Show all columns of Pandas DataFrame in Jupyter Notebook

If you are working with datasets containing a large number of columns, it can very well happen that only some of the columns are shown when displaying the dataframe or a section of it. In this tutorial, we’ll look at how to show all the columns of a pandas dataframe in a jupyter notebook.

If you prefer a video tutorial over text, check out the following video detailing the steps in this tutorial –

Default limit on columns to be shown

By default, a pandas dataframe displays a limited number of columns. You can check this with the following syntax:

import pandas as pd
pd.get_option("display.max_columns")

Output:

Depending on your pandas version and settings, you may get a different number. In our case, the result turned out to be 20. That is, if a dataframe has more than 20 columns, it will skip a few columns when displaying the dataframe.

Highlighted programs for you

Put simply, All Star is in the business of connecting students and schools. We help students find schools that are great matches for their educational needs, personal preferences and lifestyles, and schools pay us for our work.

Here's a quick Q & A of information we think you should know if you choose to use our websites. The main takeaways: Using our services is free, but starting and completing a degree, certificate or diploma program takes commitment and effort and should be considered carefully.

1. How do you provide your services for free?

Schools pay to advertise on our sites. This allows us to offer our service to prospective students like you for free.

Schools place a very high priority on enrolling students who go on to graduate. By using All Star's focused, information-rich services, schools can be more confident that the prospective students we introduce them to are truly committed to their education and to succeeding once they're enrolled in school.

2. How do you differ from your competitors?

There are other companies out there that do what we do. But there is no one that does it with more integrity or respect for our users and their choices. We put you, the student, in control. You get to choose the schools you're interested in, and you get to choose what programs you'd like to learn more about. We will never submit your contact information to a school without your consent.

3. Do you really work with ALL schools?

No. Our listings are not exhaustive, we do not list all schools, but they do include a rich selection of options. We believe this wide variety of options from hundreds of schools meets the needs of most prospective students who visit our sites. We partner with smaller schools that specialize in one particular career field, such as Pima Medical Institute, as well as world-class, multi-discipline institutions like the University of Southern California.

4. Is getting a degree really going to open up doors for me?

We really want you to succeed in the program you choose. So does your school. But we feel compelled to be very frank and upfront: You must work hard and stay committed to graduate. And assuming you do graduate, there is no guarantee you will find a job in your chosen field, or any job for that matter.

Obtaining an education has many personal benefits and can also improve your financial prospects. However, it's important to keep in mind that obtaining an education does not guarantee financial success or even a job. Job markets vary greatly by region, state, and even locally, and are affected by trends in the national economy and even international events. Other factors affecting your job-hunting success may include your job history and experience, and your level of education, degree, or certificate type. Your area of specialization plays a role, too.

5. If I do find a job, what can I expect in terms of salary?

The government publishes a great deal of information related to hundreds of jobs on the Bureau of Labor Statistics (BLS) website. We use this as a resource for many of the articles on the All Star websites. As comprehensive as the BLS information is, it is neither complete nor entirely accurate. The BLS salary information we publish is a national average. Actual salaries for a particular job or skill may be different where you live. For example, if you live in a large city or where the job market for particular skills is especially competitive, such as Silicon Valley in California, you're likely to receive a higher wage or salary for the same job than you would in a rural or economically depressed market. Other factors that can affect salary rates include the size of the employer, union contracts and governmental regulations to name a few.

6. Where are you located? How can I contact you?

All Star Directories is located at P.O. Box 1677 Renton, WA 98057. You can reach us at (206) 436-7500 or at customerservice@allstardirectories.com.

Flatiron School

Data Science Bootcamp

Product Design UX/UI Bootcamp

University of Maryland Global Campus

Cloud Computing Systems Master's

Digital Forensics & Cyber Investigation Master's

Creighton University

Health Informatics Master's

Let’s read the rain in Australia dataset in a jupyter notebook. We read the dataset from a CSV file saved locally. This is how the dataset looks if we display the first five rows in jupyter notebook.

df = pd.read_csv("weatherAUS.csv")
df.head()

Output:

Dataframe displayed with skipped columns

You can see that the dataset has 23 columns but some of these columns have been skipped (denoted by …) on display.

Display all the columns in Jupyter Notebook

To show all the columns of a pandas dataframe in jupyter notebook, you can change the pandas display settings. Let’s go ahead and set the max_columns display parameter to None so that all the columns are displayed. You can use the pandas set_option() function to alter such configurations.

# settings to display all columns
pd.set_option("display.max_columns", None)
# display the dataframe head
df.head()

Output:

Dataframe displayed with all the columns

You can see that now if we display the dataframe, all the columns are shown because we have updated the max column display settings.

Display more rows in Jupyter Notebook

You can also similarly change the display settings to show more rows when printing/displaying the dataframe. For example, to display all the rows of a pandas dataframe, set the max_rows display option to None. The following is the syntax:

pd.set_option("display.max_rows", None)

With this, we come to the end of this tutorial. The code examples and results presented in this tutorial have been implemented in a Jupyter Notebook with a python (version 3.8.3) kernel having pandas version 1.0.5

Subscribe to our newsletter for more informative guides and tutorials.
We do not spam and you can opt out any time.

Author

Piyush Raj

Piyush is a data professional passionate about using data to understand things better and make informed decisions. He has experience working as a Data Scientist in the consulting domain and holds an engineering degree from IIT Roorkee. His hobbies include watching cricket, reading, and working on side projects.

View all posts