Pandas count null values in a groupby method

Learn, how to count null values in a group by method?
Submitted by Pranit Sharma, on November 22, 2022

Pandas is a special tool that allows us to perform complex manipulations of data effectively and efficiently. Inside pandas, we mostly deal with a dataset in the form of DataFrame. DataFrames are 2-dimensional data structures in pandas. DataFrames consist of rows, columns, and data.

Counting null values in a groupby method

The groupby() is a simple but very useful concept in pandas. By using groupby, we can create a grouping of certain values and perform some operations on those values.

The groupby() method splits the object, applies some operations, and then combines them to create a group hence large amounts of data and computations can be performed on these groups.

Suppose we are given with the data frame with multiple columns and we would like to use group by in order to count the number of Nan values for different combinations of a particular column.

For this purpose, we will first use the groupby() method and apply the sum of Nan values along with this.

Let us understand with the help of an example,

Python code to count null values in a groupby method

```# Importing pandas package
import pandas as pd

# Importing numpy package
import numpy as np

# Creating dataframe
df = pd.DataFrame({
'A' : ['one','two','one','two','one','two'],
'B':['ping','ping','pong','ding','pong','ping'],
'C':[np.nan,'fis',np.nan,np.nan,'bliss',np.nan]
})

# Display original DataFrame
print("Original DataFrame:\n",df,"\n")

# using groupby by filtering df
df['D'] = df.C.isnull()
df['D'] = df.groupby(['A','B'])['D'].transform('sum').astype(int)

# Display Result
print('New DataFrame:\n',df)
```

Output:

What's New (MCQs)

Top Interview Coding Problems/Challenges!

Languages: » C » C++ » C++ STL » Java » Data Structure » C#.Net » Android » Kotlin » SQL
Web Technologies: » PHP » Python » JavaScript » CSS » Ajax » Node.js » Web programming/HTML
Solved programs: » C » C++ » DS » Java » C#
Aptitude que. & ans.: » C » C++ » Java » DBMS
Interview que. & ans.: » C » Embedded C » Java » SEO » HR
CS Subjects: » CS Basics » O.S. » Networks » DBMS » Embedded Systems » Cloud Computing
» Machine learning » CS Organizations » Linux » DOS
More: » Articles » Puzzles » News/Updates