Cleaning a dataframe#

SquashingScaler

Perform robust centering and scaling followed by soft clipping.

Cleaner

Column-wise consistency checks and sanitization of dtypes, null values and dates.

DropUninformative

Drop column if it is found to be uninformative according to various criteria.

DropSimilar

Drop columns found too redundant to the rest of the dataframe, according to association defined by Cramér's V.

DurationToFloat

Convert duration columns to seconds.

to_datetime

Convert DataFrame or column to Datetime dtype.

deduplicate

Deduplicate categorical data by hierarchically clustering similar strings.