Cleaning a dataframe#
Perform robust centering and scaling followed by soft clipping. |
|
Column-wise consistency checks and sanitization of dtypes, null values and dates. |
|
Drop column if it is found to be uninformative according to various criteria. |
|
Drop columns found too redundant to the rest of the dataframe, according to association defined by Cramér's V. |
|
Convert duration columns to seconds. |
|
Convert DataFrame or column to Datetime dtype. |
|
Deduplicate categorical data by hierarchically clustering similar strings. |