2: Apply TableVectorizer

This step used:

1: CallMethod 'drop'

This step was used by:

4: Apply HistGradientBoostingRegressor

Where was this step created?

                
  File "/home/circleci/project/doc/conf.py", line 586, in <module>
    create_data_ops_report()
  File "/home/circleci/project/doc/data_ops_report.py", line 99, in create_data_ops_report
    employee_salary_folder = create_employee_salaries_report()
  File "/home/circleci/project/doc/data_ops_report.py", line 83, in create_employee_salaries_report
    X_vec = X.skb.apply(vectorizer)

Estimator fitted in this step:

ApplyToFrame(transformer=TableVectorizer())

In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

ApplyToFrame

iFitted

Parameters

	transformer	TableVectorizer()
	cols	all()
	keep_original	False
	rename_columns	'{}'

transformer: TableVectorizer

TableVectorizer()

numeric

PassThrough

Parameters

datetime

DatetimeEncoder

Parameters

	resolution	'hour'
	add_weekday	False
	add_total_seconds	True
	add_day_of_year	False
	periodic_encoding	None

low_cardinality

OneHotEncoder

?Documentation for OneHotEncoder

Parameters

	categories	'auto'
	drop	'if_binary'
	sparse_output	False
	dtype	'float32'
	handle_unknown	'ignore'
	min_frequency	None
	max_categories	None
	feature_name_combiner	'concat'

high_cardinality

StringEncoder

Parameters

	n_components	30
	vectorizer	'tfidf'
	ngram_range	(3, ...)
	analyzer	'char_wb'
	stop_words	None
	random_state	None

Output of this step

Column	Column name	dtype	Is sorted	Unique values	Mean	Std	Min	Median	Max
0	gender_F	Float32DType	False	2 (< 0.1%)	0.405	0.491	0.00	0.00	1.00
1	gender_M	Float32DType	False	2 (< 0.1%)	0.594	0.491	0.00	1.00	1.00
2	gender_nan	Float32DType	False	2 (< 0.1%)	0.00125	0.0353	0.00	0.00	1.00
3	department_BOA	Float32DType	False	2 (< 0.1%)	0.000375	0.0194	0.00	0.00	1.00
4	department_BOE	Float32DType	False	2 (< 0.1%)	0.00262	0.0512	0.00	0.00	1.00
5	department_CAT	Float32DType	False	2 (< 0.1%)	0.00763	0.0870	0.00	0.00	1.00
6	department_CCL	Float32DType	False	2 (< 0.1%)	0.0100	0.0995	0.00	0.00	1.00
7	department_CEC	Float32DType	False	2 (< 0.1%)	0.00800	0.0891	0.00	0.00	1.00
8	department_CEX	Float32DType	False	2 (< 0.1%)	0.00387	0.0621	0.00	0.00	1.00
9	department_COR	Float32DType	False	2 (< 0.1%)	0.0526	0.223	0.00	0.00	1.00
10	department_CUS	Float32DType	False	2 (< 0.1%)	0.00313	0.0558	0.00	0.00	1.00
11	department_DEP	Float32DType	False	2 (< 0.1%)	0.0182	0.134	0.00	0.00	1.00
12	department_DGS	Float32DType	False	2 (< 0.1%)	0.0434	0.204	0.00	0.00	1.00
13	department_DHS	Float32DType	False	2 (< 0.1%)	0.00137	0.0371	0.00	0.00	1.00
14	department_DLC	Float32DType	False	2 (< 0.1%)	0.0434	0.204	0.00	0.00	1.00
15	department_DOT	Float32DType	False	2 (< 0.1%)	0.134	0.341	0.00	0.00	1.00
16	department_DPS	Float32DType	False	2 (< 0.1%)	0.0231	0.150	0.00	0.00	1.00
17	department_DTS	Float32DType	False	2 (< 0.1%)	0.0148	0.121	0.00	0.00	1.00
18	department_ECM	Float32DType	False	2 (< 0.1%)	0.000250	0.0158	0.00	0.00	1.00
19	department_FIN	Float32DType	False	2 (< 0.1%)	0.0125	0.111	0.00	0.00	1.00
20	department_FRS	Float32DType	False	2 (< 0.1%)	0.145	0.352	0.00	0.00	1.00
21	department_HCA	Float32DType	False	2 (< 0.1%)	0.00825	0.0905	0.00	0.00	1.00
22	department_HHS	Float32DType	False	2 (< 0.1%)	0.168	0.374	0.00	0.00	1.00
23	department_HRC	Float32DType	False	2 (< 0.1%)	0.000875	0.0296	0.00	0.00	1.00
24	department_IGR	Float32DType	False	2 (< 0.1%)	0.000375	0.0194	0.00	0.00	1.00
25	department_LIB	Float32DType	False	2 (< 0.1%)	0.0399	0.196	0.00	0.00	1.00
26	department_MPB	Float32DType	False	2 (< 0.1%)	0.000250	0.0158	0.00	0.00	1.00
27	department_NDA	Float32DType	False	2 (< 0.1%)	0.00175	0.0418	0.00	0.00	1.00
28	department_OAG	Float32DType	False	2 (< 0.1%)	0.000875	0.0296	0.00	0.00	1.00
29	department_OCP	Float32DType	False	2 (< 0.1%)	0.00187	0.0433	0.00	0.00	1.00
30	department_OHR	Float32DType	False	2 (< 0.1%)	0.00738	0.0856	0.00	0.00	1.00
31	department_OIG	Float32DType	False	2 (< 0.1%)	0.000500	0.0224	0.00	0.00	1.00
32	department_OLO	Float32DType	False	2 (< 0.1%)	0.00125	0.0353	0.00	0.00	1.00
33	department_OMB	Float32DType	False	2 (< 0.1%)	0.00325	0.0569	0.00	0.00	1.00
34	department_PIO	Float32DType	False	2 (< 0.1%)	0.00625	0.0788	0.00	0.00	1.00
35	department_POL	Float32DType	False	2 (< 0.1%)	0.198	0.399	0.00	0.00	1.00
36	department_PRO	Float32DType	False	2 (< 0.1%)	0.00338	0.0580	0.00	0.00	1.00
37	department_REC	Float32DType	False	2 (< 0.1%)	0.0139	0.117	0.00	0.00	1.00
38	department_SHF	Float32DType	False	2 (< 0.1%)	0.0188	0.136	0.00	0.00	1.00
39	department_ZAH	Float32DType	False	2 (< 0.1%)	0.000500	0.0224	0.00	0.00	1.00
40	department_name_Board of Appeals Department	Float32DType	False	2 (< 0.1%)	0.000375	0.0194	0.00	0.00	1.00
41	department_name_Board of Elections	Float32DType	False	2 (< 0.1%)	0.00262	0.0512	0.00	0.00	1.00
42	department_name_Community Engagement Cluster	Float32DType	False	2 (< 0.1%)	0.00800	0.0891	0.00	0.00	1.00
43	department_name_Community Use of Public Facilities	Float32DType	False	2 (< 0.1%)	0.00313	0.0558	0.00	0.00	1.00
44	department_name_Correction and Rehabilitation	Float32DType	False	2 (< 0.1%)	0.0526	0.223	0.00	0.00	1.00
45	department_name_County Attorney's Office	Float32DType	False	2 (< 0.1%)	0.00763	0.0870	0.00	0.00	1.00
46	department_name_County Council	Float32DType	False	2 (< 0.1%)	0.0100	0.0995	0.00	0.00	1.00
47	department_name_Department of Environmental Protection	Float32DType	False	2 (< 0.1%)	0.0182	0.134	0.00	0.00	1.00
48	department_name_Department of Finance	Float32DType	False	2 (< 0.1%)	0.0125	0.111	0.00	0.00	1.00
49	department_name_Department of General Services	Float32DType	False	2 (< 0.1%)	0.0434	0.204	0.00	0.00	1.00
50	department_name_Department of Health and Human Services	Float32DType	False	2 (< 0.1%)	0.168	0.374	0.00	0.00	1.00
51	department_name_Department of Housing and Community Affairs	Float32DType	False	2 (< 0.1%)	0.00825	0.0905	0.00	0.00	1.00
52	department_name_Department of Liquor Control	Float32DType	False	2 (< 0.1%)	0.0434	0.204	0.00	0.00	1.00
53	department_name_Department of Permitting Services	Float32DType	False	2 (< 0.1%)	0.0231	0.150	0.00	0.00	1.00
54	department_name_Department of Police	Float32DType	False	2 (< 0.1%)	0.198	0.399	0.00	0.00	1.00
55	department_name_Department of Public Libraries	Float32DType	False	2 (< 0.1%)	0.0399	0.196	0.00	0.00	1.00
56	department_name_Department of Recreation	Float32DType	False	2 (< 0.1%)	0.0139	0.117	0.00	0.00	1.00
57	department_name_Department of Technology Services	Float32DType	False	2 (< 0.1%)	0.0148	0.121	0.00	0.00	1.00
58	department_name_Department of Transportation	Float32DType	False	2 (< 0.1%)	0.134	0.341	0.00	0.00	1.00
59	department_name_Ethics Commission	Float32DType	False	2 (< 0.1%)	0.000250	0.0158	0.00	0.00	1.00
60	department_name_Fire and Rescue Services	Float32DType	False	2 (< 0.1%)	0.145	0.352	0.00	0.00	1.00
61	department_name_Merit System Protection Board Department	Float32DType	False	2 (< 0.1%)	0.000250	0.0158	0.00	0.00	1.00
62	department_name_Non-Departmental Account	Float32DType	False	2 (< 0.1%)	0.00175	0.0418	0.00	0.00	1.00
63	department_name_Office of Agriculture	Float32DType	False	2 (< 0.1%)	0.000875	0.0296	0.00	0.00	1.00
64	department_name_Office of Consumer Protection	Float32DType	False	2 (< 0.1%)	0.00187	0.0433	0.00	0.00	1.00
65	department_name_Office of Emergency Management and Homeland Security	Float32DType	False	2 (< 0.1%)	0.00137	0.0371	0.00	0.00	1.00
66	department_name_Office of Human Resources	Float32DType	False	2 (< 0.1%)	0.00738	0.0856	0.00	0.00	1.00
67	department_name_Office of Human Rights	Float32DType	False	2 (< 0.1%)	0.000875	0.0296	0.00	0.00	1.00
68	department_name_Office of Intergovernmental Relations Department	Float32DType	False	2 (< 0.1%)	0.000375	0.0194	0.00	0.00	1.00
69	department_name_Office of Legislative Oversight	Float32DType	False	2 (< 0.1%)	0.00125	0.0353	0.00	0.00	1.00
70	department_name_Office of Management and Budget	Float32DType	False	2 (< 0.1%)	0.00325	0.0569	0.00	0.00	1.00
71	department_name_Office of Procurement	Float32DType	False	2 (< 0.1%)	0.00338	0.0580	0.00	0.00	1.00
72	department_name_Office of Public Information	Float32DType	False	2 (< 0.1%)	0.00625	0.0788	0.00	0.00	1.00
73	department_name_Office of Zoning and Administrative Hearings	Float32DType	False	2 (< 0.1%)	0.000500	0.0224	0.00	0.00	1.00
74	department_name_Office of the Inspector General	Float32DType	False	2 (< 0.1%)	0.000500	0.0224	0.00	0.00	1.00
75	department_name_Offices of the County Executive	Float32DType	False	2 (< 0.1%)	0.00387	0.0621	0.00	0.00	1.00
76	department_name_Sheriff's Office	Float32DType	False	2 (< 0.1%)	0.0188	0.136	0.00	0.00	1.00
77	division_00	Float32DType	False	674 (8.4%)	0.224	0.281	7.32e-05	0.134	1.12
78	division_01	Float32DType	False	675 (8.4%)	0.176	0.284	-0.557	0.172	0.821
79	division_02	Float32DType	False	674 (8.4%)	0.0400	0.314	-0.601	-0.00556	1.00
80	division_03	Float32DType	False	675 (8.4%)	0.0438	0.307	-0.404	-0.00797	1.12
81	division_04	Float32DType	False	677 (8.5%)	-0.0385	0.232	-0.804	-0.00726	0.372
82	division_05	Float32DType	False	680 (8.5%)	-0.0438	0.218	-0.657	-0.0441	0.695
83	division_06	Float32DType	False	679 (8.5%)	0.0114	0.211	-0.344	-0.00379	1.19
84	division_07	Float32DType	False	681 (8.5%)	0.00159	0.207	-0.825	-0.00348	0.936
85	division_08	Float32DType	False	681 (8.5%)	-0.0156	0.199	-0.846	-0.0131	0.666
86	division_09	Float32DType	False	681 (8.5%)	0.0151	0.185	-0.531	0.00201	1.03
87	division_10	Float32DType	False	681 (8.5%)	0.0275	0.180	-0.377	0.00560	1.23
88	division_11	Float32DType	False	681 (8.5%)	0.0166	0.175	-0.592	0.00326	0.641
89	division_12	Float32DType	False	681 (8.5%)	0.0123	0.167	-0.671	-0.00449	0.870
90	division_13	Float32DType	False	681 (8.5%)	0.0275	0.159	-0.364	0.00232	1.06
91	division_14	Float32DType	False	681 (8.5%)	-0.00633	0.155	-0.441	-0.000916	0.867
92	division_15	Float32DType	False	681 (8.5%)	-0.0135	0.151	-0.617	-0.0105	0.684
93	division_16	Float32DType	False	681 (8.5%)	0.000125	0.147	-0.559	-0.000247	0.514
94	division_17	Float32DType	False	681 (8.5%)	0.0222	0.140	-0.432	0.00498	0.533
95	division_18	Float32DType	False	681 (8.5%)	0.0128	0.140	-0.583	0.00485	0.538
96	division_19	Float32DType	False	681 (8.5%)	0.00723	0.139	-0.366	-0.00319	0.634
97	division_20	Float32DType	False	681 (8.5%)	-0.00184	0.134	-0.418	-0.00179	0.983
98	division_21	Float32DType	False	681 (8.5%)	0.00979	0.131	-0.584	-0.00555	0.610
99	division_22	Float32DType	False	681 (8.5%)	-0.00703	0.127	-0.378	-0.00466	0.596
100	division_23	Float32DType	False	681 (8.5%)	-0.00302	0.122	-0.497	-0.00400	0.600
101	division_24	Float32DType	False	681 (8.5%)	0.00308	0.118	-0.721	-0.00304	0.804
102	division_25	Float32DType	False	681 (8.5%)	0.00371	0.115	-0.330	0.00644	0.717
103	division_26	Float32DType	False	681 (8.5%)	0.00198	0.114	-0.307	-0.00839	0.644
104	division_27	Float32DType	False	681 (8.5%)	-0.00730	0.112	-0.542	-0.00115	0.633
105	division_28	Float32DType	False	681 (8.5%)	0.00185	0.108	-0.514	-0.00191	0.326
106	division_29	Float32DType	False	681 (8.5%)	0.00479	0.107	-0.326	-0.00494	0.453
107	assignment_category_Parttime-Regular	Float32DType	False	2 (< 0.1%)	0.0896	0.286	0.00	0.00	1.00
108	employee_position_title_00	Float32DType	False	431 (5.4%)	0.234	0.313	0.000532	0.0893	1.10
109	employee_position_title_01	Float32DType	False	431 (5.4%)	0.0777	0.344	-0.374	0.00421	1.08
110	employee_position_title_02	Float32DType	False	431 (5.4%)	0.109	0.301	-0.0620	0.0149	1.16
111	employee_position_title_03	Float32DType	False	431 (5.4%)	0.106	0.275	-0.166	0.0314	0.989
112	employee_position_title_04	Float32DType	False	431 (5.4%)	0.0800	0.240	-0.584	0.0430	0.684
113	employee_position_title_05	Float32DType	False	431 (5.4%)	0.0523	0.208	-0.310	-0.00336	0.963
114	employee_position_title_06	Float32DType	False	431 (5.4%)	0.0323	0.192	-0.306	0.00383	0.819
115	employee_position_title_07	Float32DType	False	431 (5.4%)	0.0106	0.190	-0.533	-0.00498	0.636
116	employee_position_title_08	Float32DType	False	431 (5.4%)	0.0360	0.177	-0.294	0.00422	0.773
117	employee_position_title_09	Float32DType	False	431 (5.4%)	0.00682	0.180	-0.514	0.00591	0.780
118	employee_position_title_10	Float32DType	False	431 (5.4%)	0.0219	0.175	-0.520	-0.00711	0.696
119	employee_position_title_11	Float32DType	False	431 (5.4%)	-0.00189	0.173	-0.437	0.00309	0.852
120	employee_position_title_12	Float32DType	False	431 (5.4%)	-0.00592	0.168	-0.499	-0.00404	0.895
121	employee_position_title_13	Float32DType	False	431 (5.4%)	0.0128	0.165	-0.449	-0.00431	0.657
122	employee_position_title_14	Float32DType	False	431 (5.4%)	-0.00423	0.160	-0.445	-0.00619	0.398
123	employee_position_title_15	Float32DType	False	431 (5.4%)	0.0178	0.155	-0.235	-0.000759	1.08
124	employee_position_title_16	Float32DType	False	431 (5.4%)	0.0113	0.145	-0.292	-0.00240	0.798
125	employee_position_title_17	Float32DType	False	431 (5.4%)	0.00434	0.138	-0.251	-0.00128	0.687
126	employee_position_title_18	Float32DType	False	431 (5.4%)	0.00572	0.136	-0.325	0.00585	1.00
127	employee_position_title_19	Float32DType	False	431 (5.4%)	0.0107	0.132	-0.319	-0.00322	0.438
128	employee_position_title_20	Float32DType	False	431 (5.4%)	-0.00353	0.129	-0.485	-0.00317	0.380
129	employee_position_title_21	Float32DType	False	431 (5.4%)	-0.00478	0.127	-0.427	0.0137	0.532
130	employee_position_title_22	Float32DType	False	431 (5.4%)	0.00195	0.125	-0.378	-0.00274	0.614
131	employee_position_title_23	Float32DType	False	431 (5.4%)	0.00778	0.123	-0.427	-0.00747	0.698
132	employee_position_title_24	Float32DType	False	431 (5.4%)	-0.00280	0.122	-0.593	0.00186	0.720
133	employee_position_title_25	Float32DType	False	431 (5.4%)	0.00829	0.120	-0.222	-0.000561	0.654
134	employee_position_title_26	Float32DType	False	431 (5.4%)	-0.00189	0.114	-0.399	0.00105	0.485
135	employee_position_title_27	Float32DType	False	431 (5.4%)	0.00517	0.108	-0.377	-0.00248	0.558
136	employee_position_title_28	Float32DType	False	431 (5.4%)	-0.000175	0.105	-0.337	-0.00239	0.551
137	employee_position_title_29	Float32DType	False	431 (5.4%)	-0.00513	0.0971	-0.802	0.0133	0.193
138	date_first_hired_year	Float32DType	False	51 (0.6%)	2.00e+03	9.33	1.96e+03	2.00e+03	2.02e+03
139	date_first_hired_month	Float32DType	False	12 (0.1%)	6.35	3.48	1.00	7.00	12.0
140	date_first_hired_day	Float32DType	False	31 (0.4%)	15.3	8.61	1.00	15.0	31.0
141	date_first_hired_total_seconds	Float32DType	False	2101 (26.3%)	1.08e+09	2.94e+08	-1.34e+08	1.12e+09	1.48e+09
142	year_first_hired	Float32DType	False	51 (0.6%)	2.00e+03	9.33	1.96e+03	2.00e+03	2.02e+03

Please enable javascript

The skrub table reports need javascript to display correctly. If you are displaying a report in a Jupyter notebook and you see this message, you may need to re-execute the cell or to trust the notebook (button on the top right or "File > Trust notebook").

2: Apply TableVectorizer

This step used:

This step was used by:

Where was this step created?

Estimator fitted in this step:

Output of this step

gender_F

gender_M

gender_nan

department_BOA

department_BOE

department_CAT

department_CCL

department_CEC

department_CEX

department_COR

department_CUS

department_DEP

department_DGS

department_DHS

department_DLC

department_DOT

department_DPS

department_DTS

department_ECM

department_FIN

department_FRS

department_HCA

department_HHS

department_HRC

department_IGR

department_LIB

department_MPB

department_NDA

department_OAG

department_OCP

department_OHR

department_OIG

department_OLO

department_OMB

department_PIO

department_POL

department_PRO

department_REC

department_SHF

department_ZAH

department_name_Board of Appeals Department

department_name_Board of Elections

department_name_Community Engagement Cluster

department_name_Community Use of Public Facilities

department_name_Correction and Rehabilitation

department_name_County Attorney's Office

department_name_County Council

department_name_Department of Environmental Protection

department_name_Department of Finance

department_name_Department of General Services

department_name_Department of Health and Human Services

department_name_Department of Housing and Community Affairs

department_name_Department of Liquor Control

department_name_Department of Permitting Services

department_name_Department of Police

department_name_Department of Public Libraries

department_name_Department of Recreation

department_name_Department of Technology Services

department_name_Department of Transportation

department_name_Ethics Commission

department_name_Fire and Rescue Services

department_name_Merit System Protection Board Department

department_name_Non-Departmental Account

department_name_Office of Agriculture

department_name_Office of Consumer Protection

department_name_Office of Emergency Management and Homeland Security

department_name_Office of Human Resources

department_name_Office of Human Rights

department_name_Office of Intergovernmental Relations Department

department_name_Office of Legislative Oversight

department_name_Office of Management and Budget

department_name_Office of Procurement

department_name_Office of Public Information

department_name_Office of Zoning and Administrative Hearings