November 16, 2021

New York City Council Passes Bill Requiring Oversight of AI Hiring Platforms

Written by

The New York City Council passed a bill that requires HR vendors selling AI-driven hiring screenings to undergo a yearly bias audit starting January 1, 2023. The bill is designed to ensure that hiring tools don’t use biased algorithms or standards when they select applications to move to the next step of the hiring process. 

The bill also requires companies to disclose the use of AI screening tools to applicants, allows candidates to request an alternative screening process, and requires companies to disclose to candidates the type of data collected, how it is used in the screening process, and how long that data is retained.

The bias audit would presumably be run by a third-party company that would test how the algorithm reacts to several sets of applications where details have been engineered to trigger biased reactions, although details of what the bias audits required by the city would entail were not included in the bill. 

How do AI hiring tools work?

Automated hiring tools screen application materials for keywords that match a pre-set hiring criteria, and reject applications that don’t meet these criteria. The tools are meant to help recruiters sift through piles of applications for suitable candidates quickly. 

Recruiting and applicant tracking software vendors that employ screening AI programs often market these tools as unbiased. The vendor’s reasoning is that a computer doesn’t have to fight against the unconscious bias a human recruiter might bring based on associations they have with personal details like the candidate’s name, education, or previous employment.

The bias inherent in the system

Humans build AI, and humans build the tools to audit the AI. All humans hold biases, whether conscious or unconscious, and those biases are bound to leak into the data that is used to train the AI. No artificial intelligence system will be completely without bias, and as Protocol.com points out, critics have already mentioned the bill includes provisions for race and gender bias, but doesn’t include protections against age or disability.

The rest of the nation is watching

New York City is by far the most populous city in the US, and this provision would affect any company who employs those living in the city limits. In addition to adding a burden to HR teams within the NYC area, it could affect thousands of companies located outside of the major metropolitan area whose employees live in the city. 

While this is far from the first of these bills to be proposed or even enacted in the US in the past year — Illinois enacted a similar bill governing the use of AI in video interviews — the implementation of the bias audit and data collection portions of the bill could help mold similar legislation around the country. 

Top Human Resources Software Recommendations

1 JazzHR

Visit website

Say Goodbye to outdated processes like spreadsheets and inbox recruiting, and Hello to powerful, user-friendly hiring tools designed to streamline your entire candidate-to-employee journey. With JazzHR you can easily post jobs, screen resumes, schedule interviews, collaborate with your team, extend offers and more from one central location. Get started today for as little as $39/month.

Learn more about JazzHR

2 Rippling

Visit website

Rippling is the first way for businesses to manage all of their HR, IT, and Finance — payroll, benefits, computers, apps, corporate cards, expenses, and more — in one unified workforce platform. By connecting every business system to one source of truth for employee data, businesses can automate all of the manual work they normally need to do to make employee changes.

Learn more about Rippling

3 Paycor

Visit website

Processing routine HR tasks by hand and entering data in multiple systems can be time consuming and risky. That’s why leaders depend on Paycor for a modern, adaptable, and unified system for all things HR. From engaging employee self-service, mobile push notifications and company updates to unlimited workflows, reminders, and notifications, Paycor‘s HR software helps you get out of the weeds so you can focus on bigger priorities like attracting, retaining and developing employees.

Learn more about Paycor

Need a Little Help?

Talk with a software expert for free. Get a list of software that’s great for you in less than 15 minutes.