Many employers commonly use automated or AI-based tools as part of their hiring processes, including to advertise job opportunities, collect and filter applications, review resumes, conduct interviews, and more. These tools can enable or exacerbate discrimination in hiring based on race, sex, disability, or other protected characteristics, and applicants may not even know they are being used in the first place.
Because of a recently enacted law, employers in New York City using these technologies are now required to work with independent auditors to conduct “bias audits” of some of the tools they use and share certain results publicly. While employers are required to provide a link to relevant bias audits on their website, these audits can be very difficult to find, and some employers have posted and later removed this information. We think that for algorithmic audits to provide meaningful transparency, they should be easily accessible. That's why the ACLU and NYCLU created this repository, where you can find examples of bias audits employers have posted publicly, as well as links to Perma.cc captures of employers' bias audits.
If you know of Local Law 144 bias audits that employers have posted that we missed, you can email us to let us know.
| Deploying Entity* | Tool Vendor or Name | Auditor | Date of Audit | Original | Perma.cc Capture | Other Entities That Have Posted the Audit |
|---|---|---|---|---|---|---|
| ADP | ADP Profile Relevance and Candidate Relevancy | BLDS, LLC | 04/2023 | Removed from employer website | Capture from 11/06/23 | |
| ADP | ADP Profile Relevance and Candidate Relevancy | BLDS, LLC | 04/2024 | From ADP.com | Capture from 7/31/24 | |
| Bloomberg | PLUM Assessment | Resolution Economics, LLC | 7/3/2023 | From CDN | Capture from 11/03/23 | |
| BNP Paribas | pymetrics inc. (Harver) Soft Skills Platform | BABL AI | 6/29/2023 | From BNP Paribas Job Posting (see link to bias audit at the bottom of the page) | Capture from 1/03/24 | |
| Dover | Dover | Varun Ganesan | 6/23/23 | From CDN | Capture from 11/03/23 | |
| Eightfold.AI | Eightfold Matching Model | BABL AI | 6/16/2023 | From Eightfold.AI | ||
| HackerRank | HackerRank Plagiarism Detection System | BABL AI | 6/30/2023 | From HackerRank.com | Capture from 11/02/23 | |
| HackerRank | HackerRank Image Analysis System | BABL AI | 6/30/2023 | From HackerRank.com | Capture from 11/02/23 | |
| The Hartford | Unknown/Not Disclosed | DCI Consulting Group | 7/5/2023 | Removed from employer website as of 11/02/23 | Capture from 8/11/23 | |
| HiredScore | HiredScore | Unknown | 7/2/2023 | From HiredScore.com | Capture from 11/02/23 | |
| JetBlue | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | From JetBlue.com | Capture from 11/06/23 | |
| Morgan Stanley | Eightfold Matching Model | BLDS, LLC | 7/5/2023 | From MorganStanley.com | Capture from 11/03/23 | |
| NBCUniversal | SmartRecruiters SmartAssistant | Conductor AI | 7/11/2023 | From ConductorAI.co | Capture from 11/03/23 | AdTalem |
| NYU Langone Health | Talent Plus | Ambrose Consulting, LLC | 2023 | From CDN | Capture from 1/03/24 | |
| Paradox | Paradox's Olivia Chatbot | Holistic AI | 6/5/2023 | From Paradox.AI | Capture from 11/02/23 | |
| Paradox | Paradox's Traitify Tool | Holistic AI | 6/12/2023 | From Paradox.AI | Capture from 11/02/23 | |
| Pfizer | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | From CDN | Capture from 11/03/23 | |
| Plum | Plum Discovery Survey | Unclear, audit reviewed by Dr. Thomas O’Neill, Dr. Deborah Powell, and Dr. Andrew Speer | 2022/2023 | From help.plum.io | Capture of executive summary from 1/03/24 | |
| Reejig | Reejig Ethical Talent AI | Holistic AI | 11/30/2023 | From Reejig.com | Capture from 1/03/24 | |
| RippleMatch | RippleMatch Fit Score Algorithm | BABL AI | 6/22/2023 | From Ripplematch.com | Capture from 11/03/23 | |
| Sheppard Mullin | Suited Law Assessment | Holistic AI | 5/26/2023 | From WellSuited | Capture from 11/02/23 | |
| Wells Fargo | Unknown | DCI Consulting Group | 7/5/2023 | From WellsFargoJobs.com | Capture from 11/03/23 | |
| Covey | Covey | ConductorAI | 8/10/2023 | From getcovey.com | Capture from 2/1/24 | Vannevar Labs |
| Vervoe | Vervoe Assessment | Holistic AI | 3/21/2024 | From vervoe.com | Capture from 4/24/24 | |
| ZoomInfo | ZoomInfo | Unknown | 5/15/2023 | From ZoomInfo.com | Capture from 4/24/24 | |
| Burlington | HireVue (various assessments for Intern or new college graduate jobs) | DCI Consulting Group | 7/5/2023 | From CDN | Capture from 4/24/24 | |
| Burlington | HireVue assessment used for Allocation Analyst role | DCI Consulting Group | 11/1/2023 | From CDN | Capture from 4/24/24 | |
| Burlington | HireVue assessment used for Intern role | DCI Consulting Group | 11/1/2023 | From CDN | Capture from 4/24/24 | |
| Bryq | Bryq Talent Intelligence | Holistic AI | 5/15/2023 | From CDN | Capture from 4/24/24 | |
| Citizens | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | From CitizensBank.com | Capture from 7/10/24 |
*The term "deploying entity" generally refers to the entity that posted the associated audit report on their website, which may be a tool vendor or an employer using a vendor's tool.
The tracker in this repository is licensed under CC BY-NC 4.0.