Aug 22, 2023

Compliance Risks with AI and Automated Employment Decision Tools

Are you reviewing your procedures regarding artificial intelligence and automation? If you're updating your hiring processes and background screening programs, this is important information to know. Read through to see how regulators and lawmakers at the federal, state and city levels are focusing on AI in employment.

 

Lawmakers and regulators are increasingly scrutinizing whether AI hiring tools unintentionally perpetuate bias. While these tools can streamline hiring processes, they may pose a compliance risk if they discriminate against certain candidates.

From basic computer screening to advanced AI, various tools are used to evaluate employment candidates. These include resume scanners, employee monitoring software, virtual assistants, video technologies and job-fit algorithms that assess candidates' potential success in certain positions.

However, these tools can introduce discrimination into the hiring process, which is why legislators at the federal, state and local levels are focusing on AI in employment. Although there is no consensus on what constitutes AI and how it contributes to discrimination in hiring, upcoming laws will aim to address these concerns.

Starting in April, New York City employers are banned from using AI in employment decisions, unless they take affirmative steps to mitigate potential bias. This includes conducting a bias audit of the AI tool, making the tool publicly available and notifying job candidates about its use. Candidates or employees must also be allowed to request alternative evaluation processes if needed.

What is a bias audit?

A bias audit involves having a person or group not involved in developing or using the AI tool review it for potential bias. Further details on what this entails are expected. A main concern is that the AI tool might significantly impact or replace discretionary employment decisions, such as overruling human decision-making.

In these instances, the bias audit must calculate the selection rate for each race or ethnicity and sex category. Then, it must be reported to the Equal Employment Opportunity Commission, where the impact ratio for each category will be calculated. This involves dividing the selection rate by the rate of the most selected category. From there, the average score of individuals in a given category will be compared to the value of the highest-scoring category.

Government responses to AI

Various government bodies are scrutinizing the use of AI and automated tools in employment decision-making. The EEOC has issued technical guidance, warning employers that the use of these tools could violate disability protections under the Americans with Disability Act.

The Department of Commerce has appointed 27 members to the National Advisory Committee, which is the group that oversees AI. The White House has released a blueprint for an AI Bill of Rights, which includes provisions related to employment decisions using AI tools.

The Federal Trade Commission has also issued reports expressing concerns about the use of AI and automated tools in decision-making without human review. The EEOC has issued guidance on the use of AI to assess job applicants and employees with regard to ADA protections. Two pending federal bills would require the FTC to mandate impact assessments of automated hiring systems and algorithm usage.

Several states are taking action

California is proposing draft revisions to expand existing discrimination and employment laws that are related to liability risks for employers and vendors selling or administering automated hiring tools that leverage AI. Colorado, Vermont and Washington have created task forces to study AI. And Illinois and Maryland have enacted laws regulating the tools to some extent, though not as comprehensively as New York City.

When it comes to using AI in hiring, there are a few things to keep in mind. The definition of AI can be broad and unclear. It's important to understand what constitutes AI use in an automated hiring tool, and your legal counsel can help with this assessment. When using automated hiring decision tools, consider data retention and work with third-party vendors to ensure compliance with any new laws or regulations. Be prepared to address any implementation issues.

Although automated employment decision tools have the potential to improve efficiency, the use of these tools in employment decision-making will soon require transparency and accountability, as well as clear standards for auditing the processes.

 ©2023


 

MORE RECENT NEWS…


Jul 03, 2025

What To Know About Fringe Benefits and Taxes

When you provide workers with additional benefits on top of their regular pay, some may be taxable. As the rules can get complicated, it pays to familiarize yourself with the requirements. Read through for an overview of which benefits are taxable.


Jul 02, 2025

Working 'Off the Clock': What Employers Need To Know

Disputes over unpaid work time often arise from tasks performed outside official hours — for example, answering emails, traveling between jobsites or changing into work clothes. Employers must understand when these activities count as compensable work. Read through to learn how exempt and nonexempt statuses affect wage obligations.


Jul 01, 2025

Are You Considering Pay-As-You-Go Workers' Comp Insurance

Workers' comp insurance is essential for most businesses, but as an employer, you may have more options than you realize. Read through for an introduction to the pay-as-you-go model and the advantages of outsourcing it.


Jun 30, 2025

Paid and Unpaid Breaks: What Employers Need To Know

Employers must ensure that break policies comply with wage laws, especially when employees work through lunch, answer emails after hours or remain on call. Similarly, misclassifying paid and unpaid breaks can lead to wage violations and legal risks. Read through for key guidelines on tracking break time and maintaining compliance.


Jun 04, 2025

What Is Key Person Insurance and Do You Need It?

Have you heard of key person insurance? This is a type of life insurance policy that may positively benefit your business’s continuity, though it has both tax and financial implications. Read through to see whether key person insurance is right for your company.


Jun 03, 2025

Is This Your Situation: Managing Tax Rules for Part-Time or Seasonal Help

Do you have questions about the tax treatment of payments for part-time and seasonal help? These employees are subject to the same rules that apply to all employees — with some twists. Read through for some help on tax rules regarding part-time and seasonal help.




More News & Press can be found in our Archive.