California’s Assembly Bill 1018: A Pivotal Moment in AI Regulation

By Khari Johnson, CalMatters

Reading materials and fliers at the Sacramento Works job training and resources center in Sacramento on April 23, 2024. The center provides help and resources to job seekers, businesses, and employers in Sacramento County. Photo by Miguel Gutierrez Jr., CalMatters

This article was originally published by CalMatters. Sign up for their newsletters.

The Long Road to Regulation

For the past three years, Assemblymember Rebecca Bauer-Kahan has been championing Assembly Bill 1018 (AB 1018) in California, which aims to ensure transparency and accountability in automated decision-making. However, as the legislative session came to a close, she announced that the bill will not progress this year and will be designated as a two-year bill, allowing it to be revisited in next year’s session. This decision, made in the final hours of the legislative calendar, reflects the complexities of navigating a landscape filled with opposition and diverse stakeholder interests.

The Core of AB 1018

At its heart, AB 1018 seeks to give Californians the right to know when artificial intelligence (AI) systems are making significant decisions in their lives. This includes areas such as employment, healthcare, finances, and education. The bill mandates disclosure from businesses and government entities regarding the use of automated systems in crucial decisions like hiring, issuing loans, or determining eligibility for social services.

Moreover, if these systems make errors, AB 1018 provides individuals the right to contest these decisions within 30 days. Crucially, it mandates that algorithms must treat all individuals equally and prohibits discrimination based on factors like age, race, gender, and disability.

Context and Need for Regulation

Automated systems are increasingly used to evaluate and score individuals, which can have profound implications on their lives. For example, such systems may prevent someone from receiving unemployment benefits, lower their chances in job applications, or even deny them healthcare based on erroneous data. Undoubtedly, these technologies can wield enormous power, making it’s imperative to have checks in place.

Bauer-Kahan emphasized that the "pause" on the bill is not a retreat but a necessary step toward getting the legislation right. The principles encompassed in the bill are drawn from the Biden administration’s AI Bill of Rights, highlighting a growing recognition of the need for regulatory frameworks around AI technologies.

The Legislative Landscape

California has a significant history regarding AI regulation, yet it still lacks transparency laws similar to those found in Colorado and the European Union. The decision to pause AB 1018 allows more time for discussions with Governor Gavin Newsom and the more than 70 opponents the bill has garnered.

The political climate surrounding AI regulation is challenging. At the federal level, there has been opposition to AI regulations, with some politicians expressing concerns that they could inhibit technological progress. This backdrop further complicates California’s path to establishing its own set of guidelines.

The Struggle Against Opposition

In a clear demonstration of the legislative challenges, AB 1018 has drawn significant opposition from tech giants, industry groups, and even healthcare providers. Companies such as Kaiser Permanente and Epic Systems have argued that this legislation could hinder patient care and increase costs due to the regulatory burdens it imposes.

Samantha Gordon, Chief Program Officer at TechEquity, remarked on the unprecedented number of lobbyists attempting to quash AB 1018, suggesting that while the bill had a viable path to passage, the decision was made to pause and re-strategize, especially considering Governor Newsom’s impending departure from office.

Critics have voiced concerns about the financial implications of the legislation. Estimates suggest AB 1018 could cost local and state agencies hundreds of millions of dollars, although these figures have been contested.

The Voices Behind the Bill

Despite the opposition, there is a grounded support base for AB 1018. Labor unions, privacy advocates, and civil rights organizations have rallied behind the bill, seeking strong protections against potential AI abuses. Polls consistently show that the public is in favor of stronger laws regulating AI, indicating a clear demand for legislative action.

Coauthors of the bill include prominent lawmakers who have previously pushed for AI regulations, ensuring that the conversation about accountability in technology continues within the California legislature. These legislators recognize the urgency of enacting laws designed to protect citizens from the unintended consequences of automated systems.

Looking Ahead

With AB 1018 postponed, the conversation around AI regulation in California is far from over. As stakeholders continue to engage in discussions, the necessity for a transparent and accountable AI framework has never been more crucial. The challenges that lie ahead will require collaboration, negotiation, and an unwavering commitment to safeguarding the rights of Californians in an increasingly automated world.

This article was originally published on CalMatters and is republished under the Creative Commons Attribution-NonCommercial-NoDerivatives license.