Utah expands AI healthcare pilots amid liability and regulatory questions
Regulators are working on a liability bill as new pilots test AI for prescription refills and virtual physical therapy.
Utah has announced three new pilot programs to test artificial intelligence capabilities for refilling chronic condition prescriptions, writing initial acne prescriptions, and offering virtual physical therapy. These pilots are part of the state's AI sandbox, which allows companies to test technologies in exchange for regulatory relief and state oversight.
Zach Boyd, director of Utah’s Office of Artificial Intelligence Policy, said at the ADAPT conference in Santa Fe on Thursday that regulators are working on a liability bill to build a statutory framework. The state is currently mulling how to split legal liability between AI vendors and the human clinicians who oversee them if patients are harmed. Boyd noted that regulators expect the default to be that physicians will bear too much liability.
The Utah Medical Licensing Board previously opposed an AI prescription refill pilot, calling for its immediate suspension in an April letter. Following six months of discussions, the board formed a working group that meets with state regulators weekly. As a result of this scrutiny, the state removed drugs such as the headache reliever Butalbital and the antiarrhythmic medication Flecainide from the list of prescriptions AI can refill.
To manage risks, the Office of Artificial Intelligence Policy has required companies in the sandbox to carry special liability insurance and not waive liability. However, Boyd stated that insurance is less sustainable in the long run and the state needs a way to hold vendors directly liable for the actions of automated systems. A liability bill is expected to be unveiled during the state's interim legislative session this month or next month.
The state has also engaged six independent evaluators to assess the technical claims of AI companies. These evaluators include the Coalition for Health AI, Clarion AI Partners, Glacis Technologies, mpathic AI, Vega Health, and the Stanford Clinical Excellence Research Center. Mark Sendak, CEO and co-founder of Vega Health, said evaluators will need to constantly repeat assessments as AI models change and expand to new populations.
Questions remain regarding whether the Food and Drug Administration will regulate the pilot technology. Some lawyers suggested that software used to treat or diagnose patients may require pre-market authorization from the FDA. Boyd said he hopes to work with federal regulators to create a unified regulatory pathway for AI.
Key facts
- Utah is testing AI for acne prescriptions, virtual physical therapy, and chronic condition prescription refills.
- Zach Boyd is working on a liability bill to determine responsibility between AI vendors and clinicians.
- The state removed Butalbital and Flecainide from the list of drugs AI can refill following medical board scrutiny.
- Six independent evaluators have been tapped to assess the technical claims of AI companies in the sandbox.
Three perspectives
Neutral
Utah is expanding its AI sandbox to include new healthcare pilots while developing a legal framework for liability.
Positive
The state has established a working group with the Medical Licensing Board and engaged independent evaluators to oversee technical claims.
Negative
Regulators face uncertainty regarding legal liability for patient harm and potential oversight from the FDA.
Your week in news, every Wednesday
The biggest stories of the week for your edition, in your inbox every Wednesday morning, your time. Free, and you can unsubscribe at any time.