FDA Readies to Regulate AI and Machine Learning in Medical Devices

May 17, 2021 by Daniel Mollenkamp
FDA Readies to Regulate AI and Machine Learning in Medical Devices
Hospital Corpsman 3rd Class Austin Domenech, an interventional radiology (IR) technologist assigned to Naval Medical Center San Diego's Radiology Department, prepares an operating room for an IR procedure. (U.S. Navy photo by Mass Communication Specialist Seaman Luke Cunningham)

The U.S. Food and Drug Administration has set its sights on the issue of artificial intelligence and machine learning in medical devices. Experts now say that the agency will need to open up a specific regulatory pathway for these devices that is sensitive to the unique risks and benefits posed by this technology and its possible impact on the practice of medicine. 

Continual learning, also known as “continuous” or “lifelong” learning, is an artificial intelligence technique through which mathematical models remain adaptive to the external world. Mathematical models are able to evolve by continuously incorporating new information based on real world feedback without losing previously learned knowledge, which can make its decisions more adaptive to the outside world in a similar manner to how human and animal minds acquire new insights. Researchers have anticipated the ability of these techniques to advance outcomes in medicine because of the potential it carries for automation, accuracy, and objectivity. 

A review of the relevant databases found 222 such devices had been approved in the U.S. between January 2015 and March 2020.The number of devices that have been approved in America has increased since 2015 with many of those devices approved for radiology, a medical discipline that uses imaging, according to a comparative analysis published in the peer-reviewed journal The Lancet. 

Radiology Today, a trade publication, has said that talk about artificial intelligence in radiology is “running rampant.” 

In radiology, there are certain tasks that a machine can more quickly and simply do than other areas of medicine like psychiatry which is more reliant on patient-physician interactions and more integrated treatment, said Dr. Kerstin Vokinger, professor at the University of Zurich and affiliated faculty at the Program on Regulations, Therapeutics, and Law at Harvard Medical School, one of the authors of the Lancet study, explaining why radiology has so quickly embraced this technology. 

Publications from the FDA indicate that the regulatory body is in the process of working out a framework under which to regulate these technologies. In January, the FDA published an “action plan” which said that these devices would safely and effectively improve patient care, provided they occur under an “appropriately tailored total product lifecycle-based regulatory oversight.” 

It also said that the agency is in the process of collecting real world data about the implementation of these devices. 

Other industries, such as the autopilot function in Tesla cars, already use continuous learning, according to another study. 

That study, also published in The Lancet and co-authored by Vokinger, suggests that the FDA will need to account for a few unique risks posed by artificial intelligence and machine learning, including the possibility for new information to introduce errors or to lower the effectiveness of a device after it has been approved, as well as the potential for data sets to be racially or ethnically biased. 

“The inherent risks of continual learning systems, as well as the benefits, mean that it’s important that the FDA takes a cautious approach to regulating continual learning systems,” according to the study. 

Specifically, the study says, the FDA will need to clarify what aspects of these devices manufacturers can change after they’ve received authorization. 

“A crucial principle is to ensure that the introduction of continual learning systems does not lead to a reduction in medical device performance,” it commented. “To reach this goal, the FDA and the manufacturer should determine, during the review process, how the device’s performance could further be improved through learning, for example, by identifying and addressing specific errors.” 

Bias is a particular concern since using data based on one portion of the population has the potential to lead to real world harm to the health of marginalized groups, researchers like Vokinger explain. 

“What you can see over the past fifty years or so is that these devices in general are associated with higher risks,” Vokinger said. 

Continual learning, in this respect, can either lead to the reduction of bias or the introduction of more bias, depending on the data and practices used, Vokinger said. 

“This has already been detected as a problem, and the question now is how to mitigate this,” she said. 

The FDA action plan also flags this as a particular area of concern and reports that the agency is actively supporting research efforts to “evaluate” and “eliminate” algorithmic bias. 

Researchers expect the framework to appear sooner rather than later, given the immense interest in the technology. 

It is challenging to predict what role artificial intelligence and machine learning will have in the future of medicine, Vokinger said, when asked about how artificial intelligence and machine learning will likely shape the medical device industry. 

Just because a device is authorized by the FDA doesn’t mean it will get implemented in clinics, she said, and so it remains to be seen how precisely this will shape the industry moving forward. 

“We have this increasing number of products put on the market. To be fair, artificial intelligence is nothing super new, it has already been applied [for many years], but now more manufacturers are focused on this new technology and more sophisticated methodologies that are embedded in artificial intelligence,” she said. 

“I do believe that there’s a lot of potential, and I could imagine that in certain areas, especially in more technical areas, there could be quite a big impact,” she said.

A+
a-
  • AI
  • food anddrug administration
  • Kerstin Voknger
  • medical devices
  • The Lancet
  • In The News

    Health

    Voting

    Technology

    March 28, 2024
    by Dan McCue
    Vice President Harris Rolls Out First Government-Wide Policy to Mitigate AI Risks

    WASHINGTON — Vice President Kamala Harris on Wednesday rolled out the Biden administration’s first government-wide policy intended to mitigate the... Read More

    WASHINGTON — Vice President Kamala Harris on Wednesday rolled out the Biden administration’s first government-wide policy intended to mitigate the risks associated with artificial intelligence while still enabling its use to advance the public interest. The new policy, which is being issued through the White House... Read More

    March 21, 2024
    by Tom Ramstack
    Lawmakers Say US Semiconductors Sometimes Used by Foreign Adversaries

    WASHINGTON — A congressional panel juggled competing interests Thursday of trying to lead the world in industrial development without having... Read More

    WASHINGTON — A congressional panel juggled competing interests Thursday of trying to lead the world in industrial development without having the new technologies fall into the hands of foreign militaries that might want to harm the United States. More than anything, lawmakers want more and better... Read More

    March 21, 2024
    by Dan McCue
    DOJ, 16 States Sue Apple Over Alleged Smartphone Monopoly

    WASHINGTON — The Justice Department and 16 state attorneys general sued Apple on Thursday accusing the Cupertino, California-based tech giant... Read More

    WASHINGTON — The Justice Department and 16 state attorneys general sued Apple on Thursday accusing the Cupertino, California-based tech giant of operating an illegal monopoly in the smartphone market. According to the lawsuit, which was filed in federal court in New Jersey, Apple has used the... Read More

    House Passes Bill That Would Lead to TikTok Ban if Chinese Owner Doesn't Sell. Senate Path Unclear

    WASHINGTON (AP) — The House on Wednesday passed a bill that would lead to a nationwide ban of the popular video app... Read More

    WASHINGTON (AP) — The House on Wednesday passed a bill that would lead to a nationwide ban of the popular video app TikTok if its China-based owner doesn't sell, as lawmakers acted on concerns that the company's current ownership structure is a national security threat. The bill, passed by... Read More

    In New York City, Heat Pumps That Fit in Apartment Windows Promise Big Emissions Cuts

    NEW YORK (AP) — For 27 years, the heat in Regina Fred’s Queens apartment building came from a noisy steam... Read More

    NEW YORK (AP) — For 27 years, the heat in Regina Fred’s Queens apartment building came from a noisy steam radiator that she couldn't control and sometimes didn't come on at all, leaving her shivering. Sometimes, the radiators ran so hot that residents had to keep... Read More

    March 7, 2024
    by Tom Ramstack
    Congress Warned US Competition for Biotechnology Creates Promises and Perils

    WASHINGTON — New scientific discoveries mean the future is bright for biotechnology but laced with many dangers in the competition... Read More

    WASHINGTON — New scientific discoveries mean the future is bright for biotechnology but laced with many dangers in the competition with China, according to expert witnesses at a congressional hearing Wednesday. China’s military dominance of its industries means its biotechnology could be used to find weaknesses... Read More

    News From The Well
    scroll top