Premature Babies Deserve Mature AI

Generative artificial intelligence (AI) has dominated healthcare discourse this past year, and for good reason: Hospitals are woefully understaffed, ill-prepared for spikes in demand for care, and cannot afford to sit idle while their margins constrict. The universe of AI-enabled digital health solutions, each of which promises a way out of the darkness and into a bright new future of care, is growing by the day.

Tracy Warren

In some cases, these tools are having a marked effect on how clinicians work. They generate documentation, automate clerical tasks, and streamline clinical workflow within the electronic health record (EHR). All good functions, to be sure. But none of them is perfect, because EHR data are notoriously imperfect.

In primary care, specialty care, and long-term care, imperfect works for now. Although every generative AI technology is likely to produce at least the occasional hallucination, they ultimately save clinicians in these settings more time than it takes to fix incorrect outputs. Clinicians in intensive care facilities, however, do not have the privilege of being able to accept imperfect AI.

In intensive care settings, the slightest errors can jeopardize outcomes. The problem is especially acute in neonatal intensive care units (NICUs), where precise measurements and complex arithmetic for nutritional intervention are a life-sustaining part of care delivery. It can mean the difference between enteral and parenteral feeding and determine a baby's length of stay in the NICU.

Data Quality in the NICU: Critical Condition

Consider your average NICU: Care is fast-paced, with nearly every clinical decision being made in real time. Those decisions are already hampered by the poor quality of the data. EHRs may contain an abundance of clinical data, but the unstructured data that NICU teams need are often either buried, missing from a patient chart, or riddled with typos. The human eye can correct for many of these errors; a NICU nurse is likely to know if an extra 0 has been accidentally added to a medication dosage based on a baby's weight and is able to account for the mistake in the moment. We cannot yet trust AI to do the same.

Poor data quality in NICUs is already fueling distrust among clinicians and creating an unruly amount of rework. The problem is fueling burnout among nurses who feel morally obligated to take time — a resource that they do not have in abundance — to double-check everything they see in a patient chart.

NICUs are simply not in a place where it would be responsible to trust AI tools in any facet of patient care — assuming that those tools are built on pediatric data to begin with. As noted in a recent framework of recommendations for the safe use of pediatric data in AI research, lack of these data is leading to inappropriate generalizations made to pediatric populations from adult datasets.

Contrary to the opinion that the time is now for NICUs to embrace AI to enhance decision-making and improve patient outcomes, health systems have much more reason to practice caution by shoring up the quality of their clinical data in intensive care settings. As the old saying goes, "garbage in, garbage out."

Prioritizing Data Vigilance

Although the allure of generative AI is strong in the face of provider burnout, what NICUs need first and foremost in order to protect the time of their staff and the lives of the babies they care for are tools and best practices that prioritize data vigilance.

At its core, data vigilance is the complete awareness of what data you need to improve clinical decision-making and optimize the workflow, how much of those data you have, and how much are missing. All of these factors are prerequisites for responsible AI, and most NICUs in the United States have a few boxes yet to check.

A recent study, for example, sought to determine changes in resources for preterm infants at 822 NICUs in the United States between 2009 and 2020. The study's results were limited by missing data on entries as simple as birth NICU level, race and ethnicity, congenital anomalies, and sex. In another study, researchers determined that anywhere from 13 to 91 medication errors may happen for every 100 NICU admissions — errors that occur most frequently because data as simple as time and date were not entered.

Perhaps the most glaring sign of a lack of data vigilance within NICUs is the fact that most are grappling with "alarm fatigue." According to a 2020 study, 87.5% of alarms from monitoring systems are false, triggered by incorrect data. The phenomenon is fueling a "boy who cried wolf" dilemma among NICU nurses, who have grown so accustomed to false alarms that response times have grown longer in the event of a real critical situation.

To improve data vigilance and eventually get to a place where AI can benefit patient care, NICUs need improved standards and clinical decision support tools to ensure the basics: no missing values on critical data points like timestamps; appropriately synchronization of data capture from monitoring devices or milk tracking software; and validation of data in real time to prevent clinicians from chasing information long after a patient has been transferred.

If NICU teams cannot trust the data they're looking at on a daily basis, health systems cannot trust that there is yet a role for AI in informing the care of our most vulnerable infants. The smaller the person, the more danger errors pose. Instilling a culture of data vigilance will ensure that the data are correct, complete, and quality enough for AI to make a difference in neonatal care.

Follow Medscape on Facebook, X (formerly known as Twitter), Instagram, and YouTube