In just the modest span of my career, the volume of medical data has exploded. Well intentioned folks in my line of work call this “bloat” and worry over cajoling humans to stem the tide. We never will. Fortunately, AI will save us from ourselves.
“…it will be necessary to develop a more organized approach to the medical record…and a positive attitude about the computer in medicine…Developments [in computers] are far more advanced and immediately applicable than many realize, and concern with them is neither premature nor impractical.”
— Dr Lawrence Weed
Ahead of the Wave
That quote nails it. I love to ask my students to guess when it was written. Typical guesses range from mid-Bruce Springsteen to late-Radiohead. No one yet has guessed the correct answer – 1968, peak Beatles.
Dr Weed was a man ahead of his time. The first commercial microprocessor, the Intel 4004, didn’t hit the market until 1971 and even that was some 8 orders of magnitude slower than the bog standard hardware of 2025. An IBM 2311 disk drive could hold 7.25 MB, almost enough for 2 typical jpeg photos, yet it weighed over 100 lb.
Indeed, so far ahead of his time was he that by the time I started med school, authors reacted to Weed’s farsighted prediction “For over thirty years, there have been predictions that the widespread clinical use of computers was imminent. Yet the ‘wave’ has never broken.”
We sensed then, rightly as it turned out, that wave was finally upon us.
Just as I was emerging from med school coursework into clinical rotations, Stanford made the leap from a motley array of paper charts and siloed computer systems into Epic. As CMS’s Meaningful Use requirements – penalized starting in 2015 – loomed on the horizon, more & more organizations followed suit.
The Wave Breaks
Turns out, we needed the government. CMS Meaningful Use started to bite ~2015. 10 years on and a paper chart is about as intuitive as a telegraph to med students today.
And yet, the way we think about those data and particularly the way we train new physicians to do so barely changed. It needs to.
Behind the Wave
Even in my senior year of residency in 2015, nurses in the NICU at San Francisco General charted on actual flowsheets – specially printed paper about 3 ft wide folded twice to fit in an 8.5 in binder. At the end of every shift, they’d splay it out over whatever table they could find to tally I/Os & vital signs. We’d wait for them to finish, hovering like vultures to get data for rounds. Pen on paper, not to mention manual calculations, limited flowsheet data to at most a few dozen variables per shift. The keyboard savvy like me might type & print H&Ps, but our progress notes were pen on paper and, as such, short. No one read them.
Those days are long gone and never coming back.
Apres Moi, Le Deluge
Fast forward 10 years. The average baby in our NICU accumulates over 1,000 rows of flowsheet data every day. Those pens & folded sheets are long gone. A daily physician note can easily reach 4,000 words. As 2 month stays are not unusual, especially in the NICU, the corpus of physician notes alone can easily stretch longer than Joyce’s Ulysses. And that’s not even to mention notes from nurses, social workers, therapists & case managers.
A complex but hardly unusual patient under my care recently had well over ¾ of a million rows of flowsheet data and 330,000 words (1.8M characters) in notes. And that’s just at our hospital. He had probably as much data again at 2 other institutions from the same illness. And stayed another month after that!
No human can process that much. I get the impression few are even trying. The data explosion ship sailed when the modern electronic health record (EHR) triumphed over the ballpoint pen and writer’s cramp, and it’s never coming back. Succinctly summarizing even a fragment of that much data is a real & complex skill that even experienced clinicians struggle with.
Medical informatics & compliance types, myself included, wring their hands about these stats and dream the impossible dream of winning the battle against “note bloat” and its less poetic cousins like flowsheet bloat. A brave new world where doctors write short notes with just their impressions and medical decision making, without the meaningless boilerplate and data auto-copied from elsewhere in the chart that became standard in the great EHR wave. In short, a world…much like the pre-EHR world minus the paper. Much as this appeals to my romantic inner Don Quixote, it’s hard to imagine we’ll ever turn back the clock.
It’s Only Getting Harder
AI scribes, software that listens to a doctor’s visit and automatically generates its documentation, is all the rage in 2025 including here at Valley Children’s where many of our physicians love it. (And patients love that doctors are talking to them instead of typing in the precious minutes they have together.) But freeing doctors from the keyboard, awesome as it is, won’t help us win the Quixotic battle against note bloat. Ambient AI nursing, which does the same for flowsheets, seems the next big thing. I’m frightened to ponder how many flowsheet types we’ll create when it’s so easy to fill them in. If we’re buried in the data wave now, worse seems sure to come.
The AI Surfer
AI may not be a panacea, but it’s the only solution on the horizon.
A mere 8 years since Attention is All You Need transformed AI, large language models are excellent at summarizing and extracting relevance from the reams of data we produce in healthcare, and they’re still getting better rapidly. (For some perspective, it was 10 years from the Wright brothers’ first flight until the first paying passenger rode a plane, itself a far cry from a 747.)
Unwilling to wait for Epic to build such a feature, I built my own secure LLM interface that extracts a patient’s hospital notes and automatically drafts a summary for their discharge paperwork. I make minor edits, but it’s better and far, far faster than I could do unaided, even on a patient I know well. Soon, it will be hard to remember when humans did such work. Writing a discharge summary will be to med students today what writing paper prescriptions is to me.
Fighting note & data bloat by trying to generate less, more relevant data is a great concept…that we’re definitely not going to succeed at. Changing the way doctors write note or hospitals design flowsheets is really hard. Sifting through masses of data with AI is way easier and only getting more so.1 Practicing medicine will be different from when I trained. And that’s ok.2
[1] AI writing notes for AI. If AI scribes are writing doctors’ notes and some other AI is reading them…where exactly are we going?
[2] OK for society. But our medical education system is in for an epochal challenge. I’m not sure it’s up for it.
