Posts in: tech

Why AI can't replace health care workers just yet

To convince myself that I am not completely clueless in the ways of medicine, I occasionally turn to my few diagnostic successes. To be clear: this is cherry-picking, and I make no claim for being a master diagnostician. Yes, a bunch of my colleagues had missed the first patient’s friction rub that was to me so evident; but say “friction rub” to a third-year medical student and they will know immediately the differential diagnosis and the treatment. How many friction rubs have I missed actually hearing? Plenty, I am sure! Like this one time when a 20-something year old man who languished in the hospital for days with severe but mysterious chest pain. Our first encounter was on a Saturday, when I saw him as the covering weekend resident; he was discharged Sunday, 24 hours after I started treatment for the acute pericarditis he so obviously had.

Once, during a mandatory ER rotation, I figured out that a patient who came in complaining of nausea and vomiting actually had an eye problem: bilateral acute angle closure glaucoma. I pestered the skeptical ophthalmology resident to come in on a Sunday afternoon, confirm the diagnosis, treat the glaucoma, likely save the patient’s vision, and get a case report for a conference out of it.

And I will never forget the case of the patient who was in the steaming hospital room shower whenever I saw him; he had come in for kidney failure from severe vomiting and insisted he never used drugs, illicit or otherwise. Still, it was obvious with anyone with a sense of smell that he had cannabinoid hyperemesis syndrome and would have to quit.

Superficial commonalities aside — all three were men with an acute health problem — what ties these together is that I had to use senses other than sight to figure them out: This being the 21st century taste is no longer allowed, but I will leave to your imagination how doctors of old could tell apart the “sweet” diabetes (mellitus) from the “flavorless” one (insipidus). hearing the friction rub, feeling the rock-hard eyeballs, smelling the pungent aroma of cannabis. And all three cases came to mind when I read a tweet an X about ChatGPT’s great diagnostic acument.

I can’t embed it — and wouldn’t even if I could — but the gist of Luca Dellanna’s extended post is that he:

  1. Had a “bump” on the inside of his eyelid that was misdiagnosed by three different doctors.
  2. Saw the fourth doctor, who made the correct diagnosis of conjunctival lymphoma.
  3. Got the same, correct diagnosis from ChatGPT on his/its first try.

A slam-dunk case for LLMs replacing doctors, right? Well, not quite: the words Luca used to describe the lesion, “a salmon-pink mass on the conjunctiva”, will give you the correct response even when using a plain old search engine. And he only got those words from the fourth doctor, who was able to convert what they saw into something they could search for, whether in their own mind palace or online.

Our mind’s ability to have seamless two-way interactions with the environment is taken for granted so much that it has become our water. This is the link to the complete audio and full text of David Foster Wallace’s commencement speech that became the “This is Water” essay, and if you haven’t read it yet, please do so now. But it is an incredibly high hurdle to jump over, and one that is in no danger of being passed just yet. It is the biggest reason I am skeptical of any high proclamations that “AI” will replace doctors, and why I question the critical reasoning skills and/or medical knowledge of the people who make them.

In fact, the last two years of American medical education could be seen as simply a way of honing this skill: to convert the physical exam findings into a recognizable pattern. A course in shark tooth-finding, if you will. This is, alarmingly, also the part of medical education that is most in danger of being replaced by courses on fine arts, behavioral psychology, business administration, medical billing, paper-pushing, box-checking, etc. But I digress.

Which is not to say that LLMs could not be a wonderful tool in the physician’s arsenal, a spellcheck for the mind. But you know what? Between UpToDate, PubMed, and just plain online search doctors already have plenty of tools. What they don’t have is time to use them, overburdened as they are with administrative BS. And that is a problem where LLMs can and will do more harm than good.


On the benefits of microblogging

The five or so regulars readers of this blog may have noticed a pattern of promises made and not kept of things I will, may, or should discuss at some future, unspecified point. These were usually somewhere in the margin notes, but sometimes I would end with a cliffhanger. The topics included mental models, notable microblogs, and ABIM’s financial shenenigans; in my head, the list was significantly longer, and the items expanded into 1,000+ word posts that would be a slog to reference, a nightmare to edit, and which no one would ultimately read.

Up until last year, whatever I thought about those topics would stay in my head, waiting for the stars to align and for the Gods of chaos and time Also known as my children. to smile upon their humble servant. Which is a net good for the reading public — who needs to read the unbaked thoughts of an oncologist? — but as Cory Doctorow wrote, having one’s thoughts written down is good practice both for developing them and for future reference. I was, in a way, depriving my future self of the benefit of knowing how big of a fool my past self was.

But ever since learning of the micro.blog/MarsEdit combination This is Miraz Jordan’s brief YouTube introduction to the two; 15 minutes of time well spent if you have even a tiny bit of interest., I’ve maintained a daily log of thoughts, readings, viewings, and writings. The low friction of the tools begs for scattered non-sequiturs and word salads — think of an unkempt Obsidian database — but the semi-social veneer that micro.blog provides tempers my worst instincts and makes the posts better overall for everyone exposed, including my future self. Sure, those longer texts still don’t get written — although, just watch this one grow! — but for personal use the snippets are even more valuable (and easier to skim).

Not everyone should be a capital-b Blogger — or have a gated newsletter for that matter — but many more people could benefit from a small-p personal blog of the commonplace type. The reason I bristle at overproduced “content” and at statements that anyone who writes must give it their all, strive to perfect everything they write above the 80%-done good-enough-for-government-work standard that is close to my heart, is that they create the wrong impression of what blogging could/should/would be if it hadn’t been for the Huffington Posts and the Gawkers of the peak-blog internet that equated blogging with monetization. And also why I took an initial dislike of The Curator’s Code despite its obvious usefulness. Why should personal blogging be standardized? It’s Personal!

And if you want to find some of these to read, for instruction, inspiration, or just plain enjoyment? Outside of the great micro.blog blogs — check out the Discover page for a daily sampling — there is Dave Winer’s scripting.com, John Naughton’s Memex, Ian Betteridge’s Technovia, Reader John’s Tipsy Teetotaler, Jerry Coyne’s Why Evolution is True, and oh so many more.


Phrase of the day: digital dandruff. Thank you, Charlie Warzel.


I’ve recently had to do a simple but tedious literature search: finding the incidence and prevalence of a handful of rare diseases, using only peer-reviewed articles as reference. The perfect job for AI, some would yes. Well, yes for an AI, but apparently not for LLMS.

I am a proponent of using LLMs as tools of the spellcheck sort, but they are still not ready to act as serious research assistants. Bing presented me with gobbledygook that ended with a repeating string of “KJKJKJKJ” or some such — and no, my prompt was not for it to pretend a cat was walking over the keyboard — while Bard gave a beautifully formatted table full of inaccurate numbers and fake references. Correcting it would have taken more time than doing the research myself.

Which is to say: I anticipate a lot of angst when incoming students start passing off unadulterated LLM work as their own in anything that’s not a business writing course.


Kudos to @danielpunkass for making MarsEdit idiot-proof. I was writing a long-ish text this morning and while uploading the photo the app crashed, an unsaved post disappeared, and my heart sank. But on restart, everything was still there. Phew! ❤️


The roundaboutness of Apple

Jason Snell notes that the iMac’s strongest legacy was Apple itself:

The company was close to bankruptcy when Jobs returned, and the iMac gave the company a cash infusion that allowed it to complete work on Mac OS X, rebuild the rest of the Mac product line in the iMac’s image, open Apple Stores, make the iPod, and set the tone for the next twenty five years.

I’m currently reading The Dao of Capital, which is all about the Austrian school of economics and the roundaboutness of true entrepreneurs, and this made what Apple is doing even more salient. Can you name a more roundabout tech company than Apple? To be clear, I suspect little of this was premeditated in the long term — i.e. no, Jobs and Ive probably did not have a Vision Pro in mind as the ultimate goal when they thought of the iMac — but the ethos of seeing everything as a potential intermediary and not commoditizing it fully à la Samsung is very much the Apple way. Using the iMac as the intermediate step towards the iPod, which was itself an intermediate step towards the iPhone, which was supposedly to be an intermediate step towards the iPad but turned into something much greater, though it also did end up being an intermediate step towards Apple silicone, all the while peppering these intermediary products with technology — LiDAR, ultra-wide lenses, spatial audio — that would become the key building blogs of Vision Pro, which is itself an intermediary towards who knows what. Very Austrian.

Thinking more closely to home, I can think of a few biotech companies that may be doing something like this — maybe, if you squint — but none come close. The addiction to immediate profits that the distorted American health care market provides is much too great.(↬Daring Fireball)


This weeks’s Galaxy Brain from Charlie Warzel, about the apparent decline of Wirecutter, is spot on:

Wirecutter’s trajectory is the story of what the internet does to most great ideas: It forces them to scale, and then others replicate the concepts at varying levels of quality until, eventually, an economic, algorithmic wildfire is burning. The original is consumed and left in a scarred landscape.

Not just the internet, I would say. It’s the American way of doing everything!


“In Defense of the Yugo”:

The Yugo had problems, but it also had the right idea: a cheap, fuel-efficient, sensibly sized car where the only point is transportation from one place to another. Cars as conspicuous consumption has been a disaster for the planet and for society at large. The end goal is to move away from car dependency and toward actually sustainable transportation — but as long as we have cars, small and fuel-efficient is the standard by which we should build them.

The Yugo as a foot soldier in the war against cars? Checks out.


I love that micro.blog hosts blogs as static websites. But if I were ever to need a non-blog static website, FastMail would be my number 1, 2, 3… host of choice. They’ve managed my email for a decade and have been nothing but outstanding. ↬This day’s portion


Three months ago I would have thought this recognize-the-scam quiz from The Washington Post was too easy, misguided, just useless. But I’ve recently seen my dad interact with the modern Web, and I strongly recommend you forward this link to anyone you know who is over 70.