Make money doing the work you believe in

There's no discussion given here to the possibility that foundation models will ever get good enough to do this job out of the box. I'm not so sure. They are a) getting better faster b) have a lot of incentive to develop guardrails for "compliance" heavy businesses like finance and healthcare. In Clayton Christenson terms, the risk to OE might be from "beneath" not "above"

But engaging on the question as posed-

It's extremely unlikely that UpToDate-based AI will be as good as OpenEvidence, as long as OE avoids platform decay (aka "enshitification") that is the cardinal sin of two-sided attention marketplaces 

Both models will be generally trained LLMs with post-training/ RAG/ system prompts/ guardrails/ inference on top, with one drawing most strength from human-curated summaries, the other more directly from the literature/ trials/ guidelines. 

[In other words, I'm willing to bet this is will not be true "UpToDate tool won’t scour the entire medical literature or the unfiltered internet for insights. Instead, UpToDate’s AI will draw its wisdom exclusively from its thousands of continuously updated chapters, written by experts."]

There is no way that those Paul Bunyan humans will be able to compete on scale and speed, and the most likely outcome is that what they paste into their updates will increasingly be OpenEvidence generated anyway. 

The observationally trained model (Epic corpus) will also start with general knowledge (much as medical doctors start as adult humans with bachelors degrees)- but the interesting question will be whether the experience of real world "good doctors" (not the average or "doctors like you") will be able to be harnessed for greater acceptability/ feasibility realism - especially if it deviates from the evidence base to a significant degree ("I know the CHF GDMT calls for 3 meds, but go slow in elderly patients").

IMO the real question is not whether UpToDate or Epic can leverage their *content* but whether they will be able to leverage their *distribution* to pose a challenge to OE; how expensive / difficult it will be for them to replicate the exact model-building, guardrails, RAG, prompting approach that OE has taken; and how tainted OE will become from a pharma-ad driven business model. 

Oct 6
at
5:05 PM
Relevant people

Log in or sign up

Join the most interesting and insightful discussions.