October 14, 2025

How (not) to deal with the replication crisis

Always on the lookout for new blogs, I was happy to see a former leader at the National Science Foundation, Jim Olson, start one (↬Tyler Cowen). Based on the formal and didactic style I would say I was not the target audience for it, but it is better then nothing. It may also provide a convenient catalyst for my own thoughts.

For example: Olson’s most recent post is about the replication crisis. He points the finger on verification not being sexy enough for grant funders and academic journals, which is true. But if anything, having more people verify more and more claims in the ever-growing steaming pile of academese would make things seemingly worse, at least in the short term. This is the same kind of thinking that wanted to end medical reversals. You don’t want to end them, you want to make them unnecessary in the first place!

Now, fear of your claim being verified may frighten some researches from shooting from their hip, but unless paired with some sort of immediate punishment it would hardly make for a good stick. And what is preventing the person who made the original claim from demanding verification of the verifiers, and so on, and so forth, ad infinitum?

Olson also recommends more detailed methods, so that replication would be possible in the first place. This has already been implemented as anyone who had to fill out Cell’s never-ending STAR Methods can attest. Nature and Science have similar requirements, and some of them don’t even have a word count limit for the Methods section. Granted, many other journals aren’t as rigorous, but that should help you figure out which journals to follow.

So, instead of asking why we don’t have more people verifying claims, I would ask why we needed verification in the first place. Olson touches upon the core issue, mentioning “the time horizon problem”:

NSF grants run 3-5 years. Tenure clocks run 6-7 years. But scientific truth emerges over decades. We’re optimizing for the wrong timescale.

During my time at NSF, I saw brilliant researchers make pragmatic choices: publish something surprising now (even if it might not hold up) rather than spend two years carefully verifying it. That’s not a moral failing—it’s responding rationally to the incentives we created.

Of course it is about incentives. No amount of verifying will change that. People are chasing after tenure and accolades, not truth, and many a tenured professors shrugged their shoulders at the mansions of straw they had built over the decades. At best, they provided an easy target for a successor in the field to refute, unless of course there is a whole cabal of like-minded researchers protecting the dubious claims. But the default position is that these mansions of straw stay there, moulding and festering, side-tracking post-docs and spamming PubMed searches.

I have no clue what the solution may be. Maybe there is none and this is the equilibrium — let reality provide the final vote. But the status quo feels far from optimal.

October 13, 2025

Monday links, science and technology edition

October 12, 2025

You don’t need to be a billionaire to have a baby (or four)

If I had to name people who have influenced my life the most — not counting parents, teachers and other usual suspects whose very job is to influence you — the most surprising person on the list would probably be Mike Judge, the creator of Beavis and Butt-Head, Office Space, etc. Now, I was too young for Beavis and Butt-Head, never really got into King of the Hill and even though I appreciated the humor of Office Space I was merficuflly never exposed to that kind of office culture. No, Judge’s influence stems from a single movie, and in fact it was only the first five minutes of that movie that made a difference. I am of course talking about the introduction to Idiocracy (2006), in which a crude thought experiment pitted a WASP-ish couple of intellectuals against three trailers worth of rednecks and wondered which would result in more progeny.

No, the hereditary case for intelligence doesn’t make much sense, and the intro’s reliance on the pseudoscientific concept of IQ now seems quaint. But the fate of the two WASPs, ever waiting for better times to have children — or, more likely, the one-and-done — until it was far too late, this rang true. It was a good warning for someone just about to graduate from medical school (2008) and start what can be a never-ending journey of post-graduate medical education in the US (2010–2017).

More importantly, my then-medical student colleague, now-wife saw the same movie and had the same thoughts. If all goes well — and this late in the game, it better — we will welcome our fourth child into the world next month.

It is therefore with great interest that I read Scott Sumner’s most recent article which for once had a good and descriptive headline: Billionaire baby boom. And he has some interesting observations:

Fertility rates seem to follow a sort of U-shape. People in central Africa are too poor to afford very many luxuries, so children become the focus of their lives. Upper middle-class professionals have enough wealth to provide themselves with all sorts of fun activities, but not enough to provide full time caregivers for their children. Billionaires have so much money that they can farm out the difficult parts of raising children to servants, and just do the fun stuff like playing with their kids.

Note that it goes without saying that the upper middle-class professionals would want to outsource care for their children, and pay for it handsomely. Also left unspoken is the secret wish of every upper middle-class parent for their children to go to an elite university, which means a certain high school, and middle school, and… no wonder you would want to stick to just the one.

Thankfully, Nassim Taleb’s Incerto innoculated me against that kind of thinking, and frequent exposure to products of the above system acts as a booster of sorts. Limiting how many children you have so that you could raise one certified IYI would be a very IYI thing to do.

Living in DC, we are very much the outliers in any social circle you can imagine. “You must be really disappointed” is what a (single child) friend said to our 13-year-old. And everyone assumes the baby was a complete surprise (it wasn’t). We do hear a lot of “I don’t have children so that I can have a glass of wine in a restaurant at 6pm”. That’s fine. From my experience in health care those kinds of lives tend not to be as fullfilled in old age, but that could just be selection bias.

Anyway, you can definitely have more than one or two children without being a billionaire, and have a reasonably good lifestyle at that. In fact, better lifestyle than anyone ever in the history of humanity including royalty, other than in the last ~100 years. Factor that in when you make your own decisions.

🏀 Here is for another abysmal season!

October 11, 2025

Most hotels have introduced a bunch of cost-cutting measures under the guise of “saving the environment”, but this is something I can get behind. Even the tiniest leftovers are good for making your own liquid soap.

A sign from Inn by the Sea in Maine encourages guests to take slightly used bar soap home to reduce waste.

October 10, 2025

Friday quick hits

October 9, 2025

Thursday links, rabble-rouser edition

October 8, 2025

Don’t go to Maine, it sucks.

A scenic view features a marshy landscape with trees and tall grasses, a body of water, and a distant forest skyline under a partly cloudy sky.

October 7, 2025

📺 The Night Of (2016) we somehow missed when it first came out nine years ago (!?) but it was well worth revisiting. These kind of competent dramas with a deeper message than just whodunnit have become rare — was Mare of Easttown the last one? — particularly ones that feel like they were set in an actual place and not a softly-focused, sterilized backdrop of Netflixland.

The complete package is high enough quality to compensate for a few annoying stereotypes. Cutting to a street scene full of Southeast Asian pedestrians milling about? Queue vaguely ethnic music with a techno beat. Our innocent protagonist is sent to a penitentiary like a lamb for slaughter? Queue the wise black inmate to provide advice and protection… but is he himself in fact a wolf?

That whole prison story was a needless diversion, a sped-up Walter White to Heisenberg transformation which detracted from (to me) the more important message about the criminal justice system and all human systems in general. It says that competence in a profession is indistinguishable from obsession, is driven by annoyance not love, and is powerless against the greatest force of human civilization — institutional inertia. Application to medicine comes immediately to mind, a case of missed diagnosis standing in for wrongfully charging someone with murder. Now that would be a show to watch.

October 6, 2025

Monday links, min-max edition