Posts in: science

The price one pays to perform research

Today I learned, thanks to a leaked email from Vinay Prasad to his staff, I also learned that Prasad puts a double space after each period which is inexcusable in 2025 when we all use variable fonts on our electronic devices, not a fixed width-font typewriter. Whatever his high school typing teacher told him, he should drop the habit.that FDA’s CBER does actual bench research. This is pure stupidity on my part, as it is right there in the name: Center for Biologics Evaluation and Research. Silly me. They have a page dedicated to describing the work of their 65 principal investigators, and it seems to be at least on par in topics and rigor to the work done at the NIH Intramural Research Program though the latter if of course bigger.

Prasad’s email boils down to this: CBER research staff has strayed from its mission, which is primarily regulatory. We will look at work performed and planned and cut that which is not in line with the mission. He invokes sunken cost fallacy by name, so one would assume work in progress will also be cut, maybe even things completed that haven’t yet been written up — why spend hours formatting a manuscript when you could be reviewing IND Investigational New Drug applications and BLAs Biologics License Application, and let me use this sidebar to note how infuriating it is that one acronym includes the word “application” in it and the other doesn’t, forcing one to resort to clumsy phrases such as the one to the left. I supposed you could write “BLAs and IND applications” but that is listing them out of sequence. instead? And we certainly shouldn’t abuse the privilege of conducting research without having to apply for grants by just padding our CVs with insignificant work that will never be cited, which is another thing Prasad rises against.

My initial reaction was “damn right” but then I realized that regulatory review is just another price scientists-at-heart pay in order to do the work they want, similar to teaching in academia and low pay with no opportunity for outside activities at the NIH IRP. I suppose that eliminating the opportunity for self-directed research — which is what Prasad proposes instead of, let’s say, cutting it down to 10–20% of one’s time — would select for a certain type of a person (I imagine a box-checking blankface) but is that what we want? Is that what Prasad wants?

The tedious and unappreciated work of regulatory review is the price some scientists are willing to pay in order to perform research. Giving scientists the opportunity to do the work that’s meaningful to them is the price the FDA may have to pay to get good people to perform regulatory review. Any important scientific contributions that arise from this concession should be seen as an unexpected gift, not a requirement for staying employed as a reviewer.


Monday links from assorted social networks, on science, medicine and game development

  • Tom Forsyth on Mastodon: “Recent discussion about the perils of doors in gamedev reminded me of a bug caused by a door in a game you may have heard of called Half Life 2.” Parallels in biology immediately come to mind.
  • David Roberts on Blue Sky: “In an era filled with tech dipshits who never developed emotionally past the age of 13 & use their wealth to become odious monsters … listen to Steve Wozniak.” We are where we are in big part because there weren’t enough Steve Wonziaks in key industries when it mattered. Or rather, because they by definition bowed out and gave the sociopaths free space to roam.
  • Ruxandra Teslo on X: “We should do smth abt this.” The “this” is the threat of clinical trial infrastructure being flooded by the biotech equivalent of AI slop. And many misguided people think that this is a good thing!
  • Joe Janizek on Substack: The birth of Advanced Radiology. Or: radiology as chess. Radiology and pathology are the few areas of medicine in which AI may be produce immediate benefit.
  • Nassim Taleb on Substack: Medical Mistakes with Probability, 2. Why the benefit of statins in people with barely elevated cholesterol and no other risk factors is grossly overestimated. Note that this constitutes most of the market for statins! My cynical take: Now that they are all out of patent I don’t think anyone would complain about cutting back.

Real-world evidence in support of closed science

When I wrote that opening up science and increasing trust in it are mutually opposed goals, I didn’t imagine the perfect example would come up so soon in both the thing that happened and the commentary about the thing. It is helpful, when interpreting what follows, to keep in mind CS Lewis’s lecture on The Inner Ring with the following two adjustments: there are in fact many rings, concentric, with people ordered in them according to some gradient; and although academia has the secret rings Lewis talks about there are also many public ones with members known, where the innermost ring to a high degree overlaps with Harvard.

The first thing that happened was a segment on 60 Minutes, America’s premier newstainment show, about the current administration’s defunding of Harvard and the implications for science. A few scientists gave interviews, including a bench researcher whose lab studied “different aspects of cancer biology, including tumor heterogeneity, cell-cell interactions, tumor microenvironment, cancer metabolism, drug resistance, and cell signaling.” So, very much a “cancer researcher”, though as far removed from the practical aspects of cancer management as you can imagine. Still, from applying for grants to writing up research results for peer-reviewed journals, scientists have been conditioned to tie whatever they are doing to real-life, practical applications: in the interview Dr Brugge said what she and her post-docs must have written hundreds of times before, that her work has the potential to prevent breast cancer.

There is a legitimate discussion to be had about overblown claims to practicality. The debate has in fact been ongoing for decades now in the editorial pages of various scientific journals. But then someone formerly of Harvard, then Duke, then out of academia completely after a legal dispute, wrote about the issue in light of the segment. This is the second thing that happened.

The article for the most part lists personal observations about the two scientists interviewed for the segment (the second was David Liu, about whom the authors had kinder words). It very much had the sound of someone expelled from the circle grinding an ax with the inner ring. This led to even its salient observations being framed somewhat maliciously. For example:

Universities and their faculty have learned that success in today’s system depends not as much on actually doing science but on marketing the perception of science — framing even routine findings as lifesaving advances. “Cancer” has become a brand, a universal justification for more funding and prestige. The public sees heroism; insiders see dollar signs. One of the strangest features of this ecosystem is how many researchers who do pure basic science — work with no foreseeable medical application — nevertheless frame their research as “curing cancer.”

Which goes from pure speculation to undisputable fact. The need to frame everything as “curing cancer” stems from all the money being allocated to cancer research. It is all about the incentives: Willie Sutton robbed banks because “that’s where the money was” and scientists are no different.

But did I just, even in this gentler framing, compare scientists to bank robbers? See, this is why the debate is best held behind closed doors, lest a politician uses the fact that most research findings are false as an excuse to cut funding. This is what most comments to [Mike

This is the open science dilemma: have the debate out in the open and risk providing ammunition to your enemies? Or do it behind closed doors and risk mistrust? A few decades ago the point was moot as the “enemies” were first powerless hippies, then only slightly more empowered religious zealots. As we all know, the anti-science front has since strengthen. Why that is, well, that is yet another debate. Since one of the reasons is that many scientists openly picked sides, whether out of conviction or out of fear from being ostracized, this is also a debate best held behind closed doors.

Until that happens, we will continue to have dialogues such as this one, The link is to what I think is the final post in the back-and-forth, which I think is the only guaranteed way to show the entire thread, but X truly wasn’t built for sharing these kinds of interactions and is not the best medium for having them. all in support of the beef-industrial complex. Other fields have already wised up: the Internet is dying on the outside but growing on the inside, with important conversations moving to private forums. Which, as I argued, they should.


After citing Niko McCarty’s list of 30 biomedical essays yesterday, I had an urge to find each and have a separate post linking to them. Well, good thing I procrastinated because he just came out with an ever longer list (130 and counting) that does have the links. Still no Mansions of straw…, but I’ve just asked asked him to consider adding it so let’s see how the list evolves.


Thursday Twitter hits, biomedical


A brief update to yesterday’s post notes that there are still people who care about the true meaning of epigenetics, and even call themselves theoretical biologists. Note that the Institute for Systems Biology is not some drive-by operation, and indeed is the home of this year’s winner of the Nobel prize in medicine. There may be hope yet. (ᔥJeffrey West, on X)


On theoretical biology and gene regulatory networks

I have been using OmniFocus since 2016 and from the very beginning have kept a running list of blog post ideas which I almost never use. “Write about Taleb’s VC quote” says an entry from October 11, 2024. More than a year later I did write about it, but not because I saw it on the list and have in fact only just now realized that it was on the list in the first place. The oldest active entry is from August 15, 2021: “Write about theoretical biology”. The second-oldest is from four days later: “Write about Waddington’s epigenetics”. This was a few months before I had read any of his books, so maybe it was just mine discovering what Waddington did? In any case, consider this post as a way to cross both of these tasks off the list.

And yet again, the writing is not prompted by any list, but rather by this question on X — what are the major breakthroughs in biology that were idea-driven arguments based on existing data — which duly reminded me of CH Waddington (or, as iOS 26 autocorrect misspelled it just before I had hit return, “CH Washington”). Waddington, a proponent of theoretical biology as a parallel to theoretical physics, organized symposia in the late 1960s on the topic. Alas, it never took off. He died in 1975, age 69, just in time to see research funding for experimental biology skyrocket making everyone an experimental biologist. The theoretical part is now mostly mathematics: see, for example, the Mathematical Oncology newsletter, but what Waddington proposed was not really maths. Interestingly enough the man behind the newsletter, Jeffrey West, has co-authored a paper with Taleb that was very Waddingtonian, with a recent follow-up and a whole book (which I am yet to read).

For an example of what Waddington wrote about see his most well-known work: the epigenetic landscape, proposed before we even knew what genes were. To me these were incredibly useful when thinking about differentiation of complex cells and how it can go sideways. It is also incredibly annoying that the term epigenetic has been hijacked by molecular biologists to mean solely chemical changes to DNA and adjacent proteins which are more likely than not merely a sideshow to what really controls gene expression (3d structure, mRNA, other genes, i.e. everything that goes into a gene regulatory network). Ask a doctor what epigenetics means and the first thing they say will be acetylation and methylation, and if they are oncologists they will talk about “epigenetic drugs” whose job is to inhibit methylation (“hypomethilators”), or what not. I would wager that GLP1 inhibitors like Ozempic are more epigenetic than the most active hypomethilator, but I may as well go after windmills.

Now, the person who asked the question that kickstarted this thinking is the founding editor of Assimov Press which is a charming publication about science and scientific progress. I hope his asking questions will lead to more writing about what happened to theoretical biology and that I’ll learn more about people who carried the flame (or, more likely, rediscovered the concept after everyone forgot about poor old Waddington).

Update: Dr. West has pointed me to the work pf Sui Huang from the Institute for Systems Biology who has tried to bring to terms the two different meanings of epigeneticts with explicit tie in to GRNs. I am sure that very paper is where I got the notion from, but have of course completely forgotten about it. Thank you, Jeff!


Two notes after wrapping up some writing projects this week

The first note is on quickly estimating the 95% confidence interval of an event rate when there are no observed events: if you observe n patients, and none of these patients have the event, then a 95% confidence interval for the probability of the event goes from zero to 3/n (source, with more mathematical detail than I care for). So, if you treat 5 patients and none of them respond, the true response rate could still be as high as 60%. Note that there are many drugs on the market now approved for response rates much lower than 60%, possibly because of the flipside of this calculation (5 of 5 responders could still mean that the true response rate is “only” 40%) combined with some persistence on the part of the developers. But are some drugs dropped too quickly? Probably, which increases the urgency of making clinical trials easier and cheaper to run.

Another implications is that in your standard 3+3 dose escalation design, where you go up in dose if the first 3 study participants don’t experience a dose-limiting toxicity, the 95% confidence interval of the DLT rate at that dose level is still 0 to almost 100%. So, the trials we are running aren’t giving us good enough information. Yay!

The second note, much les philosophical, is that there exists and online tool called reference extractor which can go through a document and extract all Zotero and Mendeley references from it for export into a variety of formats. It can also select those references in your Zotero library, which is life-saving for a slob like me who keeps his references haphazardly strewn across dozens of subfolders. This way anyone who asks can get a neat export, files included.


Tuesday Twitter hits, biotech yet again (maybe I should expand my follow list)


Sunday aftenoon links, mostly biomedical