Sascha Fast of the Zettelkasten blog writes, in a post titled The Scam Called “You Don’t Have to Remember Anything”:
Rowlands et al. wrote about the so called “digital natives” that they lack the critical and analytical thinking skills to evaluate the information they find on the internet. We need a fully developed mental map of the subject in order to derive value from the results of an internet search.
In short: You need a trained brain to actually benefit from the internet.
But not just from the internet, as the post elaborates. This applies equally or even more to LLM outputs. A great example comes from a recent post on Andrew Gelman’s blog, though not from the man himself, where a human and ChatGPT 5 both try to improve upon a statistical model in a new-to-me language called Stan. Now if you don’t know Bayesian statistics or Stan this will all look like gobbledygook and ChatGPT won’t help you understand.
LLMs are also seeping into the everything-bucket software, the one whose primary purpose is to black-hole every article and textbook you will never read or video you will ever watch. Well now it can also give you the illusion of knowledge and control because you can ask questions about the contents. This is something Casey Newton learned this year:
I can give Notion a sprawling question like “how did the Cambridge Analytica case resolve” and get a good summary of regulatory actions across several years and countries. And by default, web search is off, meaning I know that its AI systems are drawing only on the vetted journalism that I have saved into my database.
This is a dream come true. I finally have a meaningful way to sift through millions of words of article text, ask follow-up questions, and get citations that I can use in my work. Notion may yet prove to be the AI librarian that Readwise never became.
One more thing I’m trying: I mentioned above that I continue to experiment with different ways to save material that might be useful later. Recently a Reddit post turned me on to Recall, which positions itself as a “self-organizing knowledge base.” Currently available as a web and mobile app, Recall lets you save web pages, YouTube videos, PDFs, podcasts, Google Docs, and other materials into a single database that it then organizes on your behalf.
To be clear, I myself have asked for something like this from my everything-bucket software of choice, DEVONthink. And it delivered! But now I am realizing, and Sacha’s post was a good reminder, that these are becoming command line-level power tools — Hole Hawgs of the mind if you will — which can and will do great damage if not used carefully. And unlike the Hole Hawg they are freely available and come with no instruction manual. Caveat utilitor.