Use AI as a collaborator that must show its work, not as an oracle. Every mathematical claim an AI makes
has to be checked: by you, against the source paper, by a computation, or (best) by a proof assistant.
Get used to working with AI agents in the terminal (e.g. Claude Code, Codex, OpenCode), which can read
your files, run LaTeX, and commit to git -- they fit naturally into the Github + neovim workflow above.
The idea (see Andrej Karpathy's "LLM wiki" note):
instead of asking an AI to re-read a pile of PDFs every time, have it build and maintain a linked
collection of plain Markdown pages -- one page per paper, concept, method, or open problem.
Our group keeps such a wiki for stochastic PDEs (about the papers we read and the techniques we use).
It is private; group members get access on request.
Ground rules that make a wiki trustworthy:
Read papers from their LaTeX source (arXiv), not from PDF text extraction -- formulas survive.
Every page cites its sources (citation keys, theorem numbers); no unsourced claims.
Plain text + git: the wiki is diffable, reviewable, and never locked in one tool.
Start your own: a folder of Markdown notes under git is enough. Tools such as
Obsidian or vimwiki can browse it.
A skill is a short Markdown file of instructions (plus optional scripts) that an AI agent loads when
a task matches -- e.g. "how we add a reference to the bibliography", "how we compile and check a paper",
"how we write a referee report".
A good public collection to study: superpowers (verification before claiming done, systematic debugging, writing plans).
Why it matters: each time the AI (or you) makes a mistake, write the lesson down as a skill, so it does
not happen again. Over time your skills become a record of how your research is done.
I maintain several hundred such skills for our research workflow (literature, LaTeX, refereeing,
Lean verification); I will share the relevant ones with you.
Lean 4 is a proof assistant: a proof that compiles is checked by a small
trusted kernel. Together with AI, this is how we make sure an argument is actually correct.
lean-pkg is a registry and trust gate for Lean 4 formalization packages: it records which packages
exist, who works on each, and the evidence (receipts) that binds a package to a verified commit.
Before starting a new formalization, search the registry for prior art. Nothing becomes public
without two receipts, and the second one is re-derived independently from the bytes.