Worth reading · January 2026 · Cognitive leads

Two minutes faster, two letter grades lower.

A randomized trial by a model maker's own research group: developers who learned a new library with an AI assistant finished about two minutes sooner and understood it seventeen points less. How they used the assistant decided which. The finding is theirs. The reading against the nine dimensions is mine.

The question

Am I, the person, still intact? The Cognitive question has a growth half that is easy to forget: whether I am still picking up the new concepts and vocabulary that have always renewed the craft, or whether the assistant is picking them up for me and I am nodding. Close behind it the Epistemic question: do I know the system I shipped the way I knew code I wrote by hand.

On this build the question is whether the feature works. On the long clock it is whether I learned anything from building it. This is the first controlled evidence I have seen that the answer depends on the shape of the conversation, and it comes from a group with every reason to have found otherwise.

What they found

The sourceAnthropic, How AI assistance impacts the formation of coding skills. Published 29 January 2026. A randomized controlled trial with 52 developers. Read the original →

Fifty-two developers, mostly junior, with a year or more of Python, learning an unfamiliar asynchronous library by building two features. Half had an AI assistant in a sidebar; half coded by hand. Then a fourteen-question quiz, no AI for either group, covering debugging, reading, writing, and the concepts they had just used.

The AI group averaged 50 percent. The hand-coding group averaged 67. The authors call it nearly two letter grades, with an effect size of 0.738 and a p value of 0.01. The AI group finished about two minutes faster, and that difference did not reach significance.

The part that matters is inside the AI group. The people who used the assistant to ask why, to request explanations, to pose conceptual questions while writing the code themselves, held the material. The people who delegated generation and debugging did not. The authors' own caveat: mostly junior developers, one library, one session, a learning study rather than a productivity study, and skilled developers may use the tools differently.

The three questions

Every research post runs the same three rows. Which of the nine it names, how good the evidence is, and whether the thing is being measured.

RowStatusEvidence
NamedWhich of the nine questions does this answer? Cognitive The growth signals: new concepts appearing in my own turns, vocabulary still expanding. Epistemic second, because a library you did not learn is a system you cannot explain cold.
EvidencedHow good is the evidence? supported Randomized, a quiz both groups took without the tool, a significant gap. Narrow, and the authors say so. Narrow and honest is the best kind of supported.
MeasuredIs this being read on the Data page? pending The kit's accept, modify, or reject rate and its reasoning ratio are the near neighbours. The own-words line on Data reads volume, not comprehension.

What this cannot say:

  1. Whether it holds for a builder with thirty years, on their own systems, over months. The authors' own limit. One session with junior developers on one library is a mechanism, not a career.
  2. Whether two minutes on a task compounds into anything on a quarter. The speed side did not reach significance, and nothing in the design could say what it adds up to.
  3. What the gap looks like a week later. The quiz was minutes after the build. Whether the delegator ships again without ever closing the gap is the long-clock question, and it was not asked.
  4. Whether asking why survives a deadline. The good pattern is a choice. The trial did not test what happens to that choice under load, which is where I live.

What I am doing about it

The status says what is missing. These are the moves, on my own work, that would supply it. Each is either read automatically off the footprint or asked of me on a cadence, and each costs something to keep doing.

  1. AutoCount the question turns. Of my own turns, the share that ask the agent to explain rather than to do. The trial says this is the variable; the kit can read it monthly.Costs: a classifier, and a number that will drop under load exactly when I would rather it did not.
  2. Asked · MonthlyExplain cold a system I built thirty to ninety days ago, with no agent. The Epistemic signal the model puts first, taken on me before it is taken on anyone.Costs: an hour a month failing in private.
  3. AutoSplit accepted outright from modified from rejected, weekly. Accepting outright is the delegating pattern the trial names. The harness records the difference between what was offered and what landed.Costs: a spine that has to keep the diff, which the kit's does, and a reading that will show me my worst weeks.
  4. Asked · QuarterlyA fixed class of problems, solved without a tool. The same afternoon the Cognitive maintenance signal already asks for, now with a paper behind it.Costs: the afternoon, and the possibility of finding out.

What I keep

The assistant, in the sidebar, for the questions. The trial does not say use it less. It says the shape of the conversation decides what you keep, and the shape is mine to choose. Two minutes is not worth two grades on a library I will maintain. It is worth it on one I will never touch again. Knowing which is the judgement.

What it costs is being slower on purpose on the systems I intend to own.

Their finding, published January 2026; read by me against the nine dimensions, September 2026. Written with AI assistance; the reading is mine. — Clay

Want the nine readings taken on your own work?

The kit ships with the same instrument I am running on myself. Mentorship installs it with me in the room.

One list, no drip.

New Resources, Research, Data readings, and kit editions. This list is the only announcement I send.