← back to the archiveCover illustration for “Delete a prompt rule only after naming what replaced it”
POSTday 71·5w ago·by Andy Padia

Delete a prompt rule only after naming what replaced it

Anthropic’s large system-prompt reduction preserved measured coding performance. The transferable method is controlled removal with evidence, not an instruction to delete 80 percent.

The part of a prompt-reduction story I want to copy is the test, not the percentage.

In Anthropic's July 24 context-engineering article, the company reports removing more than 80 percent of Claude Code's system prompt for its Claude 5 generation models with “no measurable loss on our coding evaluations.” That is a scoped result about a particular change and evaluation suite.

It does not say that every application will improve after deleting the same proportion of its instructions. Nor does no measurable loss establish a quality gain. A shorter prompt can still be valuable for other reasons, but those benefits need to be named and measured separately.

My rule would be to ask what function each removed instruction served and where that function now lives. Sometimes the answer is that it was unnecessary. Sometimes a tool, a skill or a better default has taken over. Sometimes nobody has checked.

A percentage is a result, not a target

Imagine a hypothetical coding assistant whose prompt contains a long explanation of a tool's argument format. The tool schema now provides that information directly. Removing the duplicated prose is a plausible simplification.

Now imagine the same prompt contains a project-specific rule about which operations require an approval. The model's general competence does not make that local authority boundary redundant. Deleting both instructions because they are equally long would ignore what each was doing.

I would classify the candidate text by function before editing. Duplication, obsolete workaround, task-specific knowledge and permission boundary deserve different reasons for removal. This is a review aid, not a promise that a category makes deletion safe automatically.

The distinction also helps when behaviour has moved elsewhere. A shorter system prompt may coexist with more useful tool descriptions or dynamically supplied context. The application has changed its delivery mechanism; it has not necessarily stopped supplying the information.

Anthropic's article discusses a wider context system that includes tools, memory artifacts and skills. That makes the surrounding setup part of the interpretation rather than background we can discard while copying the headline.

Test the removed instruction's job

For an application I was assessing, I would preserve the existing version and run representative cases before and after a small, coherent removal. Keep the model, tools and other conditions visible so a favourable result is not silently attributed to the wrong change.

Include cases that exercise the instruction being removed. A permission rule cannot be evaluated solely on successful code completion. A formatting rule needs an acceptance check for the required format. Repeated runs help reveal whether a clean example was just a fortunate sample.

Then compare the outcomes the application actually values: accepted work, relevant failures and any measured resource or maintenance benefit. If the quality check cannot detect the regression we care about, a passing result is weak evidence for deletion.

This does not require preserving every defensive paragraph forever. Excess instructions can become difficult to maintain and can contradict one another. It requires making simplification accountable to the behaviour the application is meant to retain.

I have not reproduced Anthropic's internal evaluation. The claim I can own is a method for adapting the lesson without pretending its percentage is a universal recipe.

Remove prompt text when its job is demonstrably unnecessary or reliably performed elsewhere; use the evaluation to earn the deletion.

#context-engineering#evaluation#agents#prompts
← older drop
Agent payments should earn the right to write
newer drop →
Failure attribution should not choose the repair owner

related drops

explore all 243 drops →
← back to the archiveday 106