Kim 2 ML

Starting off as a muggle that naïve to the Math's and Data Science world.

Prompt Repetition Improves Non-Reasoning LLMs

ref: https://arxiv.org/pdf/2512.14982

Summary

The easiest AI upgrade might be just “copy and paste”. Google researchers tested with 7 leading models and found that repeating the exact same prompt boosted results in 47/70 tests, with 0 losses! On one particular task, accuracy jumped from 21% to 97%. Even better, response time and output length stayed the same. Before adding complex tricks (Re-read, CoT, asking score & threatening), try repeating your prompt once.

ps. The order of question and context also changed performance. Always do question first, context later in Q&A query.

Baseline prompt
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Repetition prompt
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Repetition prompt (Verbose)
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Let me repeat that:
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Repetition prompt ×3
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Let me repeat that:
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.
Let me repeat that one more time:
Which of the following combinations is a mixture rather than a compound?
A. oxygen and nitrogen in air
B. sodium and chlorine in salt
C. hydrogen and oxygen in water
D. nitrogen and hydrogen in ammonia
Reply with one letter (’A’, ’B’, ’C’, ’D’) in the format:
The answer is <ANSWER>.

Kim Ng

Leave a comment