Deep20Bench
v1.0Previous

Benchmark edition

Edition 1.0 settings

7 subjects5 rounds per subject50 question limit
Question answersYesNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Did not identify Genghis Khan after 50 counted questions.

Back to all Genghis Khan rounds
Questions
50 Scored as 51
Outcome
Question limit reached
Format errors
No errors
Duration
38m 58s
Round cost
$2.2639 All 51 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser being evaluated in a Twenty Questions benchmark.

One subject is hidden. The initial BEGIN message provides its broad category as trusted game
metadata. Identify the subject using as few counted questions as possible. ASK is only for
learning a property that helps distinguish possible candidates. Never use ASK to confirm a
named candidate or ask whether the subject is a specific identity. When you are ready to name
a candidate, use GUESS immediately. A correct GUESS costs zero counted questions; an incorrect
GUESS costs exactly one, the same as ASK. A GUESS must provide both a name and a short
identifying description. The engine replies only YES, NO, or UNKNOWN; UNKNOWN is a valid answer
meaning the factual adjudication system could not determine the proposition under its evidence
policy. Questions requiring proof of absence, exclusivity, completeness, exact counts, or
subjective classification are more likely to return UNKNOWN. Prefer direct, positively
verifiable properties when possible.

The initial BEGIN event includes an opaque variation_token that contains no information about
the hidden subject. Do not interpret, repeat, mention, or derive meaning from it. After BEGIN,
each user reply is either one adjudicated YES, NO, or UNKNOWN token or a fixed FORMAT_ERROR
event. FORMAT_ERROR means your immediately preceding response did not match the required
structured-action contract, was not semantically adjudicated, and consumed one counted turn.
Use the formats in that event and try again. Never infer that the attempted question or
guess was right or wrong.

At most 50 questions or rejected guesses are counted. After that limit you receive
one final guess-only opportunity. Format errors also consume counted turns. The provider wire
response is an object with exactly one `result` action. On the final opportunity ASK is
forbidden. Return only the required structured response. Do not include analysis, hidden
reasoning, or additional fields.
BEGIN event
{"category":"person","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the person alive?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the person alive?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Were they a politician?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a politician?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
He says that Khan was not the stereotypical barbarian of lore, calling him a statesman responsible for laying the foundations for global trade and diplomacy.
Open nhpr.org
2 · Answer check returns Yes
Q3
1 · Guesser asks

Were they from the United States?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they from the United States?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q4
1 · Guesser asks

Were they male?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they male?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q5
1 · Guesser asks

Were they from Europe?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they from Europe?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Were they a head of state (e.g., president, prime minister, monarch)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a head of state (e.g., president, prime minister, monarch)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q7
1 · Guesser asks

Were they from Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they from Asia?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q8
1 · Guesser asks

Were they a communist leader?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a communist leader?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q9
1 · Guesser asks

Were they a monarch (king, emperor, etc.)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a monarch (king, emperor, etc.)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q10
1 · Guesser asks

Were they an emperor rather than a king?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they an emperor rather than a king?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q11
1 · Guesser asks

Was the empire primarily located in East Asia (e.g., China, Japan, Korea)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was the empire primarily located in East Asia (e.g., China, Japan, Korea)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q12
1 · Guesser asks

Was the empire located in South Asia (e.g., Indian subcontinent)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was the empire located in South Asia (e.g., Indian subcontinent)?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q13
1 · Guesser asks

Were they known for building the Taj Mahal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they known for building the Taj Mahal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q14
1 · Guesser asks

Did they rule during the 16th or 17th century?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule during the 16th or 17th century?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q15
1 · Guesser guesses

Ashoka

Mauryan emperor known for spreading Buddhism across South Asia

Validator rationale The proposal identifies Ashoka, while the trusted subject is Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Mauryan emperor known for spreading Buddhism across South Asia","name":"Ashoka","question":null}}
2 · Validator returns No
Q16
1 · Guesser asks

Did they rule before the year 1000 CE?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule before the year 1000 CE?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q17
1 · Guesser asks

Were they the last ruler of their empire or dynasty?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they the last ruler of their empire or dynasty?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q18
1 · Guesser asks

Were they part of the Mughal dynasty?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they part of the Mughal dynasty?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Did they rule between 1000 and 1500 CE?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule between 1000 and 1500 CE?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q20
1 · Guesser asks

Were they part of the Vijayanagara Empire?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they part of the Vijayanagara Empire?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q21
1 · Guesser asks

Did they rule primarily in southern India?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule primarily in southern India?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q22
1 · Guesser asks

Were they a Muslim ruler?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a Muslim ruler?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q23
1 · Guesser asks

Did they rule in Bengal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule in Bengal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q24
1 · Guesser asks

Did they rule in what is now modern-day Nepal or Sri Lanka?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule in what is now modern-day Nepal or Sri Lanka?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q25
1 · Guesser asks

Did their empire include the city of Delhi at some point?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did their empire include the city of Delhi at some point?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q26
1 · Guesser guesses

Jayavarman VII

Khmer Emperor of the Khmer Empire who built Angkor Thom and numerous Buddhist temples in medieval Cambodia

Validator rationale The proposal identifies Jayavarman VII, while the trusted subject is Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Khmer Emperor of the Khmer Empire who built Angkor Thom and numerous Buddhist temples in medieval Cambodia","name":"Jayavarman VII","question":null}}
2 · Validator returns No
Q27
1 · Guesser asks

Were they a patron of the Jagannath Temple at Puri?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they a patron of the Jagannath Temple at Puri?"}}
2 · Answer check returns Unknown
Q28
1 · Guesser asks

Did they rule in Odisha?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule in Odisha?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q29
1 · Guesser asks

Were they from the Gujarat or Rajasthan region of India?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they from the Gujarat or Rajasthan region of India?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q30
1 · Guesser guesses

Bhoja

Paramara king of Malwa who ruled as an emperor-like figure in central India between 1010 and 1060

Validator rationale The proposal identifies Bhoja, a Paramara king of Malwa, not Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Paramara king of Malwa who ruled as an emperor-like figure in central India between 1010 and 1060","name":"Bhoja","question":null}}
2 · Validator returns No
Q31
1 · Guesser asks

Did their empire include the city of Ujjain?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did their empire include the city of Ujjain?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q32
1 · Guesser asks

Were they Hindu?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they Hindu?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q33
1 · Guesser guesses

Govindachandra

Gahadavala emperor who ruled the Kannauj region of northern India during the 12th century

Validator rationale The proposal identifies Govindachandra, a 12th-century Gahadavala ruler, not Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Gahadavala emperor who ruled the Kannauj region of northern India during the 12th century","name":"Govindachandra","question":null}}
2 · Validator returns No
Q34
1 · Guesser asks

Were they associated with the construction of the temples at Khajuraho?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they associated with the construction of the temples at Khajuraho?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q35
1 · Guesser asks

Were they Buddhist?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they Buddhist?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q36
1 · Guesser guesses

Ram Shah

Gond emperor of the Garha Kingdom in central India who ruled from 1350 to 1380 CE following traditional tribal beliefs

Validator rationale The trusted subject is Genghis Khan, while the proposed identity is Ram Shah, a different historical person.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Gond emperor of the Garha Kingdom in central India who ruled from 1350 to 1380 CE following traditional tribal beliefs","name":"Ram Shah","question":null}}
2 · Validator returns No
Q37
1 · Guesser guesses

Sukaphaa

Founder of the Ahom Kingdom who ruled as emperor in medieval Assam with animist beliefs

Validator rationale Sukaphaa, founder of the Ahom Kingdom, is a different historical person from Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Founder of the Ahom Kingdom who ruled as emperor in medieval Assam with animist beliefs","name":"Sukaphaa","question":null}}
2 · Validator returns No
Q38
1 · Guesser guesses

Suteuphaa

Ahom Swargadeo who ruled the Ahom Kingdom in Assam from 1268 to 1281, following animist traditions

Validator rationale Suteuphaa was an Ahom ruler, not Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Ahom Swargadeo who ruled the Ahom Kingdom in Assam from 1268 to 1281, following animist traditions","name":"Suteuphaa","question":null}}
2 · Validator returns No
Q39
1 · Guesser guesses

Singhana II

Yadava emperor who ruled the Deccan region of South Asia from 1200 to 1247 CE

Validator rationale Singhana II, a Yadava ruler, is a different historical person from Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Yadava emperor who ruled the Deccan region of South Asia from 1200 to 1247 CE","name":"Singhana II","question":null}}
2 · Validator returns No
Q40
1 · Guesser guesses

Susenphaa

Ahom Swargadeo who ruled the Ahom Kingdom in medieval Assam from 1376 to 1407

Validator rationale The trusted subject is Genghis Khan, while the proposal identifies Susenphaa, an Ahom ruler.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Ahom Swargadeo who ruled the Ahom Kingdom in medieval Assam from 1376 to 1407","name":"Susenphaa","question":null}}
2 · Validator returns No
Q41
1 · Guesser guesses

Gangeyadeva

Kalachuri emperor of Tripuri who ruled central India from about 1040 to 1070 CE

Validator rationale Gangeyadeva was a Kalachuri emperor of Tripuri, a different historical person from Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Kalachuri emperor of Tripuri who ruled central India from about 1040 to 1070 CE","name":"Gangeyadeva","question":null}}
2 · Validator returns No
Q42
1 · Guesser guesses

Rajendra Chola I

Chola emperor who ruled South India from 1014 to 1044 CE and expanded the empire to include Sri Lanka, Southeast Asia, and the Maldives

Validator rationale Rajendra Chola I is a different historical person from Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Chola emperor who ruled South India from 1014 to 1044 CE and expanded the empire to include Sri Lanka, Southeast Asia, and the Maldives","name":"Rajendra Chola I","question":null}}
2 · Validator returns No
Q43
1 · Guesser guesses

Sukhaangphaa

Ahom Swargadeo (1290-1332) who ruled the Ahom Kingdom in Assam as an animist emperor

Validator rationale Sukhaangphaa was an Ahom ruler, not Genghis Khan (Temüjin), founder of the Mongol Empire.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Ahom Swargadeo (1290-1332) who ruled the Ahom Kingdom in Assam as an animist emperor","name":"Sukhaangphaa","question":null}}
2 · Validator returns No
Q44
1 · Guesser guesses

Sujangphaa

Ahom Swargadeo who ruled the Ahom Kingdom in medieval Assam from 1407 to 1422 as an animist emperor

Validator rationale Sujangphaa was an Ahom ruler, not Genghis Khan (Temüjin), founder of the Mongol Empire.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Ahom Swargadeo who ruled the Ahom Kingdom in medieval Assam from 1407 to 1422 as an animist emperor","name":"Sujangphaa","question":null}}
2 · Validator returns No
Q45
1 · Guesser asks

Were they from a kingdom in the Brahmaputra valley?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they from a kingdom in the Brahmaputra valley?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q46
1 · Guesser guesses

Lakshmi-Karna

Emperor of the Kalachuri dynasty of Tripuri who ruled central India from 1041 to 1073 CE following tribal animist traditions

Validator rationale The trusted subject is Genghis Khan, while the proposal identifies Lakshmi-Karna, a different historical ruler of the Kalachuri dynasty.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Emperor of the Kalachuri dynasty of Tripuri who ruled central India from 1041 to 1073 CE following tribal animist traditions","name":"Lakshmi-Karna","question":null}}
2 · Validator returns No
Q47
1 · Guesser asks

Were they Jain?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they Jain?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q48
1 · Guesser asks

Did they rule in modern-day Pakistan or Afghanistan?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did they rule in modern-day Pakistan or Afghanistan?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q49
1 · Guesser asks

Were they Zoroastrian?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Were they Zoroastrian?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q50
1 · Guesser asks

Was their capital Ghazni?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was their capital Ghazni?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
G
1 · Guesser guessesNot counted

Anandapala

Shahi king of Kabul and Lahore who ruled from 1001 to 1010 CE as the last major non-Muslim emperor in the Afghanistan-Pakistan region

Validator rationale Anandapala was a Shahi king, whereas the trusted subject is Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Shahi king of Kabul and Lahore who ruled from 1001 to 1010 CE as the last major non-Muslim emperor in the Afghanistan-Pakistan region","name":"Anandapala","question":null}}
2 · Validator returns No