Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Genghis Khan in 25 counted questions.

Back to all Genghis Khan rounds
Questions
25
Outcome
Solved
Format errors
No errors
Duration
7m 12s
Round cost
$0.1438 All 26 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"person","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the person a politician or government leader?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the person a politician or government leader?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q2
1 · Guesser asks

Did the person serve as head of state or head of government?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or head of government?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as having the title/office of khan from 1206 to 1227 and states that an assembly of leaders declared him universal emperor in 1206.

Open britannica.com
2 · Answer check returns Yes
Q3
1 · Guesser asks

Did the person serve as head of state or government of the United States?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of the United States?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica states that in 1206 an assembly of leaders declared Genghis Khan universal emperor of the Mongolian steppe, and describes him as a ruler who brought the nomadic tribes of Mongolia under his rule.

Open britannica.com
Source 02

Source summary (model-reported)

The page states that the President of the United States is the head of state and head of government of the United States, and that the officeholder leads the executive branch of the federal government.

Open en.wikipedia.org
2 · Answer check returns No
Q4
1 · Guesser asks

Did the person serve as head of state or government of a European country?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a European country?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Genghis Khan was best known for unifying the Mongolian steppe under a massive empire... the rule of himself and his family in a rigidly disciplined military state.

Open britannica.com
Source 02

Source summary (model-reported)

The Mongol Empire began in 1206 when Genghis Khan united Mongolian tribes... in the Steppe of central Asia, near Lake Baikal in Mongolia. By the late 13th century, it stretched from the Pacific Ocean to the Danube River and the Persian Gulf.

Open britannica.com
2 · Answer check returns No
Q5
1 · Guesser asks

Did the person serve as head of state or government of a country in Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in Asia?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q6
1 · Guesser asks

Is the person a woman?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the person a woman?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Genghis Khan, whose original name was Temüjin, was born on the banks of the river Onon in the extreme northeast corner of present-day Mongolia. ... Forced into exile, he spent several years wandering, and during this time he developed a following.

Open encyclopedia.com
Source 03

Source summary (model-reported)

Genghis Khan, or Chinggis Khan, originally Temüjin, was a Mongolian warrior-ruler who consolidated nomadic tribes into a unified Mongolia.

Open britannica.com
2 · Answer check returns No
Q7
1 · Guesser asks

Did the person serve as head of state or government of a country in East Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in East Asia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Genghis Khan was a Mongolian warrior-ruler ... who consolidated tribes into a unified Mongolia. Britannica lists his title/office as "khan (1206-1227)."

Open britannica.com
2 · Answer check returns Yes
Q8
1 · Guesser asks

Did the person serve as head of state or government of Japan?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of Japan?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as a Mongolian warrior-ruler, states that an assembly declared him universal emperor of the Mongolian people in 1206, and lists his title/office as “khan (1206–1227).”

Open britannica.com
Source 02

Source summary (model-reported)

The Mongol Empire article states that Genghis Khan died on 18 August 1227. It separately states that Kublai Khan invaded Japan in 1274 and again in 1281, but was unable to conquer Japan.

Open en.wikipedia.org
2 · Answer check returns No
Q9
1 · Guesser asks

Did the person serve as head of state or government of China?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of China?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

While Genghis Khan began encroaching on China as early as 1211, Kublai Khan, his grandson, is credited with founding the Yuan dynasty. Kublai Khan consolidated Mongol rule over China by defeating the Nan (Southern) Song dynasty in 1279. In 1271, he officially proclaimed the Yuan dynasty, establishing himself as its first emperor.

Open britannica.com
Source 02

Source summary (model-reported)

Genghis Khan unified the Mongols north of China in 1206 and began encroaching on the Jin dynasty in northern China in 1211, taking its capital in 1215. The final consolidation came under Genghis’s grandson Kublai Khan, who reigned from 1260–94 and adopted the role of a traditional Chinese emperor.

Open britannica.com
Source 03
At the time of his death, Genghis Khan had conquered the land mass extending from Beijing to the Caspian Sea. His successors would extend their power over the whole of China.
Open britannica.com
2 · Answer check returns No
Q10
1 · Guesser asks

Did the person serve as head of state or government of South Korea?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of South Korea?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as born in 1162 and deceased on August 18, 1227; it lists his title/office as khan from 1206 to 1227.

Open britannica.com
Source 02

Source summary (model-reported)

South Korea was established as a country on August 15, 1948. Known as the Republic of Korea, its formation followed the division of the Korean peninsula; Syngman Rhee was its first president.

Open britannica.com
2 · Answer check returns No
Q11
1 · Guesser asks

Did the person serve as head of state or government of North Korea?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of North Korea?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan's title/office as khan (1206–1227) and gives his death date as August 18, 1227; it describes him as the founder of the Mongol Empire.

Open britannica.com
Source 02
The Democratic People’s Republic of Korea was established on September 9, 1948, with Kim Il-Sung as its first premier. Kim Il-Sung was the first leader of North Korea, serving from 1948 until his death in 1994.
Open britannica.com
2 · Answer check returns No
Q12
1 · Guesser asks

Did the person serve as head of state or government of Taiwan?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of Taiwan?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica describes Genghis Khan as a Mongolian warrior-ruler and states that in 1206 an assembly of leaders declared him universal emperor of the Mongolian Empire.

Open britannica.com
Source 02

Source summary (model-reported)

The Office of the President of the Republic of China (Taiwan) lists presidents since 1947, including Chiang Kai-shek (1948–1975), Yen Chia-kan (1975–1978), and subsequent presidents through Tsai Ing-wen (2016–2024).

Open english.president.gov.tw
Source 03

Source summary (model-reported)

The official presidential biography states that the Republic of China central government relocated to Taiwan in December 1949 and that Chiang Kai-shek resumed office as president in Taipei in March 1950.

Open english.president.gov.tw
2 · Answer check returns No
Q13
1 · Guesser asks

Did the person serve as head of state or government of Mongolia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of Mongolia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

By 1206 Temüüjin’s success in tribal warfare caused him to be proclaimed ruler of All the Mongols with the rank of khan and the title of Genghis.

Open britannica.com
Source 03

Source summary (model-reported)

The biographical infobox identifies him as Khan of the Mongol Empire, with a reign from 1206 to August 1227; the article separately says modern Mongolians recognise him as the founding father of their nation.

Open en.wikipedia.org
2 · Answer check returns Unknown
Q14
1 · Guesser asks

Did the person serve as head of state or government of a communist state?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a communist state?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as a Mongolian warrior-ruler, gives his dates as born 1162 and died August 18, 1227, and lists his office as khan (1206–1227).

Open britannica.com
Source 02

Source summary (model-reported)

Britannica states that the Mongolian People’s Republic was proclaimed in November 1924, and separately describes Genghis Khan as a warrior-ruler who died in 1227.

Open britannica.com
Source 03

Source summary (model-reported)

The BBC describes Mongolia as having undergone decades of communist rule, ending when popular protests in the early 1990s brought that rule to an end, and contrasts this period with Genghis Khan’s earlier historical era.

Open news.bbc.co.uk
2 · Answer check returns No
Q15
1 · Guesser asks

Did the person serve as leader of a non-sovereign territory, such as Hong Kong or Macau?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as leader of a non-sovereign territory, such as Hong Kong or Macau?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

In 1206 an assembly of leaders declared him universal emperor (chinggis khān) of the Mongolian steppe. He was best known for unifying the Mongolian steppe under a massive empire.

Open britannica.com
Source 02

Source summary (model-reported)

The Mongol Empire began in 1206 with Genghis Khan's election as leader of a federation of tribes in the Steppe of central Asia. The Mongol Empire was not a state in the normal sense of the word but a vast agglomeration of widely different territories held together by military domination.

Open britannica.com
2 · Answer check returns No
Q16
1 · Guesser asks

Did the person serve as head of state or government of a country in Southeast Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in Southeast Asia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as a Mongolian warrior-ruler who consolidated tribes into a unified Mongolia and established the Mongol Empire. It describes Mongol expansion across Asia, reaching the Pacific coast of China and the Adriatic Sea.

Open britannica.com
Source 02

Source summary (model-reported)

The page identifies Genghis Khan, also known as Temüjin, as the founder and first khan of the Mongol Empire. Its succession table lists his position as Khan of the Mongol Empire from 1206 to 1227.

Open en.wikipedia.org
Source 03

Source summary (model-reported)

The Mongol Empire page states that the empire originated in present-day Mongolia in East Asia and that Temüjin became its ruler. It separately refers to later Mongol invasions of Southeast Asia.

Open en.wikipedia.org
2 · Answer check returns No
Q17
1 · Guesser asks

Did the person serve as head of state or government of a country in South Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in South Asia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Genghis Khan rose to establish the largest land empire in history. After uniting the nomadic tribes of the Mongolian plateau, he conquered huge chunks of central Asia and China.

Open history.com
Source 03

Source summary (model-reported)

From 1221 to 1327, the Mongol Empire launched several invasions into the Indian subcontinent. The Mongols occupied parts of northwestern South Asia for decades, but failed to penetrate past the outskirts of Delhi and were repelled from the interior of India.

Open en.wikipedia.org
2 · Answer check returns No
Q18
1 · Guesser asks

Did the person serve as head of state or government of a country in the Middle East or Western Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in the Middle East or Western Asia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

In 1206 an assembly of leaders declared him universal emperor (chinggis khān) of the Mongolian ... [He] consolidated tribes into a unified Mongolia and then extended his empire across Asia to the Adriatic Sea.

Open britannica.com
Source 02

Source summary (model-reported)

Genghis Khan ... was proclaimed as the ruler of all Mongols in 1206. Genghis Khan died on 18 August 1227, by which time the Mongol Empire ruled from the Pacific Ocean to the Caspian Sea.

Open en.wikipedia.org
Source 03

Source summary (model-reported)

Genghis Khan was the first leader, or Khan, of the Mongol Empire, from 1206 CE–1227 CE. By the time of Genghis Khan’s death in 1227, the Mongol Empire ruled from the Pacific Ocean to the Caspian Sea.

Open courses.lumenlearning.com
2 · Answer check returns No
Q19
1 · Guesser asks

Did the person serve as head of state or government of a country in Central Asia?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country in Central Asia?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Mongol Empire began in 1206 with Genghis Khan's election as leader of a federation of tribes in the Steppe of central Asia, near Lake Baikal in Mongolia.

Open britannica.com
Source 02

Source summary (model-reported)

Genghis Khan ... was a Mongolian warrior-ruler ... who consolidated tribes into a unified Mongolia and then extended his empire across Asia.

Open britannica.com
2 · Answer check returns Yes
Q20
1 · Guesser asks

Did the person serve as head of state or government of a country that was formerly part of the Soviet Union?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of a country that was formerly part of the Soviet Union?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica identifies Genghis Khan as a Mongolian warrior-ruler and lists his title/office as “khan (1206–1227)” of the Mongol empire.

Open britannica.com
Source 02

Source summary (model-reported)

Britannica states that the Mongol Empire began in 1206 when Genghis Khan united Mongolian tribes and was founded by him as an empire in Central Asia.

Open britannica.com
Source 03

Source summary (model-reported)

The source states that from 1956 until its dissolution in 1991, the Soviet Union consisted of 15 Soviet Socialist Republics, which were its constituent union republics.

Open en.wikipedia.org
2 · Answer check returns No
Q21
1 · Guesser asks

Did the person serve as head of state or government of Afghanistan?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person serve as head of state or government of Afghanistan?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The historical timeline states that Genghis Khan took over the territory in the 13th century, but that the area was not united as a single country until the 1700s.

Open pbs.org
Source 03

Source summary (model-reported)

The Library of Congress country study states that in 1220 all of Central Asia fell to the Mongol forces of Genghis Khan and describes Afghanistan as remaining fragmented afterward.

Open tile.loc.gov
2 · Answer check returns No
Q22
1 · Guesser asks

Did the person hold the title of emperor, king, khan, or another hereditary monarch?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person hold the title of emperor, king, khan, or another hereditary monarch?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Genghis Khan ... was the founder and first khan of the Mongol Empire. Temüjin formally adopted the title "Genghis Khan" ... at an assembly in 1206.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

Britannica identifies Genghis Khan as the founder of the Mongol nation and the leader whose campaigns led to the establishment of the Mongol Empire.

Open britannica.com
2 · Answer check returns Yes
Q23
1 · Guesser asks

Did the person rule a Mongol or Turkic empire?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person rule a Mongol or Turkic empire?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q24
1 · Guesser guesses

Timur

Turco-Mongol conqueror who founded the Timurid Empire in Central Asia, with its capital at Samarkand, and ruled as a monarch.

Validator rationale Timur was a different historical ruler and founder of the Timurid Empire, not Genghis Khan.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Turco-Mongol conqueror who founded the Timurid Empire in Central Asia, with its capital at Samarkand, and ruled as a monarch.","name":"Timur","question":null}}
2 · Validator returns No
Q25
1 · Guesser asks

Did the person found the empire they ruled?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did the person found the empire they ruled?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica describes Genghis Khan as the founder of the Mongol nation and credits his unification of the Mongolian steppe with leading to the establishment of the Mongol Empire.

Open britannica.com
2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Genghis Khan

Mongol conqueror who founded the Mongol Empire in the early 13th century, uniting the Mongol tribes and ruling as Great Khan.

Validator rationale The proposed identity names Genghis Khan and describes the same historical person: founder and first khan of the Mongol Empire.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Mongol conqueror who founded the Mongol Empire in the early 13th century, uniting the Mongol tribes and ruling as Great Khan.","name":"Genghis Khan","question":null}}
2 · Validator returns Yes