Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Albert Schweitzer in 20 counted questions.

Back to all Albert Schweitzer rounds
Questions
20
Outcome
Solved
Format errors
Errors found View one example
Duration
5m 51s
Round cost
$0.3543 All 21 turns

Format warning

The model sent replies in the wrong format.

The Guesser sent 1 invalid reply. Each one before the question limit used up a counted turn. The model was only reminded of the required format; it was never told whether its question or guess was correct.

Valid format
95.2%
Format errors
1
Turns used by format errors
1

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"person","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

2 of 18 answers in this round reuse an earlier, fully checked answer with its original evidence. No new search or check ran for those turns.

Q1
1 · Guesser asks

Is this person currently alive?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person currently alive?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Did this person die before the year 1900?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did this person die before the year 1900?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Was this person primarily known for their work in politics or government?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for their work in politics or government?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

NobelPrize.org lists his role as “Missionary surgeon; Founder of Lambaréné (République de Gabon)” and says the prize recognized his altruism, reverence for life, and tireless humanitarian work. It also describes him as a gifted musician who gave organ concerts to finance the hospital in Africa.

Open nobelprize.org
Source 02

Source summary (model-reported)

The Nobel biography describes Schweitzer as an internationally known concert organist and musicologist who studied medicine and went to Africa as a medical missionary. It states that he founded a hospital at Lambaréné.

Open nobelprize.org
Source 03

Source summary (model-reported)

PBS describes him as a renowned medical missionary, notes that he founded a hospital in Lambaréné, and discusses his work as a physician, theologian, philosopher, and musician.

Open pbs.org
2 · Answer check returns No
Q4
1 · Guesser asks

Was this person primarily known for work in the arts or entertainment (such as music, film, literature, or visual arts)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for work in the arts or entertainment (such as music, film, literature, or visual arts)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The page also states that he was a gifted musician and interpreter of Bach and gave organ concerts to finance the hospital.

Open nobelprize.org
Source 02

Source summary (model-reported)

Albert Schweitzer dedicated himself to medical studies and sought to build and run a hospital in Africa. The hospital in Lambaréné became his life’s work. The page separately describes him as a skilled musician.

Open nobelprize.org
Source 03

Source summary (model-reported)

At Lambaréné, Schweitzer was doctor and surgeon, pastor, administrator, writer of scholarly books, commentator on contemporary history, and musician. The biography notes that his Nobel Peace Prize funds helped him start the leprosarium at Lambaréné.

Open nobelprize.org
2 · Answer check returns No
Q5
1 · Guesser asks

Was this person primarily known for work in science, mathematics, or technology?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for work in science, mathematics, or technology?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Nobel Prize identifies Albert Schweitzer's role as “Missionary surgeon; Founder of” [the hospital at Lambaréné] and records his 1952 Nobel Peace Prize.

Open nobelprize.org
Source 02

Source summary (model-reported)

Schweitzer was internationally recognized as a concert organist. He later studied medicine and obtained his M.D. in order to go to Africa as a medical missionary.

Open nobelprize.org
Source 03

Source summary (model-reported)

The nomination describes him as a doctor of philosophy, theology and medicine, musician and missionary, and says he was nominated for humanitarian work on a religious basis.

Open nobelprize.org
2 · Answer check returns No
Q6
1 · Guesser asks

Was this person primarily known as an athlete or for involvement in sports?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known as an athlete or for involvement in sports?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The page also describes him as a gifted musician who gave organ concerts.

Open nobelprize.org
Source 02

Source summary (model-reported)

Albert Schweitzer was awarded the Nobel Peace Prize for his philosophy of “reverence for life” and tireless humanitarian work. The page identifies him as a theologian and philosopher, a minister turned doctor in Africa, and a skilled musician.

Open nobelprize.org
Source 03

Source summary (model-reported)

The article describes Schweitzer as a renowned medical missionary who founded a hospital in Lambaréné, won the Nobel Peace Prize, became well known as a virtuoso organist, and established a reputation as a theologian and philosopher.

Open pbs.org
2 · Answer check returns No
Q7
1 · Guesser asks

Was this person primarily known for military service or leadership?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for military service or leadership?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...”
Open nobelprize.org
Source 02

Source summary (model-reported)

At Lambaréné, Schweitzer was doctor and surgeon in the hospital, pastor of a congregation, administrator of a village, writer of scholarly books, commentator on contemporary history, musician, and host to countless visitors.

Open nobelprize.org
2 · Answer check returns No
Q8
1 · Guesser asks

Was this person primarily known for business or entrepreneurship?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for business or entrepreneurship?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The page also describes him as “Doctor, Missionary, Philosopher and Musician.”
Open nobelprize.org
Source 02

Source summary (model-reported)

Albert Schweitzer was awarded the Nobel Peace Prize for his philosophy of “reverence for life” and tireless humanitarian work. He dedicated himself to medical studies, seeking to build and run a hospital in Africa to alleviate suffering. The hospital in Lambaréné became his life’s work.

Open nobelprize.org
Source 03

Source summary (model-reported)

The biography describes Schweitzer as an internationally known concert organist, musicologist, author, theologian, and physician who studied medicine and went to Africa as a medical missionary. It discusses his work raising funds for his African hospital, not business or entrepreneurship as his primary identity.

Open nobelprize.org
2 · Answer check returns No
Q9
1 · Guesser asks

Was this person primarily known for religious or spiritual leadership?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for religious or spiritual leadership?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The expression “reverence for life” is the key to Albert Schweitzer's personal philosophy.
Open nobelprize.org
Source 02
Albert Schweitzer was a devout Christian... Minister turned doctor in Africa. Theologian and philosopher. He dedicated himself to medical studies, seeking to build and run a hospital in Africa to alleviate suffering. The hospital in Lambaréné became his life's work.
Open nobelprize.org
Source 03
Albert Schweitzer was an Alsatian-German theologian, philosopher, organist, and mission doctor in equatorial Africa, who received the 1952 Nobel Prize for Peace for his efforts on behalf of “the Brotherhood of Nations.”
Open britannica.com
2 · Answer check returns No
Q10
1 · Guesser reply rejectedTurn counted

Reply in the wrong format.

Invalid action · fixed format reminder sent

Why this reply was rejectedInvalid action · turn 10

The reply was JSON, but it matched neither the ASK nor the GUESS format.

Recorded type
invalid_action
Turn
10
Counted
Yes · question 10
Feedback
FORMAT_ERROR
What the model returnedExact text from the provider
Attempt 1 · finish stop
{"result":{"action":"ASK","question":"","name":null,"description":null}}
What a valid reply looks likeThe same formats shown to the Guesser
ASK
{"result":{"action":"ASK","description":null,"name":null,"question":"<non-empty yes-or-no property question>"}}
GUESS
{"result":{"action":"GUESS","description":"<non-empty identifying description>","name":"<non-empty candidate name>","question":null}}

A reply must match one of these formats exactly. Text fields in use must not be empty; unused fields must be JSON null.

2 · System responseFORMAT
Q11
1 · Guesser asks

Was this person primarily known as an explorer, aviator, or adventurer?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known as an explorer, aviator, or adventurer?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Albert Schweitzer ... Role: Missionary surgeon; Founder of Lambaréné ... Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The page also describes him as a gifted musician who gave organ concerts to finance the hospital in Africa.

Open nobelprize.org
Source 02

Source summary (model-reported)

Schweitzer was recognized as an internationally known concert organist and studied medicine after deciding to go to Africa as a medical missionary. In 1913, after obtaining his M.D., he went to Africa to serve as a physician and establish his hospital work.

Open nobelprize.org
Source 03

Source summary (model-reported)

Albert Schweitzer was an Alsatian-German theologian, philosopher, organist, and mission doctor in equatorial Africa, who received the 1952 Nobel Prize for Peace.

Open britannica.com
2 · Answer check returns No
Q12
1 · Guesser asks

Was this person primarily known for criminal activity (e.g., as a murderer, gangster, or outlaw)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known for criminal activity (e.g., as a murderer, gangster, or outlaw)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Albert Schweitzer ... Role: Missionary surgeon; Founder of Lambaréné ... Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work...” The page also describes him as “Doctor, Missionary, Philosopher and Musician.”
Open nobelprize.org
Source 02

Source summary (model-reported)

The Nobel Prize biography states that Schweitzer was recognized internationally as a concert organist, studied medicine, obtained an M.D., and went to Africa as a medical missionary to establish and support a hospital.

Open nobelprize.org
2 · Answer check returns No
Q13
1 · Guesser asks

Was this person primarily known as an activist, social reformer, or humanitarian?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person primarily known as an activist, social reformer, or humanitarian?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Role: Missionary surgeon; Founder of Lambaréné (République de Gabon). Prize motivation: “for his altruism, reverence for life, and tireless humanitarian work which has helped making the idea of brotherhood between men and nations a living one”
Open nobelprize.org
2 · Answer check returns Yes
Q14
1 · Guesser asks

Was this person a woman?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person a woman?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Albert Schweitzer Nobel Peace Prize 1952 ... Role: Missionary surgeon; Founder of Lambaréné ... Together with his wife, who was a nurse, he built and ran a hospital at the mission station Lambarene in Gabon.

Open nobelprize.org
2 · Answer check returns No
Q15
1 · Guesser asks

Was this person from the United States?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person from the United States?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Schweitzer was born on 14 January 1875 in Kaysersberg in Alsace, in what had less than four years previously become the Imperial Territory of Alsace-Lorraine in the German Empire. He later became a citizen of France after World War I, when Alsace became French territory again.
Open en.wikipedia.org
Source 03
The theologian, musician, philosopher and Nobel Prize-winning physician Albert Schweitzer is born on January 14, 1875 in Upper-Alsace, Germany (now Haut-Rhin, France).
Open history.com
2 · Answer check returns No
Q16
1 · Guesser asks

Was this person killed (assassinated or executed) rather than dying of natural causes?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person killed (assassinated or executed) rather than dying of natural causes?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Dr. Albert Schweitzer ... died Saturday, Sept. 4, at Lambarene, Gabon ... Weak and enfeebled by his long years of work, he finally succumbed to a cerebral stroke which he had suffered a week before his death.
Open mla.bethelks.edu
2 · Answer check returns No
Q17
1 · Guesser asks

Was this person from Europe?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person from Europe?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Schweitzer was born on 14 January 1875 in Kaysersberg in Alsace, in what had less than four years previously become the Imperial Territory of Alsace-Lorraine in the German Empire.
Open en.wikipedia.org
2 · Answer check returns Yes
Q18
1 · Guesser asks

Was this person's humanitarian work primarily connected to World War II or the Holocaust (e.g., rescuing people or pursuing justice for its victims)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person's humanitarian work primarily connected to World War II or the Holocaust (e.g., rescuing people or pursuing justice for its victims)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Nobel Foundation identifies Schweitzer as a missionary surgeon and founder of Lambaréné, and states that he and his wife built and ran a hospital at the mission station in Gabon. His prize motivation cited altruism, reverence for life, and tireless humanitarian work.

Open nobelprize.org
Source 02

Source summary (model-reported)

Johns Hopkins University Press states that Schweitzer dedicated the last six decades of his life to medicine and to the hospital he founded with his wife in French Equatorial Africa, and that he used his Nobel Prize stipend to expand the hospital and build facilities for leprosy patients.

Open press.jhu.edu
Source 03

Source summary (model-reported)

The Albert Schweitzer Fellowship reports that World War II disrupted supply lines to Africa and that supporters provided material and financial support for Schweitzer's hospital in Lambaréné. This describes a wartime effect on his African medical work, not humanitarian work primarily centered on the war or Holocaust victims.

Open schweitzerfellowship.org
2 · Answer check returns No
Q19
1 · Guesser asks

Did this person receive the Nobel Peace Prize?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did this person receive the Nobel Peace Prize?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q20
1 · Guesser guesses

Henry Dunant

Swiss humanitarian, founder of the Red Cross and co-recipient of the first Nobel Peace Prize in 1901

Validator rationale The proposal identifies Henry Dunant, a different historical person from the target Albert Schweitzer.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Swiss humanitarian, founder of the Red Cross and co-recipient of the first Nobel Peace Prize in 1901","name":"Henry Dunant","question":null}}
2 · Validator returns No
G
1 · Guesser guessesNot counted

Albert Schweitzer

Alsatian-born theologian, physician and humanitarian who founded a hospital in Lambaréné, Gabon, and won the 1952 Nobel Peace Prize

Validator rationale The proposal identifies Albert Schweitzer himself and matches the defining biographical details; it does not substitute the hospital, a work, or an organization.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Alsatian-born theologian, physician and humanitarian who founded a hospital in Lambaréné, Gabon, and won the 1952 Nobel Peace Prize","name":"Albert Schweitzer","question":null}}
2 · Validator returns Yes