Deep20Bench
v1.0Previous

Benchmark edition

Edition 1.0 settings

7 subjects5 rounds per subject50 question limit
Question answersYesNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Did not identify Stephen King after 50 counted questions.

Back to all Stephen King rounds
Questions
50 Scored as 51
Outcome
Question limit reached
Format errors
No errors
Duration
38m 38s
Round cost
$3.5361 All 51 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser being evaluated in a Twenty Questions benchmark.

One subject is hidden. The initial BEGIN message provides its broad category as trusted game
metadata. Identify the subject using as few counted questions as possible. ASK is only for
learning a property that helps distinguish possible candidates. Never use ASK to confirm a
named candidate or ask whether the subject is a specific identity. When you are ready to name
a candidate, use GUESS immediately. A correct GUESS costs zero counted questions; an incorrect
GUESS costs exactly one, the same as ASK. A GUESS must provide both a name and a short
identifying description. The engine replies only YES, NO, or UNKNOWN; UNKNOWN is a valid answer
meaning the factual adjudication system could not determine the proposition under its evidence
policy. Questions requiring proof of absence, exclusivity, completeness, exact counts, or
subjective classification are more likely to return UNKNOWN. Prefer direct, positively
verifiable properties when possible.

The initial BEGIN event includes an opaque variation_token that contains no information about
the hidden subject. Do not interpret, repeat, mention, or derive meaning from it. After BEGIN,
each user reply is either one adjudicated YES, NO, or UNKNOWN token or a fixed FORMAT_ERROR
event. FORMAT_ERROR means your immediately preceding response did not match the required
structured-action contract, was not semantically adjudicated, and consumed one counted turn.
Use the formats in that event and try again. Never infer that the attempted question or
guess was right or wrong.

At most 50 questions or rejected guesses are counted. After that limit you receive
one final guess-only opportunity. Format errors also consume counted turns. The provider wire
response is an object with exactly one `result` action. On the final opportunity ASK is
forbidden. Return only the required structured response. Do not include analysis, hidden
reasoning, or additional fields.
BEGIN event
{"category":"person","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is this person known for working in entertainment, such as acting, music, or television?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for working in entertainment, such as acting, music, or television?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q2
1 · Guesser asks

Is this person primarily known as an actor?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person primarily known as an actor?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Is this person known as a singer or musician?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known as a singer or musician?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q4
1 · Guesser asks

Is this person a woman?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person a woman?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q5
1 · Guesser asks

Was this person born in the United States?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person born in the United States?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q6
1 · Guesser asks

Did this person first achieve widespread fame before 1990?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Did this person first achieve widespread fame before 1990?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q7
1 · Guesser asks

Is this person alive today?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person alive today?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q8
1 · Guesser asks

Is this person known for being a lead singer of a rock band?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for being a lead singer of a rock band?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q9
1 · Guesser asks

Had this person achieved widespread fame before 1970?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Had this person achieved widespread fame before 1970?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q10
1 · Guesser asks

Is this person especially associated with country music?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person especially associated with country music?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q11
1 · Guesser asks

Is this person African American?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person African American?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q12
1 · Guesser asks

Is this person well known for playing the piano?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person well known for playing the piano?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Stephen Edwin King ... made his first professional short story sale in 1967 ... King is the recipient of the 2003 National Book Foundation Medal for Distinguished Contribution to American Letters and the 2014 National Medal of Arts.
Open stephenking.com
2 · Answer check returns No
Q13
1 · Guesser asks

Was this person born before 1950?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Was this person born before 1950?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q14
1 · Guesser asks

Is this person known for performing folk music or folk rock?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for performing folk music or folk rock?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q15
1 · Guesser asks

Is this person best known as a singer rather than as an instrumentalist?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person best known as a singer rather than as an instrumentalist?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q16
1 · Guesser asks

Is this person best known for playing the guitar?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person best known for playing the guitar?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Best Known For: Stephen King is a 'New York Times'-bestselling novelist who made his name in the horror and fantasy genres. Outside of writing, King is a music fan and sometimes plays guitar.
Open biography.com
2 · Answer check returns No
Q17
1 · Guesser asks

Is this person known for playing drums or other percussion instruments?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing drums or other percussion instruments?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q18
1 · Guesser asks

Is this person known for composing music for films?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for composing music for films?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Is this person associated with jazz music?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person associated with jazz music?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q20
1 · Guesser asks

Is this person known for playing the trumpet or flugelhorn?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the trumpet or flugelhorn?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q21
1 · Guesser asks

Is this person known for playing the saxophone?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the saxophone?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q22
1 · Guesser asks

Is this person known for playing the bass guitar or double bass?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the bass guitar or double bass?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q23
1 · Guesser asks

Does this person play a wind instrument?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does this person play a wind instrument?"}}
2 · Answer check returns Unknown
Q24
1 · Guesser asks

Is this person known for playing the violin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the violin?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q25
1 · Guesser asks

Is this person known for playing the clarinet or flute?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the clarinet or flute?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q26
1 · Guesser asks

Is this person known for playing the trombone?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the trombone?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q27
1 · Guesser asks

Is this person known as a record producer?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known as a record producer?"}}
2 · Answer check returns Unknown
Q28
1 · Guesser asks

Is this person known for playing the banjo or mandolin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the banjo or mandolin?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q29
1 · Guesser asks

Is this person known for composing or conducting music?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for composing or conducting music?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q30
1 · Guesser asks

Is this person known for playing the harmonica?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the harmonica?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q31
1 · Guesser asks

Is this person known for playing an electronic keyboard or organ?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing an electronic keyboard or organ?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q32
1 · Guesser asks

Has this person won a Grammy Award?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Has this person won a Grammy Award?"}}
2 · Answer check returns Unknown
Q33
1 · Guesser asks

Is this person professionally known as a dancer or choreographer?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person professionally known as a dancer or choreographer?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q34
1 · Guesser asks

Is this person known for playing the vibraphone?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the vibraphone?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q35
1 · Guesser asks

Is this person known for hosting radio or television programs?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for hosting radio or television programs?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q36
1 · Guesser asks

Is this person known for playing the accordion?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the accordion?"}}
2 · Answer check returns Unknown
Q37
1 · Guesser asks

Has this person performed as a member of a musical band or ensemble?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Has this person performed as a member of a musical band or ensemble?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q38
1 · Guesser asks

Is this person known for playing the tuba?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the tuba?"}}
2 · Answer check returns Unknown
Q39
1 · Guesser asks

Is this person known for playing a stringed instrument?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing a stringed instrument?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q40
1 · Guesser asks

Is this person known for playing the cello?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the cello?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Best Known For: Stephen King is a 'New York Times'-bestselling novelist who made his name in the horror and fantasy genres... Outside of writing, King is a music fan. He even sometimes plays guitar and sings in a band.
Open biography.com
2 · Answer check returns No
Q41
1 · Guesser asks

Is this person known for playing the ukulele?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the ukulele?"}}
2 · Answer check returns Unknown
Q42
1 · Guesser asks

Is this person known for playing the harp?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the harp?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Stephen King is a bestselling novelist who made his name in the horror and fantasy genres... Outside of writing, King is a music fan. He sometimes plays guitar and sings in a band... Best Known For: Stephen King is a bestselling novelist.
Open biography.com
2 · Answer check returns No
Q43
1 · Guesser asks

Is this person known for playing the viola?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the viola?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q44
1 · Guesser guesses

Laraaji

American ambient musician born Edward Larry Gordon in 1943, known for playing the electric zither.

Validator rationale The proposal identifies Laraaji, an American ambient musician, while the trusted subject is Stephen King, the author.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"American ambient musician born Edward Larry Gordon in 1943, known for playing the electric zither.","name":"Laraaji","question":null}}
2 · Validator returns No
Q45
1 · Guesser asks

Is this person known for playing the Chapman Stick?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing the Chapman Stick?"}}
2 · Answer check returns Unknown
Q46
1 · Guesser asks

Is this person known for playing a dulcimer?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for playing a dulcimer?"}}
2 · Answer check returns Unknown
Q47
1 · Guesser asks

Has this person performed professionally on a guitar, including a steel guitar?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Has this person performed professionally on a guitar, including a steel guitar?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q48
1 · Guesser asks

Has this person performed as a member of Steely Dan or played on their recordings?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Has this person performed as a member of Steely Dan or played on their recordings?"}}
2 · Answer check returns Unknown
Q49
1 · Guesser asks

Is this person particularly associated with playing the pedal steel guitar?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person particularly associated with playing the pedal steel guitar?"}}
2 · Answer check returns Unknown
Q50
1 · Guesser asks

Is this person known for inventing or building musical instruments?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this person known for inventing or building musical instruments?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Best Known For: Stephen King is a New York Times-bestselling novelist who made his name in the horror and fantasy genres with books like Carrie, The Shining and IT.
Open biography.com
2 · Answer check returns No
G
1 · Guesser guessesNot counted

Bill Connors

American jazz guitarist born in 1949, known for playing with Chick Corea's Return to Forever and for his solo recordings.

Validator rationale The proposal identifies Bill Connors, an American jazz guitarist, while the trusted subject is Stephen King, the American author.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"American jazz guitarist born in 1949, known for playing with Chick Corea's Return to Forever and for his solo recordings.","name":"Bill Connors","question":null}}
2 · Validator returns No