Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Door handle in 27 counted questions.

Back to all Door handle rounds
Questions
27
Outcome
Solved
Format errors
No errors
Duration
6m 38s
Round cost
$0.2782 All 28 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

2 of 27 answers in this round reuse an earlier, fully checked answer with its original evidence. No new search or check ran for those turns.

Q1
1 · Guesser asks

Is the target a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a living organism?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Is the target a human-made entity?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a human-made entity?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. ... There are many designs of door handle, depending on the appropriate use. ... Door handles can be made out of a plethora of materials.

Open en.wikipedia.org
2 · Answer check returns Yes
Q3
1 · Guesser asks

Is the target a physical object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a physical object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q4
1 · Guesser asks

Is the target typically found indoors?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically found indoors?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors. ... Entrance: These door handles are typically used on exterior doors ... Privacy: Typically used on bedrooms and bathrooms ... Passage ... are used in hall or closet doors.
Open en.wikipedia.org
2 · Answer check returns Unknown
Q5
1 · Guesser asks

Is the target typically larger than an adult human?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically larger than an adult human?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Can the target typically be held in one hand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Can the target typically be held in one hand?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q7
1 · Guesser asks

Is the target an electronic device?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target an electronic device?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A handle is “a part of an object designed for holding, moving, or carrying the object easily”; the page gives “a door handle” as an example and notes that door handles can be made of brass.

Open dictionary.cambridge.org
Source 03

Source summary (model-reported)

The source describes an “electronic door handle” as a specific product containing electronics, LED signaling, and a power supply, showing that electronic handles are a particular variant rather than the defining identity of door handles generally.

Open nedapsecurity.com
2 · Answer check returns No
Q8
1 · Guesser asks

Is the target primarily used as a tool?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily used as a tool?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Fenestration hardware can be classified in three primary groups: hinges, tracks, guides, or a closer device for the purpose of determining movement; lockset, stop, or catch as a means of securing operable parts; and door knobs, lever handles, pull handles, or push plates as operating mechanisms.

Open huduser.gov
2 · Answer check returns No
Q9
1 · Guesser asks

Is the target primarily made of metal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily made of metal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Yale offers a wide variety of door handles in stainless steel, brass, zinc alloy, and aluminium material, available in different surface finishes.

Open yalehome.com
2 · Answer check returns Rather yes
Q10
1 · Guesser asks

Is the target used as money or currency?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target used as money or currency?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q11
1 · Guesser asks

Is the target typically worn on the body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically worn on the body?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q12
1 · Guesser asks

Is the target mainly used for eating or drinking?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target mainly used for eating or drinking?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is the target primarily used as a weapon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily used as a weapon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors.

Open en.wikipedia.org
2 · Answer check returns No
Q14
1 · Guesser asks

Is the target mainly used for recreation or play?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target mainly used for recreation or play?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q15
1 · Guesser asks

Is the target a container for holding something?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a container for holding something?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Dictionary.com defines a door handle as the handle used to open and close a door, and notes that it can sometimes mean the same thing as a doorknob.

Open dictionary.com
2 · Answer check returns No
Q16
1 · Guesser asks

Is the target used for writing or marking?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target used for writing or marking?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q17
1 · Guesser asks

Is the target primarily decorative?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily decorative?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. ... These may be plain or fancy, embellished in any form, and serve variously to protect surrounding surfaces, conceal ... fasteners, cover uneven rough openings, and add a decorative flourish.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

A door handle is the handle that you turn or push to open a door. It is a small round object or a lever that is attached to a door and is used for opening and closing it.

Open collinsdictionary.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is the target used to fasten or join other things together?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target used to fasten or join other things together?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. Most household door handles use a simple mechanism with a screw-style axle (called a spindle) ... to which the handles are attached.

Open en.wikipedia.org
2 · Answer check returns No
Q19
1 · Guesser asks

Is the target mainly a component part of a larger object rather than a standalone usable object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target mainly a component part of a larger object rather than a standalone usable object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A door handle or doorknob is a handle used to open or close a door. ... Most household door handles use a simple mechanism with a screw-style axle ... to which the handles are attached.
Open en.wikipedia.org
2 · Answer check returns Yes
Q20
1 · Guesser asks

Is the larger object the target is part of typically a machine?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the larger object the target is part of typically a machine?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors. The most common type ... [is] often found in residential houses and commercial and public buildings.

Open en.wikipedia.org
2 · Answer check returns No
Q21
1 · Guesser asks

Is the larger object the target is part of typically a piece of furniture?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the larger object the target is part of typically a piece of furniture?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors.
Open en.wikipedia.org
2 · Answer check returns No
Q22
1 · Guesser asks

Is the larger object the target is part of typically clothing or an accessory?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the larger object the target is part of typically clothing or an accessory?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors.
Open en.wikipedia.org
2 · Answer check returns No
Q23
1 · Guesser asks

Is the larger object the target is part of typically a vehicle?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the larger object the target is part of typically a vehicle?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The supplied subject description defines the target as the handle fitting used to open and close a building door, explicitly distinguishing it from the whole door and other components. Retrieved reference material notes that door handles can be found on residential and commercial building doors as well as vehicle doors.

Open en.wikipedia.org
2 · Answer check returns No
Q24
1 · Guesser asks

Is the larger object the target is part of typically a building or other built structure?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the larger object the target is part of typically a building or other built structure?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including: exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors.

Open en.wikipedia.org
2 · Answer check returns Yes
Q25
1 · Guesser asks

Is the target typically part of a door?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically part of a door?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. ... Most household door handles use a simple mechanism ... that is passed through the door ... to which the handles are attached.

Open en.wikipedia.org
2 · Answer check returns Yes
Q26
1 · Guesser asks

Is the target the part of a door that a person normally grasps to open or close it?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target the part of a door that a person normally grasps to open or close it?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source describes a door handle or doorknob as a handle used to open or close a door and identifies lever handles and doorknobs as common types.

Open en.wikipedia.org
2 · Answer check returns Yes
Q27
1 · Guesser asks

Is the target typically round or knob-shaped rather than an elongated lever?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically round or knob-shaped rather than an elongated lever?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The most common types of door handle are the lever handle and the doorknob. The most common type of door handle is the lever latch or latch door handle, often found in residential houses and commercial and public buildings.
Open en.wikipedia.org
Source 02

Source summary (model-reported)

Door handles can be either attractive door knobs, levers, or handles. Knobs are circular or other shapes, while levers are pushed up and down to open doors.

Open thespruce.com
2 · Answer check returns No
G
1 · Guesser guessesNot counted

door handle

lever-style handle attached to a door for opening and closing it

Validator rationale The proposal identifies the general door-handle fitting and its hand-operated function; the lever-style design is an acceptable narrower variant.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"lever-style handle attached to a door for opening and closing it","name":"door handle","question":null}}
2 · Validator returns Yes