Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 2

Round 2

Identified Door handle in 21 counted questions.

Back to all Door handle rounds
Questions
21
Outcome
Solved
Format errors
No errors
Duration
15m 22s
Round cost
$0.3091 All 22 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"BKXG3AZI"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is it a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a living organism?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Is it human-made?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it human-made?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The manufacturer classifies door handles as door hardware and states that it produces door handles in various designs, including tubular, rectangular, and square forms, as well as special handles made to customer specifications.

Open wss.de
2 · Answer check returns Yes
Q3
1 · Guesser asks

Is it a physical, tangible object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a physical, tangible object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

A door handle is the handle used to open and close a door. Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
2 · Answer check returns Yes
Q4
1 · Guesser asks

Is it an electronic device?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it an electronic device?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle is the handle used to open and close a door. Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
Source 02

Source summary (model-reported)

Huf describes door-handle systems with electronic components for passive entry integrated into the door handles, including touch recognition and other sensor-based systems.

Open huf-group.com
Source 03

Source summary (model-reported)

TELENOT describes digital door handles in which electronics and mechanics are housed in the lever handle for electronic access control, while also offering visually identical mechanical versions.

Open telenot.com
2 · Answer check returns Unknown
Q5
1 · Guesser asks

Does it require electricity to function?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it require electricity to function?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle... Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

Many newer cars have replaced the tried-and-true door handle with complex electronic versions... Instead of a simple, familiar mechanical latch, it’s now common for some car exterior door handles to remain flush against the door until the car is unlocked, requiring an electric motor to open.

Open consumerreports.org
2 · Answer check returns No
Q6
1 · Guesser asks

Is it something that is typically worn on the body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it something that is typically worn on the body?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Does it have moving parts?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have moving parts?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened. The doorknob has a spindle running through it...
Open en.wikipedia.org
2 · Answer check returns Yes
Q8
1 · Guesser asks

Is it typically used for transportation?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically used for transportation?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle, often found in residential houses and commercial and public buildings... Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened.

Open en.wikipedia.org
Source 02
It consists of a handle/lever on a backplate which when pushed down turns the spindle which passes through the door and the tubular latch inside the door allowing the door to be opened... Pull handles... are designed for pulling the door open or closed.
Open atlantichandles.com
2 · Answer check returns No
Q9
1 · Guesser asks

Is it typically used as a tool or utensil?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically used as a tool or utensil?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Dictionary.com defines a door handle as the handle used to open and close a door, noting that it may be a knob, a vertical bar, or a horizontal bar.

Open dictionary.com
2 · Answer check returns No
Q10
1 · Guesser asks

Does it have wheels?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have wheels?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle... The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

A door handle is the handle used to open and close a door. Sometimes, it means the same thing as doorknob... Door handles in other shapes might be called doorknobs or just handles. Doorknobs typically turn. Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
2 · Answer check returns No
Q11
1 · Guesser asks

Is it a type of furniture?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a type of furniture?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Furniture: equipment or articles that are necessary, useful, or desirable; specifically, movable articles (such as tables, beds, chairs) used to make a room ready for use.

Open merriam-webster.com
Source 03

Source summary (model-reported)

Door furniture, in British and Australian English, or door hardware in North American English, refers to items attached to a door or drawer to enhance functionality or appearance; doors generally have at least one fixed handle.

Open en.wikipedia.org
2 · Answer check returns Unknown
Q12
1 · Guesser asks

Is it small enough to be held in one hand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it small enough to be held in one hand?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

ADA-compliant door handles must meet other standards besides door handle height. Among other requirements, they need to allow one-hand operation, operate with 5 lbf (pound-force) maximum force or less, and can be gripped loosely.

Open thespruce.com
Source 02

Source summary (model-reported)

With the door in the open position, place one hand over the external handle and hold it firmly in place. Using the correct type of screwdriver, un-tighten the fixing screws on the internal handle set.

Open eraeverywhere.com
2 · Answer check returns Yes
Q13
1 · Guesser asks

Is it primarily used for entertainment, play, or as a toy?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used for entertainment, play, or as a toy?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The source explains that a standard passage door handle rotates to operate the latch and door, and discusses door handles in terms of door functionality, security, and interior or exterior use.

Open thespruce.com
2 · Answer check returns No
Q14
1 · Guesser asks

Does it typically contain gears?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it typically contain gears?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The most common type of door handle is the lever latch or latch door handle... Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door.
Open en.wikipedia.org
Source 03
The door handle consists of a spindle, a knob, and a lever. When you push down on the knob, it turns the spindle. The spindle then pushes or pulls the lever... allowing the door to open or close.
Open manovelladesign.com
2 · Answer check returns No
Q15
1 · Guesser asks

Is it typically made primarily of metal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically made primarily of metal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
In the U.S., most door knobs and levers are made from brass. Historically, door knobs and levers have been made from glass, wood, clay, bronze, brass, iron, and steel. Today, most door hardware in the U.S. is brass, but you’ll also find options made from bronze, stainless steel, iron, pewter, and other metals.
Open brennancorp.com
Source 02

Source summary (model-reported)

The manufacturer’s door-handle range includes brass, stainless steel, aluminium, and zinc handles, with the listed materials used for exterior, interior, public-space, and light-interior applications.

Open abloy.com
2 · Answer check returns Yes
Q16
1 · Guesser asks

Is it typically used to lock, fasten, or secure something?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically used to lock, fasten, or secure something?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Passage door handles do not have locking mechanisms and are typically used on closet and basement doors and other interior doors that do not require a lock. The source also distinguishes specialized privacy and keyed handles that can secure doors.

Open thespruce.com
Source 03

Source summary (model-reported)

A passage door knob or lever is a handle set without an internal locking mechanism; it opens and closes by turning. Privacy and keyed handle sets are separate types that include locking mechanisms.

Open emtek.com
2 · Answer check returns No
Q17
1 · Guesser asks

Does it typically have a hinge?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it typically have a hinge?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle is the handle used to open and close a door. Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is it typically a component or part of a larger object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically a component or part of a larger object?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q19
1 · Guesser asks

Is it typically used as a part in machinery or mechanical devices?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically used as a part in machinery or mechanical devices?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A standard door handle is described as a handle/lever whose spindle passes through the door and latch, allowing the door to be opened. The page also describes pull handles as used on sliding or entrance doors and knob handles as commonly found on residential and interior doors.

Open atlantichandles.com
Source 02

Source summary (model-reported)

The USPTO places attachable or adjunct handles and related door articles in Class 16, “MISCELLANEOUS HARDWARE,” which includes door-hangers, hinges, door checks and closures, and other hardware articles.

Open uspto.gov
Source 03

Source summary (model-reported)

The page presents door handles and related components within “door hardware,” discussing access control and the mechanical and electrified hardware used to hang, secure, control, and protect doors.

Open us.allegion.com
2 · Answer check returns No
Q20
1 · Guesser asks

Is it typically used on or attached to a door?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically used on or attached to a door?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

A door handle is the handle used to open and close a door. The term can refer to handles that turn or fixed vertical or horizontal bars.

Open dictionary.com
2 · Answer check returns Yes
Q21
1 · Guesser asks

Does a person typically grasp it with their hand in order to open a door?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does a person typically grasp it with their hand in order to open a door?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

doorknob

a round, typically metal handle attached to a door that is grasped and turned to open the door

Validator rationale A doorknob is a recognized subtype of door handle: it is the hand-operated fitting used to open and close a door. The added round shape and typical metal material do not conflict with the target's unspecified design or material.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"a round, typically metal handle attached to a door that is grasped and turned to open the door","name":"doorknob","question":null}}
2 · Validator returns Yes