Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 2

Round 2

Identified Door handle in 19 counted questions.

Back to all Door handle rounds
Questions
19
Outcome
Solved
Format errors
No errors
Duration
5m 29s
Round cost
$0.1856 All 20 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"BKXG3AZI"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

1 of 19 answers in this round reuse an earlier, fully checked answer with its original evidence. No new search or check ran for those turns.

Q1
1 · Guesser asks

Is it a tangible physical entity?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a tangible physical entity?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q2
1 · Guesser asks

Is it made by humans?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made by humans?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The page describes production of doorknobs and handles using moulding, high-pressure injection of melted metal, CNC turning, and lost-wax casting, and explicitly discusses how doorknobs and handles are made.

Open cmz.com
Source 02

Source summary (model-reported)

The page describes designing door handles, making prototypes and molds, and using casting, forging, or machining, followed by assembly, finishing, and quality control.

Open fosunhardware.com
2 · Answer check returns Yes
Q3
1 · Guesser asks

Is it usually small and light enough for one person to hold in one hand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it usually small and light enough for one person to hold in one hand?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Specifications list interior and exterior pull handles measuring 160 mm by 185 mm and weighing 563 g and 580 g, respectively; other listed handle components weigh 135 g, 150 g, and 194 g.

Open sugatsune.com
Source 02

Source summary (model-reported)

The Total Door Handle is listed as 157 mm wide, 28 mm high, and 51 mm deep. The page describes its squared, rectangular lever as designed to provide a firm grip.

Open dimensions.com
2 · Answer check returns Yes
Q4
1 · Guesser asks

Does it require electricity to perform its primary function?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it require electricity to perform its primary function?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A lift handle is a handle attached to the door that allows you to manually open or close a door. ... The lift handles and pull ropes are intended for use with a door that is opened and closed by hand.

Open raynor.com
Source 02

Source summary (model-reported)

A door handle, adapted to be mounted on a door for actuating a lock to open the door ... further comprising an electric source ... for supplying [an electroluminescent sheet] with electric power.

Open patents.justia.com
2 · Answer check returns No
Q5
1 · Guesser asks

Is it primarily used as a tool to perform a practical task?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used as a tool to perform a practical task?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Rather yes
Q6
1 · Guesser asks

Is its primary use to cut, shape, fasten, or otherwise physically alter another object or material?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is its primary use to cut, shape, fasten, or otherwise physically alter another object or material?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Is its primary purpose to measure, indicate, or help determine some quantity or condition?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is its primary purpose to measure, indicate, or help determine some quantity or condition?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q8
1 · Guesser asks

Is it primarily used to hold, contain, or carry something else?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to hold, contain, or carry something else?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

For a door or window, a handle is “the part of a door, window, etc. that you use to open it.” The same entry separately defines handles of cups, bags, or tools as parts used to hold or carry them.

Open oxfordlearnersdictionaries.com
2 · Answer check returns No
Q9
1 · Guesser asks

Is it primarily used to open, close, lock, or unlock something?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to open, close, lock, or unlock something?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened.

Open en.wikipedia.org
Source 03

Source summary (model-reported)

Pull handles are long handles that are typically used on doors that do not require latching or locking mechanisms... They are designed for pulling the door open or closed. Other door-handle types can operate latches, locks, or unlocking mechanisms.

Open atlantichandles.com
2 · Answer check returns Yes
Q10
1 · Guesser asks

Is it used to unlock a lock by being inserted into the lock?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it used to unlock a lock by being inserted into the lock?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The keyhole is the access area for inserting your key into the lock. Thumbturn: A thumbturn is a small rotating knob or lever on the interior of a door lock, which allows users to lock or unlock the door without a key. The handle allows you to operate the latch.

Open us.eufy.com
Source 02

Source summary (model-reported)

It consists of a handle/lever on a backplate which when pushed down turns the spindle which passes through the door and the tubular latch inside the door allowing the door to be opened. A lock door handle has a keyhole cut out ... to allow a key to be entered into the door to operate a sash lock.

Open atlantichandles.com
2 · Answer check returns No
Q11
1 · Guesser asks

Is it primarily used to open sealed food or drink containers?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to open sealed food or drink containers?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
A door handle or doorknob is a handle used to open or close a door. Door handles can be found on all types of doors including exterior doors of residential and commercial buildings, internal doors, cupboard doors and vehicle doors.
Open kiwi.itspektar.net
2 · Answer check returns No
Q12
1 · Guesser asks

Does the object itself physically secure something against being opened or moved?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does the object itself physically secure something against being opened or moved?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The common lever latch or latch door handle has a lever or knob that operates the latch. Pushing the handle down operates the latch mechanism and allows the door to be opened. The article also distinguishes this from the latch that keeps the door shut.

Open en.wikipedia.org
2 · Answer check returns No
Q13
1 · Guesser asks

Is it normally attached to a door, window, lid, or similar movable barrier while being used?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally attached to a door, window, lid, or similar movable barrier while being used?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q14
1 · Guesser asks

Does a person normally grasp and move it directly to open or close the barrier?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does a person normally grasp and move it directly to open or close the barrier?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened. The doorknob has a spindle running through it... Pushing the lever or turning the knob pulls the cylinder...

Open en.wikipedia.org
Source 02

Source summary (model-reported)

A door handle is the handle used to open and close a door. ... Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
2 · Answer check returns Yes
Q15
1 · Guesser asks

Is it typically turned or rotated by the user's hand to operate the barrier?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically turned or rotated by the user's hand to operate the barrier?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle... Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door... The doorknob has a spindle... Pushing the lever or turning the knob pulls the cylinder in the direction of the turn.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

It consists of a handle/lever... which when pushed down turns the spindle... Knob Handles... are round-shaped handles that you can twist to operate the latch or lock. Pull Handles... are designed for pulling... as opposed to a turning motion with a door handle on rose.

Open atlantichandles.com
Source 03

Source summary (model-reported)

Another difference is that doorknobs typically turn. Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
2 · Answer check returns Yes
Q16
1 · Guesser asks

Is it typically rounded or knob-shaped rather than an elongated lever or handle?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically rounded or knob-shaped rather than an elongated lever or handle?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A doorknob most often specifically refers to a handle shaped like a knob ... Door handles in other shapes might be called doorknobs, but it’s more likely for them to be called door handles or just handles. Door handles ... can also be fixed in place, like a vertical or horizontal bar.

Open dictionary.com
Source 02

Source summary (model-reported)

doorhandle: a knob used to release the catch when opening a door (often called ‘doorhandle’ in Great Britain). ... type of: knob a round handle

Open vocabulary.com
2 · Answer check returns Unknown
Q17
1 · Guesser asks

Does turning it retract a latch that holds the barrier closed?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does turning it retract a latch that holds the barrier closed?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The page states that a tubular latch is installed with interior door handles and that “Turning the handle retracts the latch into the door by rotating the thru spindle.” It also explains that latch bolts hold the door in place when engaged.

Open hiatt-hardware.com
2 · Answer check returns Yes
Q18
1 · Guesser asks

Is the barrier it operates ordinarily a full-size door used by people to enter or leave a room or building?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the barrier it operates ordinarily a full-size door used by people to enter or leave a room or building?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle, often found in residential houses and commercial and public buildings. ... Pushing the handle down ... allowing it to be opened.

Open en.wikipedia.org
2 · Answer check returns Yes
Q19
1 · Guesser asks

Does it have an elongated lever that is normally pushed downward to retract the latch?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have an elongated lever that is normally pushed downward to retract the latch?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The handle is the part you grab with your hand when opening or closing the door. Lever: A lever is a push-type handle that, when pressed, moves the spindle, pulling the latch into the lock body. Knob: A knob is a round handle that, when turned, moves the spindle, pulling the latch into the lock body.

Open doordesignlab.com
Source 02

Source summary (model-reported)

Some door levers have push-button locks ... while some may simply latch ... There are also inactive levers for doors that close without a latch.

Open schlage.com
2 · Answer check returns Rather yes
G
1 · Guesser guessesNot counted

door handle

A hand-operated lever or grip mounted on a door, turned or pushed to retract its latch and open it.

Validator rationale The proposal identifies the general kind of door handle and preserves its defining hand-operated door-opening function.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A hand-operated lever or grip mounted on a door, turned or pushed to retract its latch and open it.","name":"door handle","question":null}}
2 · Validator returns Yes