Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Door handle in 23 counted questions.

Back to all Door handle rounds
Questions
23
Outcome
Solved
Format errors
No errors
Duration
5m 21s
Round cost
$0.1018 All 24 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the subject a physical entity that can exist as a tangible object or material?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a physical entity that can exist as a tangible object or material?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q2
1 · Guesser asks

Is it primarily manufactured or substantially shaped by humans, rather than occurring naturally?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily manufactured or substantially shaped by humans, rather than occurring naturally?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle or doorknob is a handle used to open or close a door. ... There are many designs of door handle, depending on the appropriate use. ... Door handles can be made out of a wide variety of materials. Examples include brass, porcelain, cut glass, wood, and bronze.

Open kiwi.itspektar.net
Source 03

Source summary (model-reported)

Door handle sets are door fittings that consist of door handles and the corresponding plates or rosettes and are used to open and close doors.

Open griffwerk.de
2 · Answer check returns Yes
Q3
1 · Guesser asks

Does it normally require electricity or another external power source to perform its main function?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it normally require electricity or another external power source to perform its main function?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A passage door knob or lever is a handle set without an internal locking mechanism. The handle set will open and close by simply turning the knob or lever.
Open emtek.com
Source 02
When the main requirement is aesthetics and a basic open-close function, then a dummy door knob can be the ideal choice. ... All you get is something to pull in order to open and close the door.
Open hiatt-hardware.com
Source 03
Passage levers do not have a locking mechanism. These are often used in closets, hallways, or any doorway that does not require any locking. ... dummy levers ... are simply used to swing the door open and closed.
Open schlage.com
2 · Answer check returns No
Q4
1 · Guesser asks

Is it small enough that a person can ordinarily hold and use it with one hand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it small enough that a person can ordinarily hold and use it with one hand?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q5
1 · Guesser asks

Does it have a sharp edge or point intended to cut or pierce something?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have a sharp edge or point intended to cut or pierce something?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Typical design features of a doorknob include: no sharp edges or ridges; a shape that is easily grasped or turned; a textured finish or non-slip coating on knob to improve grip.
Open encyclopedia.com
Source 02

Source summary (model-reported)

A handle/lever operates the latch when pushed down, while pull handles are designed for pulling the door open or closed. Knob handles are twisted to operate the latch or lock.

Open atlantichandles.com
2 · Answer check returns No
Q6
1 · Guesser asks

Is its primary purpose to write, draw, or make marks on another surface?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is its primary purpose to write, draw, or make marks on another surface?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Is it primarily used for preparing, serving, or consuming food or drink?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used for preparing, serving, or consuming food or drink?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

This standard door handle has a knob or lock that rotates to operate the latch and the door. ... Door handles can be either attractive door knobs, levers, or handles.

Open thespruce.com
2 · Answer check returns No
Q8
1 · Guesser asks

Is it primarily used for personal grooming, hygiene, or appearance?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used for personal grooming, hygiene, or appearance?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The source discusses cleaning and polishing door handles as maintenance activities intended to keep them looking good and functioning properly; it does not describe grooming, hygiene, or appearance care as the handle’s primary use.

Open primadecorativehardware.com
2 · Answer check returns No
Q9
1 · Guesser asks

Is it primarily used as a tool to manipulate, repair, assemble, or measure other objects?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used as a tool to manipulate, repair, assemble, or measure other objects?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q10
1 · Guesser asks

Is it primarily worn on the body or clothing rather than held or placed somewhere?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily worn on the body or clothing rather than held or placed somewhere?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Door handle sets are door fittings that consist of door handles and the corresponding plates or rosettes and are used to open and close doors. Inside the door is a square lever handle pin, which is connected to a lever handle on both sides.
Open griffwerk.de
2 · Answer check returns No
Q11
1 · Guesser asks

Is it primarily used for entertainment, play, or recreation?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used for entertainment, play, or recreation?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q12
1 · Guesser asks

Is its primary purpose to hold, store, or contain another object or substance?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is its primary purpose to hold, store, or contain another object or substance?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is it primarily used to fasten, join, or secure other objects together?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to fasten, join, or secure other objects together?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Schlage distinguishes door levers by function: keyed levers provide secure locking, passage levers are for doorways without locking, privacy levers provide interior privacy locking, and dummy levers are used to swing the door open and closed.

Open schlage.com
Source 03

Source summary (model-reported)

The source describes door handles as operating a latch or lock to allow a door to be opened, and describes pull handles as designed for pulling a door open or closed.

Open atlantichandles.com
2 · Answer check returns No
Q14
1 · Guesser asks

Is it primarily used to communicate information or convey a message to another person?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to communicate information or convey a message to another person?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source defines a door handle as the handle used to open and close a door, and distinguishes door handles from doorknobs by their possible shapes and operation.

Open dictionary.com
2 · Answer check returns No
Q15
1 · Guesser asks

Is it made primarily of metal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made primarily of metal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Door handles can be made from various materials depending on the style, function, and budget. Common materials listed include brass, stainless steel, zinc alloy, aluminum, bronze, and, in some cases, plastic or PVC.

Open atlantichandles.com
Source 02

Source summary (model-reported)

A door handle is described as typically made of metal or plastic and operated by pushing down or pulling up on the lever.

Open ikea.com
Source 03

Source summary (model-reported)

The page presents solid metal, solid wood, and glass door handles, and states that its own door hardware products are crafted from solid stainless steel.

Open jwlhome.com
2 · Answer check returns Yes
Q16
1 · Guesser asks

Is it primarily used to open or close something, such as a door, container, or lock?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used to open or close something, such as a door, container, or lock?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q17
1 · Guesser asks

Is it normally inserted into a lock to operate the lock mechanism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally inserted into a lock to operate the lock mechanism?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The spindle is the part of the door latch that connects the knob or handle to the latch mechanism. When the knob or handle is turned, it rotates the spindle and operates the latch.

Open homebuildershardware.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is it normally attached to the thing it helps open or close, rather than being a separate handheld implement?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally attached to the thing it helps open or close, rather than being a separate handheld implement?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q19
1 · Guesser asks

Is it designed to be grasped or turned by hand, as with a handle or knob?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it designed to be grasped or turned by hand, as with a handle or knob?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q20
1 · Guesser asks

Does it operate mainly by rotating around an axis, rather than by being pushed down or pulled sideways?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it operate mainly by rotating around an axis, rather than by being pushed down or pulled sideways?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Unknown
Q21
1 · Guesser asks

Is it commonly attached to a door as the part used to open or close the door?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it commonly attached to a door as the part used to open or close the door?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The most common type of door handle is the lever latch or latch door handle, often found in residential houses and commercial and public buildings. The handle operates the latch, allowing the door to be opened.

Open en.wikipedia.org
2 · Answer check returns Yes
Q22
1 · Guesser asks

Is the part primarily a round knob that must be turned, rather than a lever that is pressed down?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the part primarily a round knob that must be turned, rather than a lever that is pressed down?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A door handle is a lever operated device while a door knob usually is shaped like a oval or round shape. ... Door knobs require good grip to operate and turn the knob ... With door handles a tight grip is not required to operate. Only light pressure is needed to open it.

Open atlantichandles.com
2 · Answer check returns Unknown
Q23
1 · Guesser asks

Is it a lever-style door handle that is pressed down rather than a round doorknob that is turned?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a lever-style door handle that is pressed down rather than a round doorknob that is turned?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The modern Door handle, better known as the Lever handle, is part of a complex mechanism. ... Today's Door handles - or rather Door handles and Lever handles - are available in numerous designs.

Open griffwerk.de
Source 02

Source summary (model-reported)

Lever Handles ... feature a lever-shaped handle that you can push down or pull up to operate the latch mechanism. Knob Handles are round-shaped handles that you can twist to operate the latch or lock.

Open atlantichandles.com
2 · Answer check returns Unknown
G
1 · Guesser guessesNot counted

door handle

A metal handle attached to a door and used by hand to open or close it.

Validator rationale The proposal identifies the general type of hand-operated door handle fitting; specifying metal is permissible because the target leaves material unspecified.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A metal handle attached to a door and used by hand to open or close it.","name":"door handle","question":null}}
2 · Validator returns Yes