Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Door handle in 29 counted questions.

Back to all Door handle rounds
Questions
29
Outcome
Solved
Format errors
No errors
Duration
8m 11s
Round cost
$0.3232 All 30 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is it a living organism (such as an animal or plant)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a living organism (such as an animal or plant)?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Is it a human-made object (manufactured or constructed by people)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a human-made object (manufactured or constructed by people)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q3
1 · Guesser asks

Is it small enough to be held in one hand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it small enough to be held in one hand?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q4
1 · Guesser asks

Is it primarily used as a tool or instrument (something you operate to accomplish a task)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily used as a tool or instrument (something you operate to accomplish a task)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Rather yes
Q5
1 · Guesser asks

Does it contain electronic components or require power (electricity/batteries) to function?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it contain electronic components or require power (electricity/batteries) to function?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
We also offer individual components ... electronic components for passive entry integrated into the door handles... we integrate mechanical locking cylinders and electronic components for touch recognition and other sensor-based passive entry systems into ... door handle systems.
Open huf-group.com
Source 02
The electric drive on the flush-fitting door handles controls the outward and inward movement of the door handle... Huf ... offers solutions for ... electronic door handles for passive entry... electronic components ... integrated ... into door handle electronics.
Open huf-group.com
Source 03
Many newer cars have replaced the tried-and-true door handle with complex electronic versions. Instead of a simple, familiar mechanical latch, it’s now common for a car’s exterior door handles to remain flush against the door until the car is unlocked, requiring an electric motor to open.
Open consumerreports.org
2 · Answer check returns Unknown
Q6
1 · Guesser asks

Is it made mostly of metal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made mostly of metal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Today, most door hardware in the U.S. is brass, but you’ll also find options made from bronze, stainless steel, iron, pewter, and other metals. Historically, door knobs and levers have been made from glass, wood, clay, bronze, brass, iron, and steel.
Open brennancorp.com
Source 02
Door handles can be made from various materials depending on the style, function, and budget. Common materials include brass, stainless steel, zinc alloy, aluminum, and bronze. In some cases, door handles can be made from plastic or PVC materials.
Open atlantichandles.com
2 · Answer check returns Yes
Q7
1 · Guesser asks

Does it have a sharp edge or point used for cutting, piercing, or scraping?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have a sharp edge or point used for cutting, piercing, or scraping?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A door handle is the handle used to open and close a door. ... Door handles in other shapes might be called doorknobs, but it’s more likely for them to be called door handles or just handles. ... Door handles can turn, but they can also be fixed in place, like a vertical or horizontal bar.
Open dictionary.com
Source 02
The most common type of door handle is the lever latch or latch door handle ... The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle ... allowing it to be opened.
Open en.wikipedia.org
2 · Answer check returns No
Q8
1 · Guesser asks

Is it used to grip, turn, or strike something (like a wrench, pliers, or hammer)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it used to grip, turn, or strike something (like a wrench, pliers, or hammer)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q9
1 · Guesser asks

Is it commonly used for measuring or displaying information (such as a gauge, meter, or dial)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it commonly used for measuring or displaying information (such as a gauge, meter, or dial)?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The most common type of door handle is the lever latch or latch door handle... The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened.
Open en.wikipedia.org
2 · Answer check returns No
Q10
1 · Guesser asks

Is it typically found in a kitchen or used with food and drink?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically found in a kitchen or used with food and drink?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The most common type of door handle is the lever latch or latch door handle, often found in residential houses and commercial and public buildings. ... This type of door handle is used on interior doors that do not need to be locked.
Open en.wikipedia.org
Source 02
Kitchen handles ... Door handles complement the overall design of your kitchen ... simple door handles for modern kitchens. All of our handle styles can fit any kitchen door from any of our ranges.
Open dreamdoors.co.uk
2 · Answer check returns No
Q11
1 · Guesser asks

Does it have moving parts?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have moving parts?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Most household door handles use a simple mechanism with a screw-style axle (called a spindle) ... Handles that lose traction can frequently be repaired by replacing or adjusting the set screw, which prevents them from slipping on the spindle.
Open ifixit.com
2 · Answer check returns Yes
Q12
1 · Guesser asks

Is it used to fasten, lock, or secure something (like a lock, clasp, or clip)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it used to fasten, lock, or secure something (like a lock, clasp, or clip)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is it a musical instrument or used to produce sound?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a musical instrument or used to produce sound?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q14
1 · Guesser asks

Is it something a person typically carries with them in daily life?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it something a person typically carries with them in daily life?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q15
1 · Guesser asks

Is it a component or part of a larger machine or structure, rather than a standalone item?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a component or part of a larger machine or structure, rather than a standalone item?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q16
1 · Guesser asks

Is it involved in transmitting motion or power (such as a gear, pulley, or bearing)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it involved in transmitting motion or power (such as a gear, pulley, or bearing)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened.
Open en.wikipedia.org
Source 02
The invention relates basically to a lever handle 20, adapted to operate a latch and/or lock mechanism ... by means of rotatable shaft or spindle 30. A user withdraws the latch bolt ... by rotating handle 20 and spindle 30.
Open patents.justia.com
2 · Answer check returns Yes
Q17
1 · Guesser asks

Does it have teeth that mesh with another similar part?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have teeth that mesh with another similar part?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The most common type of door handle is the lever latch or latch door handle... The door handle has only a lever handle or knob which operates this latch. Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door...
Open en.wikipedia.org
Source 02
The device... comprises a wheel rotatably mounted within said door and having a row of teeth... said leaves meshing with the slots between said teeth... so as to prevent rotational movement of said wheel and actuation of said door handle.
Open patents.justia.com
2 · Answer check returns No
Q18
1 · Guesser asks

Does it rotate or spin during normal operation?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it rotate or spin during normal operation?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The most common type of door handle is the lever latch or latch door handle... Pushing the handle down rotates the spindle, operating the tubular latch mechanism inside the door, allowing it to be opened... Pushing the lever or turning the knob pulls the cylinder in the direction of the turn.
Open en.wikipedia.org
Source 02
It consists of a handle/lever on a backplate which when pushed down turns the spindle... Knob Handles: Knob handles are round-shaped handles that you can twist to operate the latch or lock... Pull handles... are designed for pulling the door open or closed... as opposed to a turning motion.
Open atlantichandles.com
2 · Answer check returns Yes
Q19
1 · Guesser asks

Does it contain rolling balls or rollers between two rings?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it contain rolling balls or rollers between two rings?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
In a door handle assembly ... the door handle (2) is journalled through a ball bearing (5) with respect to a mounting plate (8) ... the inner race (6) of the ball bearing being secured in the inner end of the door handle (2).
Open patents.justia.com
Source 02
Bearing: cranked knob on the outside; sprung fixed/movable door handle on the inside, maintenance-free slide bearing; Connection: HOPPE solid spindle
Open hoppe.com
2 · Answer check returns Unknown
Q20
1 · Guesser asks

Is it roughly circular or wheel-shaped in form?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it roughly circular or wheel-shaped in form?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Their straightforward, circular shape heightens their classic style... the conventional doorknob continues to remain popular. ... Round door handles can relate to the more modern lever on rose handles or classic doorknobs.
Open hiatt-hardware.com
Source 02
Knob Handles: Knob handles are round-shaped handles that you can twist... Pull Handles are long handles... Lever Handles... feature a lever-shaped handle that you can push down or pull up.
Open atlantichandles.com
2 · Answer check returns Unknown
Q21
1 · Guesser asks

Is it long and rod-shaped (much longer than it is wide)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it long and rod-shaped (much longer than it is wide)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
There are various types of door handles available... Lever Handles... feature a lever-shaped handle... Knob Handles: Knob handles are round-shaped handles... Pull Handles: Pull handles are long handles...
Open atlantichandles.com
2 · Answer check returns Unknown
Q22
1 · Guesser asks

Is it a spring (a coiled elastic component)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a spring (a coiled elastic component)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The elastic member 4 consists of a torsion spring or the like that urges the handle main body 2 into an original state when the handle main body 2 is operated. The handle main body 2 includes a grip 20 in the form of a lever, a rotation support 21, and an engagement portion 22.
Open patents.google.com
Source 02
A return spring assembly for returning a handle to the horizontal orientation includes a spring housing... A spring is driven by two spring drivers... The spring is positioned to not interfere with a linkage extending out from the latchbolt lock mechanism.
Open patents.google.com
Source 03
A door handle is a mechanism that is attached to a door to enable the user to open or close it. It is typically made of metal, wood, or plastic and is designed to be grasped by the hand and turned or pulled to operate the door.
Open design-encyclopedia.com
2 · Answer check returns No
Q23
1 · Guesser asks

Is it found in the engine or drivetrain of a motor vehicle?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it found in the engine or drivetrain of a motor vehicle?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The drivetrain includes everything from the transmission to the wheels but excludes the engine itself. It transmits power that is already generated by the engine to the rest of the vehicle.
Open x-engineer.org
Source 03
The drivetrain is defined as any component that delivers power directly to the wheels of the vehicle. It includes: Transmission, Axles, Differential, Clutch and Flywheel, Driveshaft, Torque Converter, CV Joint, Universal Joint.
Open gillmanhondahouston.com
2 · Answer check returns No
Q24
1 · Guesser asks

Is it a part of a bicycle?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a part of a bicycle?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q25
1 · Guesser asks

Is it a part of a clock or watch mechanism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a part of a clock or watch mechanism?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
An escape wheel is the final wheel in a timepiece's gear train. ... This controlled release is the function of the escapement, a crucial component in watches and clocks.
Open britannica.com
Source 03
The term "incomplete watch or clock movements, assembled" refers to ... mechanical movements ... [including] the escapement or the barrel bridge ... [and] battery powered movements ... [including] the motor.
Open usitc.gov
2 · Answer check returns No
Q26
1 · Guesser asks

Is it a part of a hand-operated device rather than a powered machine?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a part of a hand-operated device rather than a powered machine?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A fitting with a handle for operating the lock follower of a lock fitted in a door... the handle... [transfers] rotary movement... to the operating rod.
Open justia.com
Source 02
Hand tool | Hand held device for performing work on a material or a physical system using only muscular strength. Machine tools and devices with power drive means are not considered as tools.
Open uspto.gov
2 · Answer check returns Yes
Q27
1 · Guesser asks

Is it something you turn or crank with your hand to operate the device?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it something you turn or crank with your hand to operate the device?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Rather yes
Q28
1 · Guesser asks

Is it a handle or knob that you grasp?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a handle or knob that you grasp?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A door handle is the handle used to open and close a door. Sometimes, it means the same thing as doorknob. ... Door handles in other shapes might be called doorknobs ...
Open dictionary.com
2 · Answer check returns Yes
Q29
1 · Guesser asks

Is it specifically a door handle or doorknob?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it specifically a door handle or doorknob?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Doorknob

The round metal handle on a door that you turn to open it

Validator rationale A doorknob is a recognized subtype of door handle and retains the defining hand-operated function for opening and closing a door.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"The round metal handle on a door that you turn to open it","name":"Doorknob","question":null}}
2 · Validator returns Yes