Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Eyebrow in 14 counted questions.

Back to all Eyebrow rounds
Questions
14
Outcome
Solved
Format errors
No errors
Duration
3m 4s
Round cost
$0.0957 All 15 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the subject a physical, tangible entity?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a physical, tangible entity?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q2
1 · Guesser asks

Is the subject man-made?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject man-made?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The American Academy of Ophthalmology describes eyebrows as curved, delicate hairs above the eyes and discusses their biological protective and communicative functions.

Open aao.org
2 · Answer check returns No
Q3
1 · Guesser asks

Is the subject a living organism or derived from one?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a living organism or derived from one?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q4
1 · Guesser asks

Does the subject belong to the animal kingdom or come from an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does the subject belong to the animal kingdom or come from an animal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Humans can move on their own and are placed in the animal kingdom... Our family is the hominid, within the order primate, within the class mammal, within the phylum chordate, within the kingdom animalia.

Open bio.libretexts.org
Source 02

Source summary (model-reported)

The area of curved, delicate hairs above our eyes are believed to channel unwanted moisture—sweat and rain in particular—away from the eye... eyebrows remained a core part of our features.

Open aao.org
Source 03

Source summary (model-reported)

Eyebrow hair serves many important biologic and aesthetic functions. This article reviews the structure and function of the hair follicle... Eyebrow hair follicles share the same basic structure as hair follicles elsewhere on the body.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q5
1 · Guesser asks

Is the subject an animal itself, rather than a part or product of an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an animal itself, rather than a part or product of an animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Is the subject an anatomical part of an animal's body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an anatomical part of an animal's body?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The general anatomy of the non-globe periorbital region is depicted... Eyebrow: The arch of hair on the brow... The eyebrows usually extend further laterally than medially, in relation to the eye.

Open elementsofmorphology.nih.gov
2 · Answer check returns Yes
Q7
1 · Guesser asks

Is this body part normally found in the human body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part normally found in the human body?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q8
1 · Guesser asks

Is the subject located entirely inside the body in a living person?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject located entirely inside the body in a living person?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q9
1 · Guesser asks

Is this body part located on the head?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part located on the head?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q10
1 · Guesser asks

Is this body part a specialized sensory organ (such as an eye, ear, or nose)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part a specialized sensory organ (such as an eye, ear, or nose)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The eyebrow is an area of coarse skin hairs above the eye that follows the shape of the brow ridges. The main function of the eyebrows is to prevent moisture ... from flowing into the eye ... Together with the eyebrows, the brow ridges also shade the eyes from sunlight.

Open wikidoc.org
Source 02

Source summary (model-reported)

The eye is a highly specialized sensory organ located within the bony orbit. The main function of the eye is to detect the visual stimuli (photoreception) and to convey the gathered information to the brain via the optic nerve.

Open kenhub.com
2 · Answer check returns No
Q11
1 · Guesser asks

Does the subject consist of hair?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does the subject consist of hair?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q12
1 · Guesser asks

Is this hair located on the face?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this hair located on the face?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Eyebrow: The arch of hair on the brow... The eyebrow is sometimes referred to as the supercilium. The page identifies this as anatomy of the periorbital region and describes the brow as overlying the bony supraorbital ridge.

Open elementsofmorphology.nih.gov
Source 02

Source summary (model-reported)

The study analyzes the topographic anatomy of the eyebrow and its three-dimensional relation to the eye and the supraorbital rim, confirming the eyebrow's anatomical location above and around the eye.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q13
1 · Guesser asks

Is this hair located on or around the eyes (such as eyebrows or eyelashes)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this hair located on or around the eyes (such as eyebrows or eyelashes)?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q14
1 · Guesser asks

Does this hair grow directly along the edge of the eyelid?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does this hair grow directly along the edge of the eyelid?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The American Academy of Ophthalmology states that eyelashes are the short hairs that grow along the edge of the eyelids.

Open aao.org
2 · Answer check returns No
G
1 · Guesser guessesNot counted

Eyebrow

The strip of hair growing above the eye socket on the face

Validator rationale The proposal identifies the general human eyebrow, the anatomical feature of short hairs above the eye, not an isolated hair or unrelated object.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"The strip of hair growing above the eye socket on the face","name":"Eyebrow","question":null}}
2 · Validator returns Yes