Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Eyebrow in 24 counted questions.

Back to all Eyebrow rounds
Questions
24
Outcome
Solved
Format errors
No errors
Duration
5m 55s
Round cost
$0.1905 All 25 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is this thing a living organism (such as an animal, plant, fungus, or microorganism)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing a living organism (such as an animal, plant, fungus, or microorganism)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Better Health Channel states that larger terminal hairs are found on the scalp, eyebrows, armpits, beard, and pubic regions. It explains that human hair grows at the bulb, which is the only living part of the hair, while hair cells mature into hair fibre cells through keratinisation.

Open betterhealth.vic.gov.au
Source 03

Source summary (model-reported)

This biology resource describes hair as a keratinous filament primarily made of dead, keratinized cells and states that the external hair is completely dead and composed entirely of keratin.

Open courses.lumenlearning.com
2 · Answer check returns No
Q2
1 · Guesser asks

Is this thing a physical, tangible entity or substance?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing a physical, tangible entity or substance?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q3
1 · Guesser asks

Is this thing typically man-made or manufactured by humans?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing typically man-made or manufactured by humans?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

Eyebrows and eyelashes remained a core part of our features. They are our foremost eye accessories, and we wax, tweeze and even dye them.

Open aao.org
2 · Answer check returns No
Q4
1 · Guesser asks

Is this thing primarily located in outer space (such as a celestial body or astronomical object)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing primarily located in outer space (such as a celestial body or astronomical object)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q5
1 · Guesser asks

Is this thing a specific named individual place or geographical feature (as opposed to a general kind of object, material, or landform)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing a specific named individual place or geographical feature (as opposed to a general kind of object, material, or landform)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Is this thing derived from or part of a biological organism (such as a body part, shell, bone, wood, or fossil)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing derived from or part of a biological organism (such as a body part, shell, bone, wood, or fossil)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q7
1 · Guesser asks

Is this thing derived from an animal rather than a plant or fungus?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing derived from an animal rather than a plant or fungus?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
In human beings, specialized hairs such as eye lashes and hairs inside the nostrils and external ears afford some protection from the environment. Eyebrows prevent sweat from getting into the eyes.
Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q8
1 · Guesser asks

Is this thing an anatomical part of an animal's body (such as a bone, tooth, organ, or skin) rather than a substance produced or secreted by an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing an anatomical part of an animal's body (such as a bone, tooth, organ, or skin) rather than a substance produced or secreted by an animal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The e-Anatomy reference states that “The eyebrows consist of thickened integument,” connected beneath with the orbicularis oculi, corrugator, and frontalis muscles.

Open imaios.com
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is this body part a hard or rigid skeletal/integumentary structure (such as a bone, tooth, horn, shell, claw, or feather) as opposed to soft internal tissue or organ?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part a hard or rigid skeletal/integumentary structure (such as a bone, tooth, horn, shell, claw, or feather) as opposed to soft internal tissue or organ?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Eyebrows (supercilia) are two arched eminences of integument ... and support numerous short, thick hairs ... The eyebrows consist of thickened integument, connected beneath with the Orbicularis oculi, Corrugator, and Frontalis muscles.

Open imaios.com
2 · Answer check returns No
Q10
1 · Guesser asks

Is this body part an internal organ (such as the heart, brain, liver, or stomach)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part an internal organ (such as the heart, brain, liver, or stomach)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q11
1 · Guesser asks

Is this body part located on the exterior surface of an animal (such as skin, an external sense organ, or an appendage)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part located on the exterior surface of an animal (such as skin, an external sense organ, or an appendage)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03
The eyebrow is an area of thick, short hairs above the eye. The eyebrows, eyelids, eyelashes, lacrimal gland and drainage apparatus all play a crucial role with regard to globe protection.
Open en.wikipedia.org
2 · Answer check returns Yes
Q12
1 · Guesser asks

Is this body part located on or part of the head or face of an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part located on or part of the head or face of an animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q13
1 · Guesser asks

Is this body part primarily a sensory organ or directly associated with one of the senses (such as the eye, ear, nose, or tongue)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part primarily a sensory organ or directly associated with one of the senses (such as the eye, ear, nose, or tongue)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Eyebrows act as a barrier, diverting moisture away from the eyes toward the sides of the face through their shape and the direction of their hairs and capturing small particles before they reach the eye. Moreover, eyebrows can shield the eyes from the glare of the sun.

Open britannica.com
Source 02

Source summary (model-reported)

The main function of the eyebrows is to prevent moisture, mostly salty sweat and rain, from flowing into the eye, an organ critical to sight. Together with the eyebrows, the brow ridges also shade the eyes from sunlight.

Open wikidoc.org
2 · Answer check returns Yes
Q14
1 · Guesser asks

Is this sensory organ primarily responsible for the sense of vision (such as the eye or a component of the eye)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this sensory organ primarily responsible for the sense of vision (such as the eye or a component of the eye)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The American Academy of Ophthalmology describes eyebrows as curved hairs above the eyes that help channel sweat and rain away, block light, and filter dust and dirt; these functions help keep vision clear but do not make the eyebrow the organ primarily responsible for vision.

Open aao.org
2 · Answer check returns No
Q15
1 · Guesser asks

Is this body part primarily associated with the sense of hearing (such as the ear or external ear)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part primarily associated with the sense of hearing (such as the ear or external ear)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Eyebrows act as a barrier, diverting moisture away from the eyes toward the sides of the face ... and capturing small particles before they reach the eye. Eyebrows can also shield the eyes from glare and help convey emotions through facial expressions.

Open britannica.com
2 · Answer check returns No
Q16
1 · Guesser asks

Is this body part primarily associated with the sense of smell (such as the nose or snout)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part primarily associated with the sense of smell (such as the nose or snout)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Eyebrows act as a barrier, diverting moisture away from the eyes toward the sides of the face ... and capturing small particles before they reach the eye. Moreover, eyebrows can shield the eyes from the glare of the sun ... Beyond their protective function, eyebrows are also great for nonverbal communication.

Open britannica.com
Source 02

Source summary (model-reported)

The eyebrow is an area of thick, short hairs above the eye. The main function is to prevent sweat, water, and other debris falling into the eye, but they are also important to human communication and facial expressions.

Open en.wikipedia.org
2 · Answer check returns No
Q17
1 · Guesser asks

Is this body part primarily associated with the sense of taste (such as the tongue or taste buds)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part primarily associated with the sense of taste (such as the tongue or taste buds)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Eyebrows act as a barrier, diverting moisture away from the eyes toward the sides of the face through their shape and the direction of their hairs and capturing small particles before they reach the eye. Moreover, eyebrows can shield the eyes from the glare of the sun... Eyebrows are also... important for nonverbal communication.

Open britannica.com
Source 02

Source summary (model-reported)

The main function of the eyebrows is to prevent moisture, mostly salty sweat and rain, from flowing into the eye... Eyebrows also prevent debris... and have an important facilitative function in communication, strengthening expressions like surprise or anger.

Open wikidoc.org
2 · Answer check returns No
Q18
1 · Guesser asks

Is this body part found on mammals?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part found on mammals?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source defines an eyebrow as an area of short hairs above each eye that follows the shape of the lower margin of the brow ridges of some mammals. It also identifies the human eyebrow as serving communication and protective functions.

Open kiwi.itspektar.net
2 · Answer check returns Yes
Q19
1 · Guesser asks

Is this body part a whisker (or vibrissa) used for tactile sensing?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part a whisker (or vibrissa) used for tactile sensing?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

This review describes vibrissae as long tactile facial hairs used by rodents to locate and discriminate objects. It discusses vibrissa sensory neurons and their responses to whisking movement and touch.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

Britannica describes human eyebrows as barriers that divert moisture and capture small particles, and also notes their role in shielding the eyes and communicating emotion through facial expressions.

Open britannica.com
2 · Answer check returns No
Q20
1 · Guesser asks

Is this body part present in normal human anatomy?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part present in normal human anatomy?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The male eyebrow sits along the supraorbital ridge. The study examined eyebrow anatomy in human patients and measured the eyebrow's position relative to the eye and supraorbital rim.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q21
1 · Guesser asks

Is this body part the lip (or lips) of the mouth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part the lip (or lips) of the mouth?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q22
1 · Guesser asks

Is this body part the skin (or a specific layer or component of skin)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part the skin (or a specific layer or component of skin)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The source describes the eyebrows as “arched eminences of integument” that support numerous short, thick hairs, and says they are connected beneath with several muscles.

Open imaios.com
2 · Answer check returns No
Q23
1 · Guesser asks

Is this body part hair or composed of hair (such as eyelashes, eyebrows, or facial hair)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part hair or composed of hair (such as eyelashes, eyebrows, or facial hair)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q24
1 · Guesser asks

Is this body part located on the edges of the eyelids (i.e., eyelashes)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this body part located on the edges of the eyelids (i.e., eyelashes)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Eyelashes are a group of hairs that grow around the edge of the eyelid... The area of curved, delicate hairs above our eyes are believed to channel unwanted moisture... away from the eye.
Open aao.org
2 · Answer check returns No
G
1 · Guesser guessesNot counted

eyebrow

the strip of hair growing on the ridge above a person's eye socket

Validator rationale The proposal identifies the general anatomical eyebrow, including its location and hair-bearing ridge, and does not substitute an isolated hair, eye, cosmetic, or imitation.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"the strip of hair growing on the ridge above a person's eye socket","name":"eyebrow","question":null}}
2 · Validator returns Yes