Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Eyebrow in 26 counted questions.

Back to all Eyebrow rounds
Questions
26
Outcome
Solved
Format errors
No errors
Duration
6m 17s
Round cost
$0.1422 All 27 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the hidden subject a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the hidden subject a living organism?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q2
1 · Guesser asks

Is it primarily a human-made object or material, rather than a naturally occurring entity?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily a human-made object or material, rather than a naturally occurring entity?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The American Academy of Ophthalmology states that as humans evolved, body hair and facial hair diminished, but eyebrows and eyelashes remained part of human features. It also notes that people may wax, tweeze, or dye eyebrows.

Open aao.org
2 · Answer check returns No
Q3
1 · Guesser asks

Is the subject a tangible physical entity, rather than an abstract concept or phenomenon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a tangible physical entity, rather than an abstract concept or phenomenon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q4
1 · Guesser asks

Is it a naturally occurring substance or material, rather than a distinct natural object or geographical feature?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a naturally occurring substance or material, rather than a distinct natural object or geographical feature?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The Eyebrows (supercilia) are two arched eminences of integument, which surmount the upper circumference of the orbits, and support numerous short, thick hairs.
Open imaios.com
2 · Answer check returns No
Q5
1 · Guesser asks

Is it a natural geographical or geological feature on Earth, such as a mountain, river, cave, or island?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a natural geographical or geological feature on Earth, such as a mountain, river, cave, or island?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Is the subject an astronomical object or body, such as a star, planet, moon, or asteroid?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an astronomical object or body, such as a star, planet, moon, or asteroid?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Is it a part or product of a living organism, such as a body part, shell, bone, or seed?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a part or product of a living organism, such as a body part, shell, bone, or seed?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The page identifies the eyebrow among the accessory visual structures, or ocular adnexa, which are protecting and supporting structures of the eye.

Open en.wikipedia.org
2 · Answer check returns Yes
Q8
1 · Guesser asks

Is it a part or product of an animal, rather than of a plant or fungus?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a part or product of an animal, rather than of a plant or fungus?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Center for Academic Research and Training in Anthropogeny describes “The human eyebrow” as a strip of hair on the brow ridge and discusses human eyebrows in comparison with those of other primates.

Open carta.anthropogeny.org
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is it part of the animal’s skeleton, such as a bone, tooth, or shell?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it part of the animal’s skeleton, such as a bone, tooth, or shell?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q10
1 · Guesser asks

Is it an external covering or appendage of an animal, such as skin, fur, feathers, scales, or a claw?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it an external covering or appendage of an animal, such as skin, fur, feathers, scales, or a claw?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The entry defines eyebrows as “the curved areas of hair on your face above each of your eyes” and classifies hair as “a covering for the body (or parts of it) consisting of a dense growth of threadlike structures.”

Open vocabulary.com
2 · Answer check returns Yes
Q11
1 · Guesser asks

Is it made primarily of keratin, as feathers, fur, scales, claws, and nails are?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made primarily of keratin, as feathers, fur, scales, claws, and nails are?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Eyebrows (supercilia) are two arched eminences of integument ... and support numerous short, thick hairs ... The eyebrows consist of thickened integument, connected beneath with the Orbicularis oculi, Corrugator, and Frontalis muscles.

Open imaios.com
2 · Answer check returns Unknown
Q12
1 · Guesser asks

Is the subject specifically associated with birds, such as a feather or wing?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject specifically associated with birds, such as a feather or wing?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is it specifically associated with mammals, such as hair, fur, or a claw?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it specifically associated with mammals, such as hair, fur, or a claw?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Other animals, including well documented cases of both old and new world monkeys and other mammals, have been observed to manipulate their brows as part of their communicative displays. The human eyebrow, with its contrasting hair, accentuates the movement of the brow.
Open carta.anthropogeny.org
2 · Answer check returns Yes
Q14
1 · Guesser asks

Is it primarily a covering of a mammal’s body, such as hair, fur, or skin, rather than a projection or appendage like a claw or hoof?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily a covering of a mammal’s body, such as hair, fur, or skin, rather than a projection or appendage like a claw or hoof?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q15
1 · Guesser asks

Is the covering composed of many individual strands or filaments, rather than being a continuous sheet of tissue?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the covering composed of many individual strands or filaments, rather than being a continuous sheet of tissue?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The article reviews the structure and function of eyebrow hair and describes eyebrow hair follicles as sharing the same basic structure as hair follicles elsewhere on the body.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q16
1 · Guesser asks

Does the term usually refer to a mammal’s dense overall coat, rather than to individual strands growing from its skin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does the term usually refer to a mammal’s dense overall coat, rather than to individual strands growing from its skin?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q17
1 · Guesser asks

Does it usually refer to individual strands that grow from a mammal’s skin, rather than a specialized group such as whiskers, a mane, or wool?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it usually refer to individual strands that grow from a mammal’s skin, rather than a specialized group such as whiskers, a mane, or wool?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q18
1 · Guesser asks

Is it a group of specialized sensory hairs on an animal’s face, commonly called whiskers?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a group of specialized sensory hairs on an animal’s face, commonly called whiskers?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Is it a localized growth of longer or coarser hair on a mammal, rather than the animal’s general body covering?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a localized growth of longer or coarser hair on a mammal, rather than the animal’s general body covering?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The eyebrows consist of serial arched rows (5–7 rows) of hair growing along the superior orbital margin. The eyebrows hair are short, thin but stiff, nonpliable with a slight curve along the body, and tapering toward the end.

Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

Terminal hair is the thick, coarse hair that grows on your scalp and makes up your eyelashes and eyebrows. ... Your eyebrow and eyelash hairs have a shorter growth phase, so they can’t grow as long.

Open my.clevelandclinic.org
2 · Answer check returns Yes
Q20
1 · Guesser asks

Is this localized hair growth primarily found along an animal’s neck or head, as a mane is?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this localized hair growth primarily found along an animal’s neck or head, as a mane is?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q21
1 · Guesser guesses

mane

A localized growth of long, coarse hair around the neck or head of an animal, especially a lion or horse.

Validator rationale A mane is a distinct animal hair feature around the neck or head, not the human eyebrow above the eye.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A localized growth of long, coarse hair around the neck or head of an animal, especially a lion or horse.","name":"mane","question":null}}
2 · Validator returns No
Q22
1 · Guesser asks

Is the localized hair growth found on the face or chin of a mammal, rather than along its neck or back?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the localized hair growth found on the face or chin of a mammal, rather than along its neck or back?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q23
1 · Guesser asks

Is it specifically the hair growth on a human’s chin and lower cheeks, commonly called a beard?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it specifically the hair growth on a human’s chin and lower cheeks, commonly called a beard?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q24
1 · Guesser asks

Is the hair growth concentrated beneath the chin or around the mouth, rather than on the upper lip or cheeks?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the hair growth concentrated beneath the chin or around the mouth, rather than on the upper lip or cheeks?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q25
1 · Guesser asks

Is the hair growth concentrated on the upper lip, as a mustache or moustache is?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the hair growth concentrated on the upper lip, as a mustache or moustache is?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q26
1 · Guesser asks

Is the hair growth located above the eyes, like eyebrows, rather than on the cheeks or chin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the hair growth located above the eyes, like eyebrows, rather than on the cheeks or chin?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

eyebrow

A strip or cluster of hairs above the eye, typically helping protect the eye and convey expression.

Validator rationale The proposal identifies the human eyebrow as the anatomical feature of hairs above the eye and does not substitute an isolated hair, eye, cosmetic product, or imitation.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A strip or cluster of hairs above the eye, typically helping protect the eye and convey expression.","name":"eyebrow","question":null}}
2 · Validator returns Yes