Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 2

Round 2

Identified Eyebrow in 23 counted questions.

Back to all Eyebrow rounds
Questions
23
Outcome
Solved
Format errors
No errors
Duration
5m 38s
Round cost
$0.1310 All 24 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"BKXG3AZI"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is it a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a living organism?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The eyebrow is an area of thick, short hairs above the eye. The eyebrows are listed among the accessory visual structures that protect and support the eye.

Open en.wikipedia.org
2 · Answer check returns No
Q2
1 · Guesser asks

Is it made by humans?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made by humans?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The American Academy of Ophthalmology describes eyebrows as curved, delicate hairs above the eyes and notes that people may wax, tweeze, or dye them.

Open aao.org
2 · Answer check returns No
Q3
1 · Guesser asks

Is it a naturally occurring physical object or substance on Earth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a naturally occurring physical object or substance on Earth?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The page describes the eyebrow as “an area of thick, short hairs above the eye” and identifies eyebrows among the accessory visual structures associated with the eye.

Open en.wikipedia.org
2 · Answer check returns Yes
Q4
1 · Guesser asks

Is it a geological feature or material, such as a rock, mineral, soil, or landform?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a geological feature or material, such as a rock, mineral, soil, or landform?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q5
1 · Guesser asks

Does it occur primarily in Earth's atmosphere, weather, or water cycle?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it occur primarily in Earth's atmosphere, weather, or water cycle?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The area of curved, delicate hairs above the eyes is believed to channel unwanted moisture—sweat and rain in particular—away from the eye. Eyebrows also help block light and filter dust and dirt.

Open aao.org
Source 03

Source summary (model-reported)

The article reviews the biology, structure, and function of eyebrow hair, including its hair follicles and growth cycle. Eyebrow hair follicles share the basic structure of hair follicles elsewhere on the body.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns No
Q6
1 · Guesser asks

Is it located beyond Earth, such as a celestial object or feature of outer space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it located beyond Earth, such as a celestial object or feature of outer space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The eyebrow is described as an area of thick, short hairs above the eye and as one of the accessory visual structures that protect and support the eye.

Open en.wikipedia.org
2 · Answer check returns No
Q7
1 · Guesser asks

Is it part of, produced by, or left behind by a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it part of, produced by, or left behind by a living organism?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q8
1 · Guesser asks

Is it a physical part of an animal, such as a bone, shell, tooth, or feather?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a physical part of an animal, such as a bone, shell, tooth, or feather?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q9
1 · Guesser asks

Is it a body part of a vertebrate animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a body part of a vertebrate animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Eyebrows are an often overlooked feature of the face. ... Eyebrows act as a barrier, diverting moisture away from the eyes ... and capturing small particles before they reach the eye.

Open britannica.com
2 · Answer check returns Yes
Q10
1 · Guesser asks

Is it a hard body structure made primarily of bone or cartilage?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a hard body structure made primarily of bone or cartilage?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The hair fiber itself is rich in both type I and type II keratins. The article identifies terminal hairs in the eyebrow region and describes hair follicles and hair fibers as skin-associated structures.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q11
1 · Guesser asks

Is it normally visible on the outside of the animal's body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally visible on the outside of the animal's body?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q12
1 · Guesser asks

Is it a structure characteristically found on birds, such as a feather or beak?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a structure characteristically found on birds, such as a feather or beak?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Eyebrows (supercilia) are two arched eminences of integument, which surmount the upper circumference of the orbits, and support numerous short, thick hairs... Human anatomy... Eyebrow.

Open imaios.com
Source 02

Source summary (model-reported)

A bird's beak is basically a lightweight, bony elongation of its skull... On most birds, the keratin condenses and dries, forming the beak's hard, glossy, outer covering.

Open pubs.usgs.gov
Source 03

Source summary (model-reported)

Some bird species have what is technically called a supercilium. This is a stripe which starts close to the back end of the bill, runs just above the eye... It can be thought of as an “eyebrow”.

Open thebdi.org
2 · Answer check returns No
Q13
1 · Guesser asks

Is it characteristically found on mammals, such as hair, fur, whiskers, claws, or hooves?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it characteristically found on mammals, such as hair, fur, whiskers, claws, or hooves?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q14
1 · Guesser asks

Is it made primarily of keratin, the same structural protein found in hair, nails, claws, and hooves?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made primarily of keratin, the same structural protein found in hair, nails, claws, and hooves?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The NIH Elements of Morphology resource defines the eyebrow as “The arch of hair on the brow.” It distinguishes this from the brow, which is soft tissue overlying the bony supraorbital ridge.

Open elementsofmorphology.nih.gov
Source 02

Source summary (model-reported)

The source states that human hair consists of approximately 65–95 wt% proteins and describes human hair keratin as its characteristic protein component; it also notes smaller amounts of lipids, water, minerals, pigment, and other constituents.

Open sciencedirect.com
2 · Answer check returns Yes
Q15
1 · Guesser asks

Is it a hair or fur, rather than a claw, hoof, nail, horn, or similar structure?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a hair or fur, rather than a claw, hoof, nail, horn, or similar structure?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The biology, structure, and function of eyebrow hair. Eyebrow hair serves many important biologic and aesthetic functions. This article reviews the structure and function of the hair follicle.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q16
1 · Guesser asks

Is it a specialized tactile hair, typically found on the face of mammals?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a specialized tactile hair, typically found on the face of mammals?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source describes vibrissae as hairs specialized for sensory functions, especially on the face, and states that humans lack vibrissae. It defines a whisker or vibrissa as a large tactile hair in a mechanically isolated hair follicle.

Open sciencedirect.com
Source 02

Source summary (model-reported)

The source distinguishes specialized sinus hairs called vibrissae from human eyebrow function, stating that eyebrows prevent sweat from getting into the eyes, while specialized hairs in humans include eyelashes and hairs inside the nostrils and external ears.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

A vibrissa is defined as a stiff hair located on the face, especially around the snout, of many mammals and typically serving as a tactile organ; the entry separately identifies coarse hairs inside human nostrils.

Open merriam-webster.com
2 · Answer check returns No
Q17
1 · Guesser asks

Does it refer to an animal's overall coat or covering of many hairs, rather than to one individual hair?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it refer to an animal's overall coat or covering of many hairs, rather than to one individual hair?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q18
1 · Guesser asks

Is it hair that commonly grows on humans, such as scalp hair or body hair?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it hair that commonly grows on humans, such as scalp hair or body hair?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q19
1 · Guesser asks

Does it grow on the scalp, rather than primarily on the face, limbs, or torso?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it grow on the scalp, rather than primarily on the face, limbs, or torso?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q20
1 · Guesser asks

Does it primarily grow on the face, such as a beard or mustache?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it primarily grow on the face, such as a beard or mustache?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q21
1 · Guesser asks

Is it specifically a mustache, rather than a beard more generally?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it specifically a mustache, rather than a beard more generally?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The cited dictionary definitions describe a beard as hair growth on the chin, cheeks, throat, or jaw, distinguishing upper-lip hair as the mustache.

Open wordnik.com
2 · Answer check returns No
Q22
1 · Guesser guesses

beard

Facial hair growing on the chin and cheeks of a human.

Validator rationale The proposal identifies a beard, which is facial hair on the chin and cheeks, not the eyebrow body feature above the eye.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Facial hair growing on the chin and cheeks of a human.","name":"beard","question":null}}
2 · Validator returns No
Q23
1 · Guesser asks

Is it hair that grows above the eyes, forming an eyebrow?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it hair that grows above the eyes, forming an eyebrow?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

eyebrow

The strip of facial hair above a human eye.

Validator rationale The proposal identifies the general anatomical eyebrow, including its location and hair-based structure, and does not confuse it with an isolated hair, eye, cosmetic, or imitation.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"The strip of facial hair above a human eye.","name":"eyebrow","question":null}}
2 · Validator returns Yes