Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Eyebrow in 32 counted questions.

Back to all Eyebrow rounds
Questions
32
Outcome
Solved
Format errors
No errors
Duration
7m 4s
Round cost
$0.1540 All 33 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the subject a living thing?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a living thing?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The eyebrow is defined as the ridge over the eye or the hair growing usually in a line or arch on the skin over it; the medical definition likewise describes it as the ridge over the eye or hair growing on it.

Open merriam-webster.com
2 · Answer check returns No
Q2
1 · Guesser asks

Is the subject a human-made object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a human-made object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Is the subject a celestial body, such as a star, planet, or moon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a celestial body, such as a star, planet, or moon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source defines an eyebrow as an area of short terminal hairs above each eye and identifies its human functions, including protecting the eye.

Open en.wikipedia.org
2 · Answer check returns No
Q4
1 · Guesser asks

Is the subject a geographical feature on Earth, such as a mountain, river, or ocean?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a geographical feature on Earth, such as a mountain, river, or ocean?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q5
1 · Guesser asks

Is the subject a natural phenomenon, such as weather, lightning, or an earthquake?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a natural phenomenon, such as weather, lightning, or an earthquake?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Is the subject an abstract concept, such as an idea, emotion, or mathematical notion?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an abstract concept, such as an idea, emotion, or mathematical notion?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Is the subject a substance or material, such as a chemical element or compound?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a substance or material, such as a chemical element or compound?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q8
1 · Guesser asks

Is the subject a part or product of a living organism, such as bone, shell, feather, or tooth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a part or product of a living organism, such as bone, shell, feather, or tooth?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The Eyebrows (supercilia) are two arched eminences of integument, which surmount the upper circumference of the orbits, and support numerous short, thick hairs.
Open imaios.com
Source 02

Source summary (model-reported)

The eyebrow hairs are the arch of terminal hair located on the brow—the soft tissue overlying the bony supraorbital ridge. The anatomical hierarchy places them under Human body > Integument > Skin appendages > Hairs.

Open imaios.com
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is the subject a part of a human body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a part of a human body?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q10
1 · Guesser asks

Is the subject a bone in the human body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a bone in the human body?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The arched strip of hairs (supercilia) on the brow ridge (supercilium) above each eye socket. The eyebrow is an area of thick, delicate hairs above the eye that follows the shape of the lower margin of the brow ridges. Semantic Type(s): Anatomical Structure.

Open evsexplore.semantics.cancer.gov
Source 03

Source summary (model-reported)

At the junction of the forehead and the upper eyelid, the eyebrow is a transverse elevation of hair arched above the superior orbital rim. Technically, the eyebrow is considered part of the scalp.

Open entokey.com
2 · Answer check returns No
Q11
1 · Guesser asks

Is the subject an internal organ of the human body, such as the heart, liver, or lung?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an internal organ of the human body, such as the heart, liver, or lung?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source describes eyebrow hair as serving biologic and aesthetic functions, with eyebrow hair follicles sharing the basic structure of hair follicles elsewhere on the body.

Open jddonline.com
2 · Answer check returns No
Q12
1 · Guesser asks

Is the subject a tooth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a tooth?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is the subject visible on the outside of the human body, such as skin, hair, nails, or the eye?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject visible on the outside of the human body, such as skin, hair, nails, or the eye?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The area of curved, delicate hairs above our eyes are believed to channel unwanted moisture—sweat and rain in particular—away from the eye to help keep vision clear.
Open aao.org
Source 02

Source summary (model-reported)

Eyebrow hair direction serves to protect the eyes from particulate matter and sweat. The source also discusses eyebrows as a facial feature and their role in human interactions.

Open ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q14
1 · Guesser asks

Is the subject made of keratin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject made of keratin?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Hair consists mainly of keratin, a fibrous structural protein. The hair shaft comprises a pigmented, horny, fibrous material made of impacted fibrillar cells. Hair also appears on the eyelids as eyelashes and eyebrows.

Open britannica.com
Source 03

Source summary (model-reported)

The eyebrow is a transverse elevation of hair. The skin of the eyebrow contains abundant sweat and sebaceous glands, and the skin is also found thick and mobile in this region.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Rather yes
Q15
1 · Guesser asks

Is the subject hair, such as hair on the head or body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject hair, such as hair on the head or body?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Cambridge Dictionary defines eyebrow as “the line of short hairs above each eye.” This identifies the eyebrow as a line or grouping of hairs, rather than as one hair itself.

Open dictionary.cambridge.org
2 · Answer check returns No
Q16
1 · Guesser asks

Is the subject a nail, such as a fingernail or toenail?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a nail, such as a fingernail or toenail?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The article describes eyebrow hair, stating that eyebrow hair follicles share the same basic structure as hair follicles elsewhere on the body and have a shorter growth phase.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns No
Q17
1 · Guesser asks

Is the subject skin, or a part of the skin such as the epidermis?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject skin, or a part of the skin such as the epidermis?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Eyebrow hairs are the arch of terminal hair located on the brow—the soft tissue overlying the bony supraorbital ridge. The page places eyebrows under the integument, skin, and hairs sections of its anatomical classification.

Open imaios.com
Source 03

Source summary (model-reported)

Hair is described as an accessory structure of the skin. Hair follicles originate in the epidermis, while the hair shaft is exposed at the skin’s surface and is primarily made of dead, keratinized cells.

Open openstax.org
2 · Answer check returns Unknown
Q18
1 · Guesser asks

Is the subject a thickened patch of hardened skin, such as a callus or corn?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a thickened patch of hardened skin, such as a callus or corn?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Is the subject a bodily fluid, such as blood, saliva, sweat, or tears?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a bodily fluid, such as blood, saliva, sweat, or tears?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q20
1 · Guesser asks

Is the subject a sense organ, such as the eye, ear, nose, or tongue?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a sense organ, such as the eye, ear, nose, or tongue?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

An eyebrow is an area of short terminal hairs above each eye. In humans, eyebrows serve functions including prevention of sweat, water, and other debris from falling into the eye socket.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

Sense organs are described as the eyes, ears, nose, mouth, and skin, each having its own particular type of receptors. Each sense organ reacts to a particular type of stimulus.

Open encyclopedia.com
2 · Answer check returns No
Q21
1 · Guesser asks

Is the subject a part of an animal, such as a horn, hoof, claw, or beak?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a part of an animal, such as a horn, hoof, claw, or beak?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The NIH Human Malformation Terminology defines the eyebrow as “the arch of hair on the brow” and also describes the soft tissue at the junction of facial muscles overlying the bony supraorbital ridge. It identifies medial, middle, and lateral parts of the eyebrow.

Open elementsofmorphology.nih.gov
Source 02

Source summary (model-reported)

A PubMed record for “The anatomy of eyebrow ptosis” describes research on the normal anatomy of the human eyebrow, including its relation to the supraorbital ridge, and lists “Eyebrows / anatomy & histology” with Humans as a subject category.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q22
1 · Guesser asks

Is the subject an internal soft tissue of the body, such as muscle, tendon, ligament, or cartilage?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an internal soft tissue of the body, such as muscle, tendon, ligament, or cartilage?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The article describes eyebrow hair and explains that eyebrow hair follicles share the same basic structure as hair follicles elsewhere on the body, with a shorter growing phase.

Open pubmed.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

The source identifies muscles such as the depressor supercilii, corrugator supercilii, and occipitofrontalis as muscles that move or affect the eyebrows, distinguishing those muscles from the eyebrow feature itself.

Open ncbi.nlm.nih.gov
2 · Answer check returns No
Q23
1 · Guesser asks

Is the subject a horn, such as those of cattle, goats, or rhinoceroses?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a horn, such as those of cattle, goats, or rhinoceroses?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

A horn is one of the hard pointed parts that grows on the head of some animals (such as cattle, goats, or sheep), or a hard pointed part that grows on the nose of a rhinoceros.

Open britannica.com
2 · Answer check returns No
Q24
1 · Guesser asks

Is the subject an animal product made mainly of calcium carbonate, such as a shell or pearl?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an animal product made mainly of calcium carbonate, such as a shell or pearl?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q25
1 · Guesser asks

Is the subject a part of a bird, such as a feather, beak, or claw?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a part of a bird, such as a feather, beak, or claw?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Some bird species have what is technically called a supercilium. This is a stripe which starts close to the back end of the bill, runs just above the eye, and ends towards the back of the head. It can be thought of as an “eyebrow”. It is often white, or whitish; usually, the feathers of the supercilium are a paler colour than the feathers above and below it.
Open thebdi.org
2 · Answer check returns No
Q26
1 · Guesser asks

Is the subject the fur, wool, or hide of an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject the fur, wool, or hide of an animal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source defines an eyebrow as an area of short terminal hairs above each eye and describes its functions in humans, including protecting the eye and contributing to facial expression.

Open en.wikipedia.org
2 · Answer check returns No
Q27
1 · Guesser asks

Is the subject a claw, hoof, or scale of an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a claw, hoof, or scale of an animal?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The Eyebrows (supercilia) are two arched eminences of integument, which surmount the upper circumference of the orbits, and support numerous short ... Human anatomy ... Eyebrow.
Open imaios.com
2 · Answer check returns No
Q28
1 · Guesser asks

Is the subject located on the head or face?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject located on the head or face?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q29
1 · Guesser asks

Is the subject a part of the mouth, such as the lips, tongue, or gums?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a part of the mouth, such as the lips, tongue, or gums?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q30
1 · Guesser asks

Is the subject an eyelid, eyelash, or eyebrow?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an eyelid, eyelash, or eyebrow?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q31
1 · Guesser asks

Is the subject an eyelash?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an eyelash?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The anatomy of the eyelash differs from hair elsewhere in the body in many respects. Eyelashes and eyebrows are important anatomical structures... Eyebrow hair direction serves to protect the eyes from particulate matter and sweat.
Open ncbi.nlm.nih.gov
2 · Answer check returns No
Q32
1 · Guesser asks

Is the subject an eyebrow?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an eyebrow?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Eyebrow

The arch of hair above each eye on the human face.

Validator rationale The proposal identifies the human eyebrow as the anatomical feature above the eye, not an isolated hair or a cosmetic/drawn imitation.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"The arch of hair above each eye on the human face.","name":"Eyebrow","question":null}}
2 · Validator returns Yes