Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Did not identify Eyebrow after 40 counted questions.

Back to all Eyebrow rounds
Questions
40 Scored as 41
Outcome
Too many format errors
Format errors
No errors
Duration
7m 59s
Round cost
$0.1982 All 41 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

3 of 38 answers in this round reuse an earlier, fully checked answer with its original evidence. No new search or check ran for those turns.

Q1
1 · Guesser asks

Is this thing found in nature?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing found in nature?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica identifies the eyebrow as an anatomical feature and states that eyebrows act as a barrier, diverting moisture away from the eyes and capturing small particles.

Open britannica.com
2 · Answer check returns Yes
Q2
1 · Guesser asks

Is it an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it an animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The Eyebrows (supercilia) are two arched eminences of integument ... and support numerous short, thick hairs ... The eyebrows consist of thickened integument.
Open imaios.com
2 · Answer check returns No
Q3
1 · Guesser asks

Is it a plant?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a plant?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q4
1 · Guesser asks

Is it a natural non-living thing (like a rock, mineral, or natural phenomenon)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a natural non-living thing (like a rock, mineral, or natural phenomenon)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Eyebrow hair serves many important biologic and aesthetic functions. This article reviews the structure and function of the hair follicle, as well as hair follicle morphogenesis and cycling. Eyebrow hair follicles share the same basic structure as hair follicles elsewhere on the body.
Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns No
Q5
1 · Guesser asks

Is it found in outer space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it found in outer space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

NASA describes astronauts living in space aboard the International Space Station and studying changes to crew members' eyes and eye structure.

Open nasa.gov
2 · Answer check returns Yes
Q6
1 · Guesser asks

Is it a planet?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a planet?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q7
1 · Guesser asks

Is it a star?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a star?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q8
1 · Guesser asks

Is it a moon (natural satellite)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a moon (natural satellite)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q9
1 · Guesser asks

Is it larger than Earth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it larger than Earth?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q10
1 · Guesser asks

Is it smaller than Earth's moon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it smaller than Earth's moon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q11
1 · Guesser asks

Is it a man-made object in space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a man-made object in space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Wikidata entry classifies eyebrow as a class of anatomical entity, facial feature, human facial hair, and a set of facial hairs.

Open wikidata.org
2 · Answer check returns No
Q12
1 · Guesser asks

Is it an asteroid?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it an asteroid?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q13
1 · Guesser asks

Is it smaller than 1 meter?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it smaller than 1 meter?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Statistical analysis showed high interrater reliability for all three types of measurements. The mean width of the eyebrow was found to be 47.28 ± 4.55 mm. Methods: Semiautomatic photogrammetric analysis of 300 professional White male models ... a set of linear, angular, and surface area morphometric parameters of the periorbital region was measured.

Open ingentaconnect.com
Source 02

Source summary (model-reported)

We measured the eyebrow height, upper eyelid crease height, and amount of visible pretarsal skin of 143 white subjects who had no facial abnormalities. Within the 41- to 60-year age group, the average eyebrow height was 6.4 mm (1.8 mm).

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q14
1 · Guesser asks

Is it larger than 1 millimeter?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it larger than 1 millimeter?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Statistical analysis showed high interrater reliability for all three types of measurements. The mean width of the eyebrow was found to be 47.28 ± 4.55 mm.

Open ingentaconnect.com
2 · Answer check returns Yes
Q15
1 · Guesser asks

Does it originate from outside our solar system?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it originate from outside our solar system?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The human eyebrow, with its contrasting hair, accentuates the movement of the brow ... humans have little facial hair coverage, which makes the strip of hair on the brow ridge remarkable.

Open carta.anthropogeny.org
Source 03
Development of the epidermis includes the formation of the epidermal appendages such as hair follicles. During development, cells of the basal epidermal layer form buds ... ultimately forming the hair follicle appendages.
Open tandfonline.com
2 · Answer check returns No
Q16
1 · Guesser asks

Is it a grain of sand?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a grain of sand?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Mindat defines a grain as “A mineral or rock particle having a diameter of less than a few millimeters,” giving a sand grain as an example.

Open mindat.org
2 · Answer check returns No
Q17
1 · Guesser asks

Is it a meteorite?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a meteorite?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica defines a meteorite as a meteoroid, a small natural object from interplanetary space, that survives passage through Earth's atmosphere and lands on the surface.

Open britannica.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is it a rock (mineral) found in space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a rock (mineral) found in space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Is it a natural non-living thing found in space, such as dust, gas, or plasma?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a natural non-living thing found in space, such as dust, gas, or plasma?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q20
1 · Guesser asks

Is it larger than 10 micrometers?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it larger than 10 micrometers?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Statistical analysis showed high interrater reliability for all three types of measurements. The mean width of the eyebrow was found to be 47.28 ± 4.55 mm. The study concerns white professional models and was published in Plastic and Reconstructive Surgery, Volume 152, Number 2, in 2023.

Open ingentaconnect.com
2 · Answer check returns Yes
Q21
1 · Guesser asks

Is it larger than 100 micrometers?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it larger than 100 micrometers?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q22
1 · Guesser asks

Is it commonly referred to as space dust?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it commonly referred to as space dust?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The page states that cosmic dust is also called extraterrestrial dust, space dust, or star dust, and describes it as dust occurring in outer space or having fallen onto Earth.

Open en.wikipedia.org
2 · Answer check returns No
Q23
1 · Guesser asks

Does it have a well-known scientific name or classification?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Does it have a well-known scientific name or classification?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q24
1 · Guesser asks

Is it associated with a specific astronomical phenomenon or object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it associated with a specific astronomical phenomenon or object?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The page defines an eyebrow as “the stripe of hair about 2 cm over the eye” and describes biological functions including protecting the eyes from water and sunlight.

Open simple.wikipedia.org
Source 02

Source summary (model-reported)

Dictionary definitions describe the eyebrow as “the arch of short hairs covering” the eye or “a fringe of hairs growing on the brow of the eye.”

Open wordnik.com
Source 03

Source summary (model-reported)

NASA describes NGC 6826 as an “Eye-Shaped Planetary Nebula,” an astronomical object whose appearance resembles an eye; the page does not identify a human eyebrow as part of or associated with it.

Open science.nasa.gov
2 · Answer check returns No
Q25
1 · Guesser guesses

interplanetary dust particle

A small particle of dust in the inner solar system

Validator rationale The proposal identifies an interplanetary dust particle, which is unrelated to the target human eyebrow body feature.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A small particle of dust in the inner solar system","name":"interplanetary dust particle","question":null}}
2 · Validator returns No
Q26
1 · Guesser asks

Is this thing visible to the naked eye from Earth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing visible to the naked eye from Earth?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q27
1 · Guesser asks

Is it a specific, named celestial object or phenomenon visible from Earth without a telescope?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a specific, named celestial object or phenomenon visible from Earth without a telescope?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q28
1 · Guesser asks

Is it something humans have intentionally sent into space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it something humans have intentionally sent into space?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

NASA reports that astronaut Koichi Wakata demonstrated washing his hair on the International Space Station on February 5, 2023.

Open nasa.gov
Source 02

Source summary (model-reported)

NASA reports that cosmonaut Alexander Misurkin had his hair trimmed aboard the International Space Station, and that the freshly cut hair was collected with a vacuum device.

Open nasa.gov
Source 03

Source summary (model-reported)

A study examined hair samples from astronauts during spaceflight; the samples consisted of five hair strands from each astronaut and were used for hair-follicle gene-expression analysis.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Rather no
Q29
1 · Guesser asks

Is it something formed by humans in space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it something formed by humans in space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q30
1 · Guesser asks

Is it smaller than a typical meteorite?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it smaller than a typical meteorite?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Unknown
Q31
1 · Guesser asks

Is it a particle of cosmic dust smaller than 100 micrometers?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a particle of cosmic dust smaller than 100 micrometers?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The eyebrows (supercilia) are two arched eminences of integument, which surmount the upper circumference of the orbits, and support numerous short, thick hairs.
Open imaios.com
2 · Answer check returns No
Q32
1 · Guesser guesses

cosmic dust particle

Interstellar dust particle larger than 100 micrometers

Validator rationale The proposal identifies an interstellar dust particle, which is unrelated to the target human eyebrow anatomical feature.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Interstellar dust particle larger than 100 micrometers","name":"cosmic dust particle","question":null}}
2 · Validator returns No
Q33
1 · Guesser asks

Is it a meteoroid (a natural object in space smaller than an asteroid)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a meteoroid (a natural object in space smaller than an asteroid)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
The International Astronomical Union defines a meteoroid as "a solid natural object of a size roughly between 30 micrometers and 1 meter moving in, or coming from, interplanetary space."
Open iau.org
2 · Answer check returns No
Q34
1 · Guesser asks

Is it a type of electromagnetic radiation?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a type of electromagnetic radiation?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Electromagnetic radiation ... [is] the flow of energy ... in the form of the electric and magnetic fields that make up electromagnetic waves such as radio waves, visible light, and gamma rays.

Open britannica.com
2 · Answer check returns No
Q35
1 · Guesser asks

Is it a particle smaller than 1 mm found in space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a particle smaller than 1 mm found in space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q36
1 · Guesser asks

Is it a specific named object or phenomenon, rather than a general category?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a specific named object or phenomenon, rather than a general category?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica Dictionary defines eyebrow as “the line of hair that grows over your eye” and presents it as a count noun with the plural form “eyebrows.”

Open britannica.com
2 · Answer check returns No
Q37
1 · Guesser asks

Is this thing found in outer space?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is this thing found in outer space?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

NASA describes JAXA astronaut Koichi Wakata taking a self-portrait during a six-hour-and-41-minute spacewalk outside the International Space Station.

Open nasa.gov
Source 02

Source summary (model-reported)

NASA reports that astronauts live in space and describes crew members' eyes and eye structures while they are aboard the International Space Station.

Open nasa.gov
2 · Answer check returns Yes
Q38
1 · Guesser asks

Can it be seen from Earth without any equipment?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Can it be seen from Earth without any equipment?"}}
Oracle evidence1 model-reported source

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q39
1 · Guesser asks

Is it a specific celestial object or phenomenon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a specific celestial object or phenomenon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q40
1 · Guesser asks

Is it a specific named object or phenomenon, rather than a general category?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a specific named object or phenomenon, rather than a general category?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica Dictionary defines eyebrow as “the line of hair that grows over your eye” and presents it as a count noun with the plural form “eyebrows.”

Open britannica.com
2 · Answer check returns No