Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Spider web in 21 counted questions.

Back to all Spider web rounds
Questions
21
Outcome
Solved
Format errors
No errors
Duration
7m 23s
Round cost
$0.0872 All 22 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the target a tangible physical entity?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a tangible physical entity?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders build web structures several times their size with very few external supports, using only silk fibers. ... The scans and web models showed that ... [the spider] built most of the web structure...

Open pnas.org
Source 02
Spiders make their webs from silk, a natural fibre made of protein. ... Spiders then follow various patterns of activity to construct their webs...
Open nhm.ac.uk
Source 03
Different groups of spiders build different types of webs, depending on the type of prey they capture and the location of the web. ... It takes an orb weaver about 30 to 45 minutes to make its orb web.
Open australian.museum
2 · Answer check returns Yes
Q2
1 · Guesser asks

Is the target human-made?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target human-made?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
Spider webs are made from silk. ... Insects and spiders make silk in a special part of their body called a gland, and use their legs to pull it out of their bodies. This is called spinning.
Open imb.uq.edu.au
2 · Answer check returns No
Q3
1 · Guesser asks

Is the target a living organism (or part of one)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a living organism (or part of one)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A spider web is defined as “a structure made by a spider out of silk to catch its prey.” The source also states that spiders produce the silk from spinneret glands and use it in web construction.

Open gystc.org
Source 02

Source summary (model-reported)

Britannica describes spiders constructing webs, repairing damaged areas, and, for some species, abandoning or eating the web before constructing a new one.

Open britannica.com
2 · Answer check returns No
Q4
1 · Guesser asks

Is the target a celestial body or astronomical object (e.g., a planet, star, moon, asteroid)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a celestial body or astronomical object (e.g., a planet, star, moon, asteroid)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Webs are combinations of many kinds of spider silk all able to be produced by the same spider. The web radials are strong, but the somewhat weaker circumferential ... fibers are elastic and sticky—to absorb the energy of a flying insect and hold it in place.

Open irfi.org
Source 02

Source summary (model-reported)

The spider had spun a web inside his telescope tube. ... spider silk ... led him to devise the first astronomical micrometer. ... spider silk was used for the cross-hairs of astronomical instruments.

Open amerisurv.com
2 · Answer check returns No
Q5
1 · Guesser asks

Is the target a geological feature or landform (e.g., mountain, canyon, cave, volcano)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a geological feature or landform (e.g., mountain, canyon, cave, volcano)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q6
1 · Guesser asks

Is the target typically small enough to be held in a person's hand (i.e., hand-sized or smaller)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically small enough to be held in a person's hand (i.e., hand-sized or smaller)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spider webs range from very small (a few centimeters) to extremely large (a meter or wider). The largest webs are found in the rainforests of Madagascar ... and span up to 90 feet.

Open frontiersin.org
2 · Answer check returns Unknown
Q7
1 · Guesser asks

Is the target a mineral or mineral-like natural substance (e.g., a rock, crystal, gemstone, or sand)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a mineral or mineral-like natural substance (e.g., a rock, crystal, gemstone, or sand)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders build web structures several times their size with very few external supports, using only silk fibers. ... The spider’s construction method consists of prioritizing a fast build of the structure followed by slow structural reinforcement while using only silk as material.

Open pnas.org
Source 02
A web is a structure, not a substance. Spider silk refers to the material that spiders produce to make webs. The web is the architecture built from it, much as steel is a material and a bridge is a structure.
Open theconversation.com
2 · Answer check returns No
Q8
1 · Guesser asks

Is the target a body of water or a water-related natural feature (e.g., ocean, river, lake, waterfall, ice)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a body of water or a water-related natural feature (e.g., ocean, river, lake, waterfall, ice)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. ... Spiders have structures called spinnerets on their abdomen ... These are the silk-spinning organs.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

Here we outline the main web structures that UK spiders use to catch their prey. ... Sheet webs collect insects that fall onto them from above.

Open nhm.ac.uk
2 · Answer check returns No
Q9
1 · Guesser asks

Is the target a natural phenomenon (e.g., weather event, atmospheric or optical phenomenon) rather than a discrete physical object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a natural phenomenon (e.g., weather event, atmospheric or optical phenomenon) rather than a discrete physical object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders are exceptional biological engineers, using self-manufactured silk to design and build webs many times larger than their bodies. ... A spider’s web serves as a tool for prey capture, an extension of the senses and a retreat from predators.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q10
1 · Guesser asks

Is the target derived from a living organism (e.g., a shell, feather, bone, wood, pearl, or coral) but not itself alive?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target derived from a living organism (e.g., a shell, feather, bone, wood, pearl, or coral) but not itself alive?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02
“Spiders make their webs from silk, a natural fibre made of protein.” The page also describes spinnerets as the spider’s silk-spinning organs.
Open nhm.ac.uk
2 · Answer check returns Yes
Q11
1 · Guesser asks

Is the target typically produced by an animal (e.g., a shell, pearl, coral, feather, or bone) rather than by a plant or fungus?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically produced by an animal (e.g., a shell, pearl, coral, feather, or bone) rather than by a plant or fungus?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. ... How do spiders make their webs? ... Spiders have structures called spinnerets on their abdomen ... These are the silk-spinning organs.

Open nhm.ac.uk
Source 02
Different groups of spiders build different types of webs, depending on the type of prey they capture and the location of the web. Spiders use silk for many purposes, including web-building.
Open australian.museum
Source 03

Source summary (model-reported)

Spiders ... produce, build, and tune highly functional silks and large-scale web structures. ... Spiders build web structures several times their size with very few external supports, using only silk fibers.

Open pnas.org
2 · Answer check returns Yes
Q12
1 · Guesser asks

Is the target hard or mineralized (e.g., shell, pearl, coral, bone, antler) rather than soft or fibrous (e.g., feather, silk, wool, hair)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target hard or mineralized (e.g., shell, pearl, coral, bone, antler) rather than soft or fibrous (e.g., feather, silk, wool, hair)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Individual spiders can spin different types of silk; major ampullate silk makes the radial threads and frame of the web, minor ampullate silk makes the inner spiral, and flagelliform silk makes the extensible capture spiral.

Open science.org
Source 02

Source summary (model-reported)

Spider webs consist of several different types of silk. Frame and radii of orb webs are made of strong and rather rigid silk, while other silk fibers construct the auxiliary and capture spirals and connect the web to its surroundings.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

Biological materials are described as either soft, non-mineralized structures or hard structures that are composites of minerals and fibrous organic biopolymers. Spider silk is identified as a biopolymer that deforms while remaining strong.

Open ceramics.org
2 · Answer check returns No
Q13
1 · Guesser asks

Is the target produced by an insect (e.g., silk from silkworms)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target produced by an insect (e.g., silk from silkworms)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spiders make their webs from silk, a natural fibre made of protein. ... A spider spinning silk to make its web ... Spiders have structures called spinnerets ... These are the silk-spinning organs.
Open nhm.ac.uk
Source 02
Spiders are arachnids ... Although spiders and insects are both arthropods, they belong to different taxonomic groups. Spiders are arachnids ... Unlike insects, which have six legs ...
Open britannica.com
Source 03
Spiders produce silk proteins in glands deep within their abdomens. ... Some insects also produce silk (like the silkworm) but, unlike spiders, their silk emerges from the mouthparts. ... the orb web ... is made by four spider families in Britain.
Open britishspiders.org.uk
2 · Answer check returns No
Q14
1 · Guesser asks

Is the target a material commonly used to make textiles, clothing, or similar products?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a material commonly used to make textiles, clothing, or similar products?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The article distinguishes fabric made from spider silk from spider webs and says that no one has succeeded in recruiting spiders as agents of the textile industry.

Open daily.jstor.org
2 · Answer check returns No
Q15
1 · Guesser asks

Is the target commonly consumed as food by humans?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target commonly consumed as food by humans?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Some arachnids may be used for human consumption... About 15 species of spiders are scientifically described as being edible, with a history of human consumption.

Open en.wikipedia.org
Source 03
Spiders eat their old webs to recycle the proteins. And when they eat their webs, they eat anything that might be caught on the sticky strands, such as calorie-rich pollen.
Open sciencenews.org
2 · Answer check returns No
Q16
1 · Guesser asks

Is the target a type of animal body covering (e.g., feather, fur, hair, or down) rather than an internal or secreted product?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a type of animal body covering (e.g., feather, fur, hair, or down) rather than an internal or secreted product?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spider silk is a protein fibre or silk spun by spiders. Spiders use silk to make webs or other structures that function as adhesive traps to catch prey, to entangle and restrain prey before biting, to transmit tactile information, or as nests or cocoons to protect their offspring.
Open en.wikipedia.org
Source 02
Spider silk refers to the protein filaments secreted by spiders, such as are used in the construction of webs. The proteins are produced in special abdominal glands and then spun through ducts to spinnerets.
Open textileengineering.net
Source 03

Source summary (model-reported)

Hair is a non-living structure made of keratin found in mammals that grows from a follicle in the skin. Birds have feathers covering their bodies.

Open lsu.edu
2 · Answer check returns No
Q17
1 · Guesser asks

Is the target primarily composed of keratin (the protein found in hair, horn, nails, and baleen)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily composed of keratin (the protein found in hair, horn, nails, and baleen)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The major constituents of silks are proteins termed spidroins... Orb weaving spiders can produce up to seven different silk types and their fibres are composed of one or two spidroins.
Open journals.plos.org
Source 02

Source summary (model-reported)

Spider silk fibers are composed of one or more proteins, called spidroins. The article distinguishes spider silk from the separate protein family keratin.

Open nature.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is the target waxy or greasy in texture rather than fibrous or porous?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target waxy or greasy in texture rather than fibrous or porous?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q19
1 · Guesser asks

Is the target a structure built by an animal (e.g., a web, nest, hive, or burrow) rather than a substance the animal secretes or excretes?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target a structure built by an animal (e.g., a web, nest, hive, or burrow) rather than a substance the animal secretes or excretes?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spiders build web structures several times their size with very few external supports, using only silk fibers. The spider's construction method consists of prioritizing a fast build of the structure followed by slow structural reinforcement while using only silk as material.
Open pnas.org
2 · Answer check returns Yes
Q20
1 · Guesser asks

Is the target primarily composed of silk?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target primarily composed of silk?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q21
1 · Guesser asks

Is the target typically built by a spider?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the target typically built by a spider?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Not all spiders spin webs, but those that do construct them in a variety of forms, including tube- and funnel-shaped webs, sheet webs, and orb webs.

Open britannica.com
2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Spider web

A net-like structure of silk spun by spiders to catch prey.

Validator rationale The proposal identifies the general kind of assembled spider web and preserves its defining origin and function; it does not substitute silk material, the spider, or a body part.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A net-like structure of silk spun by spiders to catch prey.","name":"Spider web","question":null}}
2 · Validator returns Yes