Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Spider web in 15 counted questions.

Back to all Spider web rounds
Questions
15
Outcome
Solved
Format errors
No errors
Duration
5m 24s
Round cost
$0.0763 All 16 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is it a tangible physical entity that occupies space and can be touched?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a tangible physical entity that occupies space and can be touched?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Library of Congress describes spider webs as complex nets of strong and elastic silk threads. It states that spiders use claws to grasp the web's threads and that silk changes from liquid inside the spider into a solid thread outside its body.

Open loc.gov
Source 03

Source summary (model-reported)

Stanford reports measurements of the mechanical properties of an intact spider web, including its silk intersections and glue spots, and describes the web as a structure formed from spider silk.

Open engineering.stanford.edu
2 · Answer check returns Yes
Q2
1 · Guesser asks

Is it a living organism in its entirety?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a living organism in its entirety?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Is it primarily human-made rather than naturally occurring?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily human-made rather than naturally occurring?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Web building involves drawing out silk from spinnerets and weaving strands into geometric traps. Webs are instinctively constructed and effectively trap flying insects.

Open britannica.com
2 · Answer check returns No
Q4
1 · Guesser asks

Is it located primarily in outer space beyond Earth's atmosphere?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it located primarily in outer space beyond Earth's atmosphere?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Many web spiders construct silk sheets in vegetation, sometimes one above the other, and often add anchor threads, which trip unsuspecting insects.

Open britannica.com
Source 02

Source summary (model-reported)

The Skylab spider experiment reported that two spiders built orb-webs in Skylab under zero gravity. The paper describes this as web-building in outer space and compares the resulting webs with Earth webs.

Open americanarachnology.org
2 · Answer check returns No
Q5
1 · Guesser asks

Is it typically smaller than an average adult human in its largest dimension?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically smaller than an average adult human in its largest dimension?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The study reports web radii ranging from 4.4 cm to 10.5 cm, while noting that Argiope radon webs average over 80 cm in diameter and that orb-web size varies substantially across species.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q6
1 · Guesser asks

Is it derived from or a part of a living organism such as a plant or animal? Unprocessed or minimally altered natural animal or plant material counts as YES.

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it derived from or a part of a living organism such as a plant or animal? Unprocessed or minimally altered natural animal or plant material counts as YES."}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q7
1 · Guesser asks

Is it derived from or a part of a plant?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it derived from or a part of a plant?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders spin webs out of silk... Actually a protein created by special organs known as spinnerets, spider silk can be used for transportation, shelter, courtship, and all kinds of creative ways to trap prey.

Open nationalgeographic.com
2 · Answer check returns No
Q8
1 · Guesser asks

Is it derived from, produced by, or a part of an animal, including humans or insects? Animal secretion or product counts as YES.

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it derived from, produced by, or a part of an animal, including humans or insects? Animal secretion or product counts as YES."}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

A spider web is a structure created by a spider out of proteinaceous spider silk extruded from its spinnerets. Spiders produce silk from spinneret glands located at the tip of their abdomen.

Open en.wikipedia.org
Source 02

Source summary (model-reported)

The article states that spider silk proteins are produced in spider silk glands and that, after secretion from the silk glands, the silk proteins are in aqueous solution. It also describes multiple silk types used to construct parts of orb webs.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

Britannica describes web building as drawing silk out from spinnerets and weaving the strands into web structures. It also states that all spiders produce silk, although only about half of known species build webs to catch prey.

Open britannica.com
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is it derived from or a part of a non-human animal rather than a human? Non-human exclusive counts as YES.

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it derived from or a part of a non-human animal rather than a human? Non-human exclusive counts as YES."}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. ... Spiders have structures called spinnerets on their abdomen ... These are the silk-spinning organs.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

In nature, spiders use their silk for several applications such as for webs ... Among the most studied webs are the orb webs which consist of several different types of silk. The underlying proteins ... are produced in ... glands.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

Spiders produce silk fibers ... Not only do they produce, build, and tune highly functional silks and large-scale web structures ... Spiders build web structures ... using only silk fibers.

Open pnas.org
2 · Answer check returns Yes
Q10
1 · Guesser asks

Is it produced by or derived from an invertebrate animal such as an insect, spider, mollusk, or coral?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or derived from an invertebrate animal such as an insect, spider, mollusk, or coral?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spiders are invertebrate creatures in the araneae order of the class arachnida in the phylum arthropoda. ... Their multiple silk glands each produce different kinds of silk to aid in mating rituals, create shields for protection from predators, encase their eggs and, of course, weave webs.
Open loc.gov
Source 02
Spiders make their webs from silk, a natural fibre made of protein. ... Spiders have structures called spinnerets on their abdomen, usually on the underside to the rear. These are the silk-spinning organs. Spiders then follow various patterns of activity to construct their webs.
Open nhm.ac.uk
2 · Answer check returns Yes
Q11
1 · Guesser asks

Is it produced by or a part of a mollusk such as an oyster, clam, mussel, or snail?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or a part of a mollusk such as an oyster, clam, mussel, or snail?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Some animals produce non-living structures external to their bodies that are critical for survival, for example the calcified skeletons of corals, the shells of molluscs, the byssal threads of mussels or the webs of spiders. Spiders produce multiple silk types, from discrete abdominal glands.

Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

While all spiders produce silk, only about half of the over 51,500 known species build webs to catch prey. Spider silk comes from the spider, and web building involves drawing out silk from spinnerets and weaving strands into traps.

Open britannica.com
2 · Answer check returns No
Q12
1 · Guesser asks

Is it produced by or derived from an insect?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or derived from an insect?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders, belonging to the order Araneae, are arachnids... How do spiders make webs? Spiders create webs from silk... Web-weaving spiders possess silk glands in their abdomen that connect to spinnerets. These spinnerets have spigots that release silk.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen... These are the silk-spinning organs. Spiders then follow various patterns of activity to construct their webs.

Open nhm.ac.uk
Source 03

Source summary (model-reported)

Although all spiders make silk, surprisingly only about half of all spider species build webs to entrap their prey. Many web spiders construct silk sheets... An insect caught in the web or touching an anchor line becomes entangled.

Open britannica.com
2 · Answer check returns No
Q13
1 · Guesser asks

Is it produced by or associated with an arachnid such as a spider, scorpion, mite, or tick?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or associated with an arachnid such as a spider, scorpion, mite, or tick?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Many web spiders construct silk sheets in vegetation... The most elaborate webs are those of the orb weavers... To begin orb-web construction, the spider releases a silk thread that is carried by wind.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. How do spiders make their webs? A spider spinning silk to make its web, pulling the thread out with its hind leg.

Open nhm.ac.uk
2 · Answer check returns Yes
Q14
1 · Guesser asks

Is it produced by or a part of a spider rather than other arachnids like scorpions, mites, or ticks?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or a part of a spider rather than other arachnids like scorpions, mites, or ticks?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A spider web, spiderweb, spider's web, cobweb or even just web ... is a structure created by a spider out of proteinaceous spider silk extruded from its spinnerets, generally meant to catch its prey.
Open en.wikipedia.org
Source 02
Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen ... These are the silk-spinning organs.
Open nhm.ac.uk
2 · Answer check returns Yes
Q15
1 · Guesser asks

In its natural form, is it organized as a net-like mesh or web of threads enclosing open spaces?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"In its natural form, is it organized as a net-like mesh or web of threads enclosing open spaces?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Spider webs include classic two-dimensional webs, tangled meshes of silk, loose three-dimensional frameworks of criss-crossing threads, and sheets of closely woven silk. These descriptions cover multiple natural web forms while retaining a thread-based, open or mesh-like organization.

Open nhm.ac.uk
2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Spider web

Mesh structure made of silk threads spun by spiders

Validator rationale The proposal identifies a spider web as a mesh structure made from spider silk, matching the target assembled web and not the silk material, spider, or a body part.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"Mesh structure made of silk threads spun by spiders","name":"Spider web","question":null}}
2 · Validator returns Yes