Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 1

Round 1

Identified Spider web in 28 counted questions.

Back to all Spider web rounds
Questions
28
Outcome
Solved
Format errors
No errors
Duration
7m 13s
Round cost
$0.3608 All 29 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"EAQCORIU"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

2 of 28 answers in this round reuse an earlier, fully checked answer with its original evidence. No new search or check ran for those turns.

Q1
1 · Guesser asks

Is it a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a living organism?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
A spider web, spiderweb, spider's web, cobweb or even just web ... is a structure created by a spider out of proteinaceous spider silk extruded from its spinnerets, generally meant to catch its prey.
Open en.wikipedia.org
2 · Answer check returns No
Q2
1 · Guesser asks

Is it human-made?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it human-made?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Is it a physical object or substance that can be touched?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a physical object or substance that can be touched?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Web-weaving spiders produce ... silks with distinct properties ... [that allow] construction of highly sophisticated spider webs with well designed architectures.

Open pubs.rsc.org
Source 02

Source summary (model-reported)

More than 130 different shapes of spider webs are known. Among the most studied webs are the so-called orb webs which consist of several different types of silk.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q4
1 · Guesser asks

Is it normally found on Earth?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally found on Earth?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q5
1 · Guesser asks

Is it primarily solid in its natural state?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it primarily solid in its natural state?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Spiders spin silks that are extra-corporally used for protection of offspring and construction of complex prey traps. The review describes the hierarchical organization of protein fibers in spider webs and their constituent silk proteins.

Open pubs.rsc.org
2 · Answer check returns Yes
Q6
1 · Guesser asks

Is it typically larger than a human adult?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically larger than a human adult?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The article describes the Darwin’s bark spider web as the largest spider web in the world. Its main anchor thread can be as long as 25 metres, and its main sticky core can be as large as 2.8 square metres.

Open nationalgeographic.com
2 · Answer check returns No
Q7
1 · Guesser asks

Is it a rock, mineral, or other geological material?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a rock, mineral, or other geological material?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk, described as “a natural fibre made of protein.” It also describes spinnerets as the spider's silk-spinning organs.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

The Chemical Society Reviews article describes spider webs and their constituent silks as hierarchical structures made of proteins, and says web-weaving spiders produce different silks based on constituent proteins to construct webs.

Open pubs.rsc.org
2 · Answer check returns No
Q8
1 · Guesser asks

Is it produced by or part of a living organism?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a living organism?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Web building involves drawing out silk from spinnerets and weaving strands into geometric traps. While all spiders produce silk, only about half of the over 51,500 known species build webs to catch prey.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen, which are the silk-spinning organs.

Open nhm.ac.uk
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is it part of or produced by an animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it part of or produced by an animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The spider builds the foundation of the web geometry during the first 2 d of construction... The spider’s construction method consists of prioritizing a fast build of the structure followed by slow structural reinforcement while using only silk as material.
Open pnas.org
2 · Answer check returns Yes
Q10
1 · Guesser asks

Is it typically found inside an animal's body while the animal is alive?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it typically found inside an animal's body while the animal is alive?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Many web spiders construct silk sheets in vegetation, sometimes one above the other, and often add anchor threads, which trip unsuspecting insects.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen... A single silk thread comes out of each.

Open nhm.ac.uk
Source 03

Source summary (model-reported)

While all spiders produce silk, only about half of the over 51,500 known species build webs to catch prey. Web spiders construct silk sheets in vegetation... and build tube-, funnel-, sheet-, and orb-shaped webs.

Open britannica.com
2 · Answer check returns No
Q11
1 · Guesser asks

Is it normally attached to the outside of a living animal's body?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it normally attached to the outside of a living animal's body?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Most web-building spiders ... choose any suitable structure—usually a rigid or semi-rigid structure ... although some spiders also attach their webs to moving structures, such as leaves and grass.
Open pmc.ncbi.nlm.nih.gov
Source 02
The smallest species tend to build their sheet webs on depressions in the soil, others on low vegetation and some on tree bark. ... House spider webs ... occur on dense vegetation ... under stones and around cracks in tree bark.
Open nhm.ac.uk
Source 03
If [a silk thread] becomes firmly attached—for example, to a twig—the spider secures the thread and crosses the newly formed bridge, reinforcing it with additional threads.
Open britannica.com
2 · Answer check returns No
Q12
1 · Guesser asks

Is it produced by or part of a mammal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a mammal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Web building involves drawing out silk from spinnerets ... and weaving strands into geometric traps. While all spiders produce silk, only about half ... build webs to catch prey.

Open britannica.com
Source 02

Source summary (model-reported)

The supplied subject description defines the target as a structure built by a spider from spider silk and expressly distinguishes the assembled web from the spider itself and from a body part.

Open en.wikipedia.org
2 · Answer check returns No
Q13
1 · Guesser asks

Is it an egg or part of an egg?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it an egg or part of an egg?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

Britannica states that the protective egg sac surrounding most spider eggs is made of silk. It distinguishes the eggs from the silk sac that surrounds them and describes the sac as a separate structure that may be attached to or associated with other spider structures.

Open britannica.com
2 · Answer check returns No
Q14
1 · Guesser asks

Is it produced by or part of an insect?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of an insect?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders, belonging to the order Araneae, are arachnids distinguished by having eight legs, unlike insects, which have six. Spiders create webs from silk... Web-weaving spiders possess silk glands in their abdomen that connect to spinnerets.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. There are seven different silk glands, which produce silk with different characteristics and uses.

Open nhm.ac.uk
2 · Answer check returns No
Q15
1 · Guesser asks

Is it produced by or part of a bird?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a bird?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Web building involves drawing out silk from spinnerets and weaving strands into structures. While all spiders produce silk, only about half of known spider species build webs to catch prey.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders produce silk fibers and build, tune, monitor, repair, and recycle web structures. The study describes a spider constructing a web and reinforcing its structure with silk.

Open pnas.org
2 · Answer check returns No
Q16
1 · Guesser asks

Is it produced by or part of a reptile?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a reptile?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk, a protein-based natural fibre, and describes spinnerets as the spider's silk-spinning organs used in making webs.

Open nhm.ac.uk
Source 03

Source summary (model-reported)

The Library of Congress explains that silk-producing glands in a spider's abdomen secrete proteins through spinnerets, and that many spiders use this silk to build webs.

Open loc.gov
2 · Answer check returns No
Q17
1 · Guesser asks

Is it produced by or part of a fish?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a fish?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk and describes spinnerets on the spider's abdomen as the silk-spinning organs.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

Britannica describes web building as drawing silk from a spider's spinnerets and weaving the strands into web structures; it also states that spiders produce silk.

Open britannica.com
2 · Answer check returns No
Q18
1 · Guesser asks

Is it produced by or part of a mollusk?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a mollusk?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Web building involves drawing out silk from spinnerets and weaving strands into traps. While all spiders produce silk, only about half of known species build webs to catch prey.

Open britannica.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen, which are the silk-spinning organs.

Open nhm.ac.uk
2 · Answer check returns No
Q19
1 · Guesser asks

Is it produced by or part of an amphibian?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of an amphibian?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Britannica describes web building as spiders drawing out silk from spinnerets and weaving strands into webs. It also states that web spiders construct silk sheets and that spiders that build webs construct them in forms including tube-, funnel-, sheet-, and orb-shaped webs.

Open britannica.com
Source 02

Source summary (model-reported)

The article describes foam nests constructed by anuran amphibians from secretions produced and whipped into a froth by the parents. It separately notes that spiders use silk for nesting and prey capture.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q20
1 · Guesser asks

Is it produced by or part of an invertebrate animal?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of an invertebrate animal?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spiders make their webs from silk, a natural fibre made of protein. Spiders have structures called spinnerets on their abdomen, usually on the underside to the rear. These are the silk-spinning organs.
Open nhm.ac.uk
Source 02

Source summary (model-reported)

While all spiders produce silk, only about half of the over 51,500 known species build webs to catch prey. Web building involves drawing out silk from spinnerets and weaving strands into structures such as geometric traps.

Open britannica.com
2 · Answer check returns Yes
Q21
1 · Guesser asks

Is it produced by or part of an arachnid such as a spider or scorpion?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of an arachnid such as a spider or scorpion?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk and describes spiders spinning silk to make their webs.

Open nhm.ac.uk
2 · Answer check returns Yes
Q22
1 · Guesser asks

Is it produced by or part of a spider, specifically?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it produced by or part of a spider, specifically?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk and describes a spider spinning silk to make its web, with silk extruded through spinnerets.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

Britannica describes web building as drawing out silk from spinnerets and weaving strands into webs; it also states that web spiders construct silk snares or webs.

Open britannica.com
2 · Answer check returns Yes
Q23
1 · Guesser asks

Is it made mainly of silk produced by the spider?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it made mainly of silk produced by the spider?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Frame and radii of orb webs are made of strong and rather rigid silk. ... Silk fibers made of proteins produced in the minor ampullate gland are used to build an auxiliary spiral. ... Connections ... and attachment of the web frame to the substratum ... are made of a sophisticated silk cement consisting of proteins produced in the piriform gland.
Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

The article describes spider silk as a fibrous biomaterial and discusses distinct silk types produced by female orb-weaving spiders. It also identifies natural spider silk taken from an orb web.

Open pubmed.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q24
1 · Guesser asks

Is it a structure built by a spider to catch prey?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it a structure built by a spider to catch prey?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns Yes
Q25
1 · Guesser asks

Is it characteristically circular, with radial threads crossed by a spiral thread?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it characteristically circular, with radial threads crossed by a spiral thread?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

British spider webs can be categorised into seven broad types: orb, sheet, tangle, funnel, lace, radial and purse. Orb webs are constructed with radial threads that function as a scaffold. The spider then lays down sticky threads in a spiral.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

Spiders ... create numerous web architectures that range from simple T webs and typical two-dimensional (2D) orb webs to complex three-dimensional (3D) webs such as funnel, cob, and tangle webs. Orb webs are composed of stiff dragline silk radial threads and extensible and sticky viscid silk spiral threads.

Open pnas.org
Source 03

Source summary (model-reported)

The four main types of spiderwebs are orb webs, sheet webs, tangle webs, and funnel webs. Orb webs, with their spiral patterns, are the most recognizable. ... those that do construct them in a variety of forms, including tube- and funnel-shaped webs, sheet webs, and elaborate orb-shaped webs.

Open britannica.com
2 · Answer check returns Rather yes
Q26
1 · Guesser asks

Is it built only by one particular family of spiders, rather than by many different kinds of spiders?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it built only by one particular family of spiders, rather than by many different kinds of spiders?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most elaborate webs are those of the orb weavers, whose circular nets are conspicuous on dewy mornings. This type of web is constructed by several spider families...

Open britannica.com
Source 02

Source summary (model-reported)

These three-dimensional criss-crosses of silk are built by three families of spiders... Broadly, seven different web architectures can be recognized among British spiders – orb, funnel, tangled, lacy, radial, hammock and purse.

Open britishspiders.org.uk
2 · Answer check returns No
Q27
1 · Guesser asks

Can this kind of structure also be funnel-shaped or sheet-shaped, not only circular?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Can this kind of structure also be funnel-shaped or sheet-shaped, not only circular?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Types of spider web ... can be categorised into seven broad types: orb, sheet, tangle, funnel, lace, radial and purse. ... The overall shape [of funnel webs] resembles a funnel. ... the labyrinth spider typically spins a large sheet of closely woven silk.

Open nhm.ac.uk
Source 02

Source summary (model-reported)

The four main types of spiderwebs are orb webs, sheet webs, tangle webs, and funnel webs. ... While not all spiders spin webs, those that do construct them in a variety of forms, including tube- and funnel-shaped webs, sheet webs, and elaborate orb-shaped webs.

Open britannica.com
2 · Answer check returns Yes
Q28
1 · Guesser asks

Is it defined as a web that has been abandoned by the spider that made it?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is it defined as a web that has been abandoned by the spider that made it?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
G
1 · Guesser guessesNot counted

spider web

a prey-catching structure made of silk produced by a spider

Validator rationale The proposal identifies a spider web as a prey-catching structure built from spider silk, matching the target assembled web and not the silk material, spider, or a body part.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"a prey-catching structure made of silk produced by a spider","name":"spider web","question":null}}
2 · Validator returns Yes