Deep20Bench
v1.1Current

Benchmark edition

Edition 1.1 settings

10 subjects3 rounds per subject40 question limit
Question answersYesRather yesRather noNoUnknown
What changed
Source
Menu
Round

Round 3

Round 3

Identified Spider web in 19 counted questions.

Back to all Spider web rounds
Questions
19
Outcome
Solved
Format errors
No errors
Duration
5m 40s
Round cost
$0.1122 All 20 turns

Transcript

Questions and answers.

Turns are shown in the order they happened. Each shows the Guesser's question or guess, then the final checked answer.

Exact Guesser setupSystem message and BEGIN event

The Guesser received these messages at the start of the round. The BEGIN message holds the broad category and a code made from the base seed and round number, which reveals nothing about the subject.

System message
You are the Guesser in a Twenty Questions benchmark. Identify the hidden subject using as few
counted turns as possible. BEGIN provides only its broad category. The variation_token has no
clues; do not interpret, mention, or repeat it.

The category in BEGIN has a broad meaning:
- person: a real human, living or historical.
- fictional_character: an invented character from a story, book, comic, film, television,
  game, or another fictional work.
- mythological_figure: a figure from mythology or traditional legend.
- video_game_character: a character known from video games.
- thing: a broad category covering natural and human-made entities, living or nonliving,
  whole entities or parts of them. Possibilities include everyday objects, tools, machines,
  materials, food, animals, plants, body parts, natural structures, geographical features,
  celestial bodies, natural phenomena, and concepts. These possibilities are not exhaustive.
  The target may be a general kind or one particular instance.

Use questions to narrow the supplied category. These definitions are not a list of targets.

Use ASK for a factual question that distinguishes candidates. Never use ASK to confirm a
specific identity. Use GUESS with a name and short identifying description to name a candidate.

ASK has five possible replies:
- YES or NO: the evidence establishes that answer to the exact question.
- RATHER_YES or RATHER_NO: evidence leans that way, but is not strong enough for a firm answer.
  Treat this as a clue; keep candidates fitting the opposite answer possible.
- UNKNOWN: no reliable direction. It supports neither answer.

Ask clear questions about verifiable properties. "Can", "sometimes", "usually", "always", and
"mainly" ask different things. Do not assume that one property proves another or rules out alternatives.
Qualified replies express uncertainty about your question, not how often a property applies.
Before narrowing heavily, check your key assumption with a different property. After rejected
guesses, reconsider earlier assumptions as well as candidates. Answers can be mistaken; check
another property when stuck. Do not ignore an answer merely because it conflicts with a
preferred candidate.

Each ASK, rejected GUESS, or format error before the limit costs one turn. A correct GUESS costs
none. After 40 counted turns, make one final GUESS; ASK is then forbidden. Identity
validation uses only YES, NO, or UNKNOWN. UNKNOWN on GUESS ends the game without success.

FORMAT_ERROR means your output broke the contract, was not checked for correctness, and cost
one turn. Retry using its displayed formats if a turn remains. Return only the required JSON
object with exactly one result action. No explanations, reasoning, or extra fields.
BEGIN event
{"category":"thing","event":"BEGIN","variation_token":"AMZAISLM"}

Valid replies are shown in the required format. Rejected replies are shown separately, without provider or call IDs.

Q1
1 · Guesser asks

Is the subject a physical object rather than a concept, event, or abstract phenomenon?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a physical object rather than a concept, event, or abstract phenomenon?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders build web structures several times their size with very few external supports, using only silk fibers. The web structure is reinforced over time.

Open pnas.org
2 · Answer check returns Yes
Q2
1 · Guesser asks

Is the subject human-made rather than naturally occurring?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject human-made rather than naturally occurring?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q3
1 · Guesser asks

Is the subject a living organism rather than a nonliving natural object?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a living organism rather than a nonliving natural object?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Within a single spider web, elastic flagelliform silk strands are coated with a sticky aggregate silk glue to aid in prey capture, while dragline silk is stiffer and stronger to provide the web with enhanced structural integrity.

Open pubs.acs.org
Source 02

Source summary (model-reported)

A spider’s silk-making proteins, called spidroins, form in its abdomen as a dense liquid. Spinnerets, body parts on the spider’s rear end, spin the liquid into long threads.

Open snexplores.org
2 · Answer check returns No
Q4
1 · Guesser asks

Is the subject typically larger than a human being?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject typically larger than a human being?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

2 · Answer check returns No
Q5
1 · Guesser asks

Is the subject commonly used in jewelry or as a decorative item?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject commonly used in jewelry or as a decorative item?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The product is a real spider-web necklace. Each frame pendant contains a real section of preserved spider web, pressed under glass and sealed with resin.

Open thebohodepot.com
2 · Answer check returns Rather no
Q6
1 · Guesser asks

Is the subject a type of rock or mineral?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a type of rock or mineral?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
The source explicitly distinguishes the web from silk: “A web is a structure, not a substance.” It describes spider silk as the material spiders produce to make webs and the web as architecture built from that material.
Open theconversation.com
Source 02

Source summary (model-reported)

The source describes orb webs as consisting of several different types of silk and states that web frames and radii are made of silk. It discusses the structure and function of spider silk fibers, not rocks or minerals.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q7
1 · Guesser asks

Is the subject biological in origin (e.g., derived from a plant or animal)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject biological in origin (e.g., derived from a plant or animal)?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01
Spiders produce silk from a specialized gland and use it to build incredible web structures. The web is the architecture built from it, much as steel is a material and a bridge is a structure.
Open theconversation.com
Source 02

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. The source also describes spider spinnerets as silk-spinning organs and explains that silk is extruded from them to form threads.

Open nhm.ac.uk
2 · Answer check returns Yes
Q8
1 · Guesser asks

Is the subject an animal-derived body part or product (such as bone, shell, feather, or silk) rather than plant-derived?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject an animal-derived body part or product (such as bone, shell, feather, or silk) rather than plant-derived?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders make their webs from silk, a natural fibre made of protein. ... How do spiders make their webs? A spider spinning silk to make its web...

Open nhm.ac.uk
2 · Answer check returns Yes
Q9
1 · Guesser asks

Is the subject a hard material, such as bone, shell, horn, antler, or ivory?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a hard material, such as bone, shell, horn, antler, or ivory?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The most studied webs are the so-called orb webs which consist of several different types of silk. Frame and radii of orb webs are made of strong and rather rigid silk. In addition to MA and Flag silk, orb weaving spiders utilize two further silks for constructing webs.

Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

Spiders use silk for a variety of practical purposes including arresting a fall, swathing prey, building a web, lining burrows, or making egg cases. The major component of the capture spiral of a spider web is flagelliform silk.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q10
1 · Guesser asks

Is the subject a textile fiber or fabric, such as silk, wool, or leather?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a textile fiber or fabric, such as silk, wool, or leather?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 03

Source summary (model-reported)

Orb webs consist of several different types of silk. The web's frame, radii, capture spiral, joints, and attachment points use distinct silk fibers or silk cement.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q11
1 · Guesser asks

Is the subject a fluid or liquid at room temperature?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a fluid or liquid at room temperature?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Spiders build web structures several times their size with very few external supports, using only silk fibers. Orb webs are composed of stiff dragline silk radial threads and extensible and sticky viscid silk spiral threads.

Open pnas.org
Source 02

Source summary (model-reported)

Among the most studied webs are the so-called orb webs which consist of several different types of silk. Frame and radii of orb webs are made of strong and rather rigid silk.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q12
1 · Guesser asks

Is the subject produced by an insect or other arthropod?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject produced by an insect or other arthropod?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

This source states that many web spiders construct silk sheets and that orb webs are constructed by several spider families. It also describes the spider releasing silk and building the web's framework and spirals.

Open britannica.com
Source 02

Source summary (model-reported)

The Australian Museum states that spiders are arachnids, not insects, and that both spiders and insects belong to the arthropods, the largest group of animals on Earth.

Open australian.museum
2 · Answer check returns Yes
Q13
1 · Guesser asks

Is the subject a wax (such as beeswax)?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a wax (such as beeswax)?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 02

Source summary (model-reported)

At the macroscale, silk fibers produce spider webs ... spiders use their protein solution to spin 3D or 2D webs.

Open osti.gov
2 · Answer check returns No
Q14
1 · Guesser asks

Is the subject commonly consumed by humans as food or a food ingredient?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject commonly consumed by humans as food or a food ingredient?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source says spiders eat their webs, sometimes every day, to recover energy. It also describes human uses of spider webs for wound treatment and research into their strength, but does not describe human consumption as food.

Open thenakedscientists.com
Source 02

Source summary (model-reported)

Britannica describes spider webs as structures used to entrap prey. It explains that spiders wrap captured insects in silk before feeding or storing them, and that many orb webs are rebuilt regularly.

Open britannica.com
Source 03

Source summary (model-reported)

The source reports that orb-weaver spiders are consumed as a protein source in Nagaland and that some other spider species are part of traditional diets. This concerns eating the spiders themselves, not their webs.

Open news.mongabay.com
2 · Answer check returns No
Q15
1 · Guesser asks

Is the subject a resin or resinous substance used in finishes or coatings?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a resin or resinous substance used in finishes or coatings?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

Orb webs consist of several different types of silk. Frame and radii of orb webs are made of strong and rather rigid silk; silk fibers are made from proteins produced in the spider's major ampullate glands.

Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

Varnish is a liquid coating material containing a resin that dries to a hard transparent film. Most varnishes are a blend of resin, drying oil, drier, and volatile solvent. Varnishes provide protective coatings for wooden surfaces, paintings, and various decorative objects.

Open britannica.com
Source 03

Source summary (model-reported)

Natural resins are a class of solid materials obtained from excretions from certain trees or shrubs. They are used as varnishes, adhesives, inks and additives in paint media.

Open cameo.mfa.org
2 · Answer check returns No
Q16
1 · Guesser asks

Is the subject used primarily as a pigment or dye?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject used primarily as a pigment or dye?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

In nature, spiders use their silk for several applications such as for webs, wrapping of prey, protection of their offspring and as a lifeline... roughly 50% thereof use webs to catch prey.

Open pmc.ncbi.nlm.nih.gov
Source 02

Source summary (model-reported)

The major pigment in the golden dragline silk of Trichonephila clavata was xanthurenic acid. The study concerns pigment in golden spider silk and speculates that spiders may use the pigment to attract prey; it does not identify assembled spider webs as pigments or dyes.

Open pubmed.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

Once the silk is solid, spiders use their spinnerets... to produce the silky fibers for webs. Spider silk is used for functions including webs, and silk has also had limited human uses such as optical crosshairs and fish nets.

Open orkin.com
2 · Answer check returns No
Q17
1 · Guesser asks

Is the subject a structural material that forms the exoskeletons of arthropods, such as chitin?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a structural material that forms the exoskeletons of arthropods, such as chitin?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source describes the complex architecture of spider webs and their constituent silk proteins. It states that web-weaving spiders produce silks with distinct properties that enable construction of sophisticated spider webs.

Open pubs.rsc.org
Source 02

Source summary (model-reported)

The source states that the exoskeletal cuticle of spiders and other arthropods is based on a combination of chitin, protein, water, and small amounts of organic cross-linkers. It separately describes a diving-bell spider weaving a silk web dome.

Open pmc.ncbi.nlm.nih.gov
Source 03

Source summary (model-reported)

The source identifies chitin as a main structural element in the exoskeletons of arthropods and states that spider exoskeletons consist mainly of chitin combined with protein.

Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns No
Q18
1 · Guesser asks

Is the subject a structure constructed by an arthropod (such as a web or nest) rather than a substance secreted by one?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the subject a structure constructed by an arthropod (such as a web or nest) rather than a substance secreted by one?"}}
Oracle evidence2 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The source describes spiders constructing webs and identifies silk as the material used in forming them, including the statement that a spider "constructs the web from the same threads used to build the egg cocoon."

Open frontiersin.org
Source 02
The source states that spiders produce different silks from aqueous protein solutions and that major ampullate silk fibers are "the constituents of draglines and of the structural elements of most webs."
Open pmc.ncbi.nlm.nih.gov
2 · Answer check returns Yes
Q19
1 · Guesser asks

Is the structure built by an arachnid (such as a spider) rather than by an insect?

Recorded Guesser outputRequired JSON format
{"result":{"action":"ASK","description":null,"name":null,"question":"Is the structure built by an arachnid (such as a spider) rather than by an insect?"}}
Oracle evidence3 model-reported sources

The Oracle reported these excerpts and URLs. They are not independently checked.

Source 01

Source summary (model-reported)

The Natural History Museum states that spiders make their webs from silk and describes how web-spinning spiders construct webs.

Open nhm.ac.uk
Source 02
The source explicitly states: “Spiders are arachnids, not insects.” It also describes cobweb spiders living in sticky, irregularly spun webs and various spider groups producing webs.
Open ucanr.edu
Source 03

Source summary (model-reported)

The Natural History Museum describes spider web structures and identifies spiders and spider families as their makers, including orb-weavers, funnel-weavers, and other web-building spiders.

Open nhm.ac.uk
2 · Answer check returns Yes
G
1 · Guesser guessesNot counted

Spider web

A structure of silk spun by a spider

Validator rationale The proposal identifies a spider web as a spider-built silk structure, matching the assembled web target and its defining function.

Recorded Guesser outputRequired JSON format
{"result":{"action":"GUESS","description":"A structure of silk spun by a spider","name":"Spider web","question":null}}
2 · Validator returns Yes