Skip to content

Commit c623701

Browse files
committed
Merge branch 'main' of github.com:cocoabench/cocoabench.github.io
2 parents b0bdcfe + 4cd21bd commit c623701

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

blog.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -174,9 +174,9 @@ <h4>Logical inference type</h4>
174174
For each task, we mark the <strong>dominant logical inference type</strong>: deductive, inductive, or abductive. Existing benchmarks typically concentrate on one direction (e.g., abductive reasoning in <a href="https://openai.com/index/browsecomp/">BrowseComp</a>, where the agent must infer a hidden target from partial clues). In contrast, CocoaBench deliberately spans all three, resulting in a more diverse set of reasoning questions.
175175
</p>
176176
<ul>
177-
<li><strong>Deductive reasoning:</strong> from general rules to specific conclusions. For example, to solve the <a href="index.html#example-wb-logs">"W&B logs"</a> example task, the agent is given a set of specific rules and raw logs, and expected to reach a specific conclusion.</li>
178-
<li><strong>Inductive reasoning:</strong> from multiple examples to a general pattern. For example, to solve the <a href="index.html#example-linear-regimes">"Linear regimes"</a> example task, the agent is given a set of raw data and expected to fit a function to the data.</li>
179-
<li><strong>Abductive reasoning:</strong> from observed outcomes to the most plausible explanation or hypothesis. For example, to solve the <a href="index.html#example-8-puzzle-game">"8-puzzle game"</a> example task, the agent is needs to infer the target state based on interaction with the interface.</li>
177+
<li><strong>Deductive reasoning:</strong> from general rules to specific conclusions. For example, in the <a href="index.html#example-wb-logs">"W&B logs"</a> example task, the agent is given specific rules and raw logs, and expected to reach a specific conclusion.</li>
178+
<li><strong>Inductive reasoning:</strong> from multiple examples to a general pattern. For example, in the <a href="index.html#example-linear-regimes">"Linear regimes"</a> example task, the agent is given raw data and expected to fit a function to the data.</li>
179+
<li><strong>Abductive reasoning:</strong> from observed outcomes to the most plausible explanation or hypothesis. For example, to solve the <a href="index.html#example-8-puzzle-game">"8-puzzle game"</a> example task, the agent needs to infer the target state based on interaction with the interface.</li>
180180
</ul>
181181
<p>
182182
Typically, tasks are mixed with all different reasoning directions. We do not treat these categories as rigid boxes. Instead, they provide a <strong>lens for analysis</strong>: for each task, we mark which directionality is most important, allowing us to ask, for example, whether agents struggle more with abductive tasks (explaining failures) than with purely deductive ones (checking constraints).

0 commit comments

Comments
 (0)