Skip to content

Commit 12b1e92

Browse files
committed
add contribution part
1 parent bb17e3f commit 12b1e92

1 file changed

Lines changed: 8 additions & 2 deletions

File tree

blog.html

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -266,9 +266,15 @@ <h2>The CocoaAgent Framework</h2>
266266
To enable rigorous evaluation and empower researchers to develop their own agents, we built the <strong><a href="https://github.com/cocoabench/cocoa-agent">CocoaAgent</a></strong> framework. CocoaAgent provides seamless integration with <a href="https://github.com/agent-infra/sandbox">AIO Sandbox</a>, an all-in-one Docker environment. It equips agents with a full suite of tools—browser automation, terminal access, file operations, and code interpreters—enabling them to operate like human developers in realistic settings. Our framework is model-agnostic, and we provide example scripts for running agents with both open-source LLMs such as Qwen3-VL and commercial models such as GPT-5.1. To support robust evaluation at scale, CocoaAgent implements both dynamic runtime tests for verifying computational correctness and lightweight static-matching checks for deterministic answers. We are currently producing comprehensive results on CocoaBench using this framework, which will be available soon on our leaderboard.
267267
</p>
268268

269-
<h2>Future Work</h2>
269+
<h2>Get Involved</h2>
270270
<p>
271-
We are continuously building and improving CocoaBench. Collaboration is welcomed! CocoaBench benefits from collaborators with diverse backgrounds. We invite you to bring your interesting ideas and use cases for agents to the community. Feel free to reach out to us or join our <a href="https://discord.gg/ZDaDhVCd" target="_blank">Discord community</a> to propose new tasks or discuss ideas. We will be also setting up a task contribution protocol soon.
271+
We are continuously building and improving CocoaBench. CocoaBench is a community-driven benchmark, and we welcome contributions from researchers and practitioners with diverse backgrounds. If you've encountered a challenging real-world problem that pushed your limits, it might make a great benchmark task!
272+
</p>
273+
<p>
274+
We've set up a streamlined <a href="https://github.com/cocoabench/cocoa-agent/blob/main/contrib/CONTRIBUTING.md" target="_blank">task contribution protocol</a> to guide you through creating and submitting new tasks. Contributors with <strong>3 accepted tasks</strong> are eligible for co-authorship on the CocoaBench paper, which we plan to submit to a top-tier ML conference.
275+
</p>
276+
<p>
277+
Have questions or ideas? Feel free to reach out to us or join our <a href="https://discord.gg/ZDaDhVCd" target="_blank">Discord community</a> to propose new tasks or discuss ideas. (If the link doesn't work, try refreshing the page or manually add the server in Discord app using invite code: <code>ZDaDhVCd</code>)
272278
</p>
273279

274280
<hr style="border: 0; border-top: 1px solid #eee; margin: 40px 0;">

0 commit comments

Comments
 (0)