bigcodebench

by bigcode-project · Agent Tool · ★ 485

About bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

agentagentsbenchmarkchatgptclaude-3code-generationdeepseekfunction-callinggeminigpt-4

Quick Facts

Stars485
Forks64
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score34.75/100
Open Issues27
Last Updated2026-01-03
Created2024-04-29
Platformsclaude-code, gemini, python
Est. Tokens~443k

Compatible Skills

These tools work well together with bigcodebench for enhanced workflows:

  • gptme — semantic(0.18)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • cursor-agent — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (56%)
  • agent-studio — semantic(0.16)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • PairCoder — semantic(0.38)+rare_topics+same_lang+similar_pop+shared_platform (52%)
  • mcp-gemini-search — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is bigcodebench?

bigcodebench is [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI. It is categorized as a Agent Tool with 485 GitHub stars.

What programming language is bigcodebench written in?

bigcodebench is primarily written in Python. It covers topics such as agent, agents, benchmark.

How do I install or use bigcodebench?

You can find installation instructions and usage details in the bigcodebench GitHub repository at github.com/bigcode-project/bigcodebench. The project has 485 stars and 64 forks, indicating an active community.

What license does bigcodebench use?

bigcodebench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools