AgentCompass

by open-compass · Codex Skill · ★ 167

About AgentCompass

[EMNLP 2026] AgentCompass is an extensible open-source evaluation infrastructure for systematically assessing LLM/VLM agent capabilities.

agentbenchmark-frameworkclaude-codecodexevaluation-frameworkharness

Quick Facts

Stars167
Forks35
LanguagePython
CategoryCodex Skill
LicenseApache-2.0
Quality Score41/100
Open Issues18
Last Updated2026-10-18
Created2025-09-04
Platformsclaude-code, codex, python
Est. Tokens~520k

Compatible Skills

These tools work well together with AgentCompass for enhanced workflows:

  • coder_eval — semantic(0.22)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • huuuuuuho-skills — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (57%)
  • Eval — semantic(0.31)+complementary+same_lang+similar_pop+shared_platform (56%)
  • myclaw-bench — semantic(0.27)+complementary+same_lang+similar_pop+shared_platform (55%)
  • GateMem — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)

More Codex Skill Tools

Explore other popular codex skill tools:

View all Codex Skill tools →

Popular Python Agent Tools

Frequently Asked Questions

What is AgentCompass?

AgentCompass is [EMNLP 2026] AgentCompass is an extensible open-source evaluation infrastructure for systematically assessing LLM/VLM agent capabilities.. It is categorized as a Codex Skill with 167 GitHub stars.

What programming language is AgentCompass written in?

AgentCompass is primarily written in Python. It covers topics such as agent, benchmark-framework, claude-code.

How do I install or use AgentCompass?

You can find installation instructions and usage details in the AgentCompass GitHub repository at github.com/open-compass/AgentCompass. The project has 167 stars and 35 forks, indicating an active community.

What license does AgentCompass use?

AgentCompass is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Codex Skill tools