Eval

by ai-twinkle · Agent Tool · ★ 110

About Eval

High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.

evalevaluationllm

Quick Facts

Stars110
Forks19
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score41.75/100
Open Issues23
Last Updated2026-09-13
Created2025-03-31
Platformspython
Est. Tokens~783k

Compatible Skills

These tools work well together with Eval for enhanced workflows:

  • SkillEvaluator — semantic(0.37)+complementary+rare_topics+same_lang+similar_pop+shared_platform (63%)
  • Tracely — semantic(0.27)+complementary+rare_topics+same_lang+similar_pop+shared_platform (59%)
  • AgentX-Python — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • RagScore — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • primitive-bench — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is Eval?

Eval is High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.. It is categorized as a Agent Tool with 110 GitHub stars.

What programming language is Eval written in?

Eval is primarily written in Python. It covers topics such as eval, evaluation, llm.

How do I install or use Eval?

You can find installation instructions and usage details in the Eval GitHub repository at github.com/ai-twinkle/Eval. The project has 110 stars and 19 forks, indicating an active community.

What license does Eval use?

Eval is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools