Eval

by ai-twinkle · AI Tool · ★ 94

About Eval

High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.

evalevaluationllm

Quick Facts

Stars94
Forks16
LanguagePython
CategoryAI Tool
LicenseMIT
Quality Score41.75/100
Open Issues18
Last Updated2026-04-11
Created2025-03-31
Platformspython
Est. Tokens~202k

Compatible Skills

These tools work well together with Eval for enhanced workflows:

  • RagScore — semantic(0.19)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • mcp-interviewer — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • eval-view — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • just-eval — semantic(0.58)+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • toolbench — semantic(0.22)+complementary+same_lang+similar_pop+shared_platform (53%)

More AI Tool Tools

Explore other popular ai tool tools:

View all AI Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is Eval?

Eval is High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.. It is categorized as a AI Tool with 94 GitHub stars.

What programming language is Eval written in?

Eval is primarily written in Python. It covers topics such as eval, evaluation, llm.

How do I install or use Eval?

You can find installation instructions and usage details in the Eval GitHub repository at github.com/ai-twinkle/Eval. The project has 94 stars and 16 forks, indicating an active community.

What license does Eval use?

Eval is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse AI Tool tools