InferenceBench

About InferenceBench

InferenceBench: A Benchmark for Open-Ended LLM Inference Optimization by AI Agents This is the official repository for the paper "InferenceBench: A Benchmark for Open-Ended LLM Inference Optimization by AI Agents". Authors: Jehyeok Yeon, Ben Rank, Maksym Andriushchenko Overview InferenceBench measures whether autonomous CLI agents can act as ML systems engineers in a genuinely open-ended setting.

ai-evals ai-research-automation ai-safety benchmarks claude-code codex-cli sglang vllm

Quick Facts

Stars	41
Forks	6
Language	Python
Category	Codex Skill
License	Apache-2.0
Quality Score	56.060059574611/100
Last Updated	2026-07-06
Created	2026-04-30
Platforms	claude-code, cli, codex, python
Est. Tokens	~13k

Compatible Skills

These tools work well together with InferenceBench for enhanced workflows:

Terradev — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (65%)
Awesome-AI-Evaluations-Tools — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (61%)

More Codex Skill Tools

Explore other popular codex skill tools:

openclaw ⭐ 391.5k
hermes-agent ⭐ 251.6k
ui-ux-pro-max-skill ⭐ 133.4k
agent-skills ⭐ 101.6k
open-design ⭐ 99.6k
taste-skill ⭐ 90.3k
orca ⭐ 86.3k
graphify ⭐ 77.1k
career-ops ⭐ 73.6k
career-ops ⭐ 69.6k

View all Codex Skill tools →

Popular Python Agent Tools

hermes-agent ⭐ 251.6k · Codex Skill
AutoGPT ⭐ 187.7k · Agent Tool
skills ⭐ 179.8k · Claude Skill
langflow ⭐ 155.5k · Agent Tool
open-webui ⭐ 154.1k · MCP Server

Frequently Asked Questions

What is InferenceBench?

InferenceBench is Benchmarking Open-Ended Inference Optimization by AI Agents. It is categorized as a Codex Skill with 41 GitHub stars.

What programming language is InferenceBench written in?

InferenceBench is primarily written in Python. It covers topics such as ai-evals, ai-research-automation, ai-safety.

How do I install or use InferenceBench?

You can find installation instructions and usage details in the InferenceBench GitHub repository at github.com/aisa-group/InferenceBench. The project has 41 stars and 6 forks, indicating an active community.

What license does InferenceBench use?

InferenceBench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Codex Skill tools