by sgl-project · Agent Tool · ★ 298
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
| Stars | 298 |
| Forks | 51 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 37.75/100 |
| Open Issues | 17 |
| Last Updated | 2026-05-14 |
| Created | 2025-06-19 |
| Platforms | python |
| Est. Tokens | ~188k |
Explore other popular agent tool tools:
genai-bench is Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.. It is categorized as a Agent Tool with 298 GitHub stars.
genai-bench is primarily written in Python.
You can find installation instructions and usage details in the genai-bench GitHub repository at github.com/sgl-project/genai-bench. The project has 298 stars and 51 forks, indicating an active community.
genai-bench is released under the MIT license, making it free to use and modify according to the license terms.