What is Inferock Bench?

Inferock Bench is a local diagnostic proxy that sits between your app and LLM providers (OpenAI, Anthropic, Gemini, OpenRouter) to track token usage, failure rates, and generate independent receipts for billing integrity.

How does Inferock Bench protect API keys?

It runs locally on your host machine. API keys are attached strictly to outgoing provider requests and are not sent to Inferock servers.

Which LLM provider APIs are supported by Inferock Bench?

It supports OpenAI, Anthropic, Gemini Developer API, and pinned OpenRouter endpoints.

What are the prerequisites to run Inferock Bench?

Node.js version 22 or newer with npm is required to execute the bench locally.

Nobody owns this listing yet

Inferock Bench is live in the directory, but no verified owner controls the page.

Claim this listing

Pick your launch day — Schedule a launch and compete for the daily #1 spot.
Win trophies you can embed — Rank top 3 on launch day and get an embeddable trophy.
“Featured on AI Kaptan” badge — Owner-only badge with your live upvote count.
Control what the page says — Edit copy, pricing, links and screenshots as the owner.

Unclaimed listings don't stay up forever. Listings left unclaimed are removed from the directory in periodic cleanups. When a listing goes, it goes everywhere — the tool page and every alternatives comparison it appears on, along with the rankings and backlinks that page had built up.

Verify with a work email on the domain (about 2 minutes), then a one-time $5 listing fee. See everything you get

Scheduled launch — Aug 16, 2026

Inferock Bench is listed on AI Kaptan and will enter the daily launch competition on that day. Community upvotes open on launch day.

Developer Tools

Free

Inferock Bench

Inferock Bench is a local proxy that tracks LLM API calls, token usage, failures, and retries, generating an independent per-call receipt to audit overpaying and billing integrity.

Visit WebsiteView Alternatives

—

Rating

Reviews

Upvotes

about 3 hours ago

Listed

Open Source

Developer Tools

Artificial Intelligence

LLM Evaluation

Cost Tracking

API Proxy

Benchmarking

Tool information

Provider

Inferock

Platforms

Mac

Windows

Linux

Languages

TypeScript

Added to directory

about 3 hours ago

Last updated

about 3 hours ago

Rating

Not available

Pricing

Free

About Inferock Bench

What the tool does and who it's for

Inferock Bench is an open-source local proxy designed for AI/LLM developers to track API costs, token usage, and billing integrity. Sitting locally between an application and LLM provider endpoints like OpenAI, Anthropic, Gemini, or OpenRouter, it captures per-call token counts, retries, timeouts, and failures. It generates an independent per-call receipt to detail actual spend, time lost, money loss from failed/incomplete calls, and billing discrepancies.

Key capabilities

Local diagnostic proxy intercepting LLM traffic on localhost

Generates independent per-call billing and usage receipts

Per-call tracking of token counts, latency, retries, and failure states

Support for OpenAI, Anthropic, Gemini, and OpenRouter API endpoints

Separates provider spend, bill-bounded money loss, time loss, and invoice-check exposure

Local-first design preserving provider API keys on host machine without telemetry transmission

Audit evidence capture for failed, truncated, timed-out, or 504 status API calls

Open-source implementation built with Node.js and TypeScript

Pricing

Free — plans below

Free / Open Source

Reviews

Be the first to review Inferock Bench

No reviews yet

Be the first to share your experience with Inferock Bench.

Featured Tools

Handpicked by our team of experts

Suggest an Update

Found outdated information? Help us keep this listing accurate.

FAQ

Inferock Bench FAQs

Common questions about Inferock Bench