I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

Open source127 GitHub stars49 forksLocal-first4 measured provider planes
Category
DevTools / AI cost observability / billing-integrity
Business model
Open-core/complementary product: free local open-source proxy plus a commercial hosted product sold by Inferock, as disclosed in the README. Public pricing and packaging are not visible.
Target audience
Platform, backend, and FinOps/billing-integrity engineers managing metered LLM API traffic on OpenAI, Anthropic, Gemini, and OpenRouter.
Opportunity score
61/100

A credible open-source wedge into a real AI billing-integrity problem with meaningful expansion potential, but commercial traction is unproven and the category is crowded.

Founder verdict
MAYBE

Inferock Bench is a credible open-source wedge into AI billing integrity, but not yet a validated business.

What is Inferock Bench?

Inferock Bench is an open-source local proxy that records per-call evidence for LLM API spend and produces billing-integrity receipts. It explicitly positions itself as an independent check on provider self-billed usage, failures, and credits, while separating observations from interpretations. The repo is early but has clear technical design, multi-provider coverage, and a disclosed commercial hosted product from Inferock.

Get the full Inferock Bench playbook

The complete reverse-engineering โ€” what to copy, what to avoid, and exactly what to build instead.

Unlock full startup intelligence โ€” $39.99