VernLLM
Lightweight open-source resilience layer for LLM client calls written in TypeScript.
Open productWhat it does
About VernLLM
VernLLM is an open-source, lightweight resilience layer designed for LLM client calls. Built from the ground up in TypeScript, it equips applications with essential execution primitives—including retries, timeouts, rate limiting, circuit breaking, and provider fallbacks—to eliminate writing repetitive custom defensive code. VernLLM maintains zero runtime dependencies and avoids bundling provider SDKs or validator libraries.
- Availability:
- launched
- Access:
- free
- Format:
- software
Pricing at launch: MIT licensed open source software
Core capabilities
Resilience Primitives
Provides retries, timeouts, provider fallback, rate limiting, and circuit breaking primitives for managing LLM API calls with sensible defaults.
Provider Fallback Execution
Runs declared backup provider targets whenever primary provider calls fail and fallback policy conditions allow the transition.
Cached Call Execution
Keep discovering
Related debuts
Continue with products that solve a similar problem or serve the same kind of maker.
