Tracely
Open-source LLM observability platform providing trace-native CI/CD release gates for AI agents.
Open productWhat it does
About Tracely
Tracely is an open-source LLM observability platform that delivers trace-native CI/CD for AI agents. By auto-instrumenting popular agent frameworks and LLM integrations such as LangChain, LangGraph, LiteLLM, OpenAI, and Anthropic, Tracely captures execution traces, grades incoming runs, and clusters failure modes into manageable issues. It freezes failed production runs into hermetic test cases that replay against recorded fixtures without incurring model fees or requiring live API keys, allowing developers to convert production incidents into automated CI release gates that block regressive pull requests.
- Availability:
- launched
- Access:
- freemium
- Format:
- software
- Platform:
- api
Pricing at launch: MIT-licensed open-source software free to self-host, with a hosted free tier and a $49/month Team plan.
Core capabilities
Trace Grading & PR Blocking
Evaluates agent traces on arrival, clusters failure patterns into tracked issues, converts bad runs into replayable test cases, and blocks pull requests that reintroduce past bugs.
Keep discovering
Related debuts
Continue with products that solve a similar problem or serve the same kind of maker.
