Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · AI role: AI-Assisted

Traditional workflow product augmented with AI features

317 products
Products and research metrics
ProductVisits · OctActions
LangfuseMCPOSSOpen Source Agent Evals &Observability586K
Pydantic LogfirePydantic Build agents you’ll actually ship to production356.6K
MLflowOSSDeliver High-Quality AI, Fast148K
Future AGIMCPOSSBuild self-improving agents. Catch what breaks. Know why. Fix it. Ship smarter every time.121.7K
PromptLayerThe collaboration layer for AI engineering teams85.9K
NeuralTrustOpen your enterprise to AI agents. Safely.74.5K
World of AI BenchWhich AI model should you build with?58.7K
HeliconeOSSBuild Reliable AI Apps57.2K
RagasOSSOpen source framework for testing and evaluating LLM applications.52.9K
LangWatchOSSTrace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.52.1K
OpenlayerOSSEvery AI system in your company.48.4K
Claude TunerOSSKnow when your AI limit hits — and when it's back46.5K
AlationLet's Get Your AI Right43.6K
ArcjetMCPOSSAgents can act. Arcjet decides whether they should.39K
SpacePromptsSave, organize, and reuse every prompt that works.38.5K
VerifyWiseOSSKnow every AI system you are running.37.3K
NeuronpediaOSSExplore, visualize, and steer the internals of AI models.28.6K
Oso CloudOSSVisibility and controls to secure agents.28.1K
AI Security GuardUsing AI agents? Protect yourself at all times.20.9K
禾维 AITests major AI models and ranks API relay services.17K
HumanloopOSSHumanloop joins Anthropic15.4K
PrefactorEvaluate your AI agents all the time.14.3K
SuperPromptsMCPSystem prompts out of your codebase. Edit in a UI, publish a version, fetch it with one call.12.4K
KastraMCPAuthorization for AI systems.10.6K
TokenBarOSSEvery token. A clearer picture.9.8K
OpenAPPAMCPOSSWhat is OpenAPPA9.4K
Free LLM PlaygroundFree instant access to 50+ models from top LLM providers. No signup, no API keys. Side-by-side compare, share links, transparent daily limits.9.4K
HoneyHiveMCPOSSProduction AI starts with observability.8.8K
promptpandaConsistent AI Marketing, Powered by Team Prompt Management7.9K
SpanTurn eng time and tokens into better outcomes7.1K
OpenlitOSSOpen source Agent Harness Engineering Platform6K
AgentTuneMCPOSSMake your AI easier to work with.5.6K
TracklyFind what's wrong with your AI — and fix it.5.6K
OpenPromptCreate. Use. Share.5.3K
PromptDrivePrompt collaboration: ChatGPT, Claude, and Gemini in one place5.3K
znMCPOSSYour coding agent works with your code, not your secrets.<5K
OneAIWorldOne Prompt. Every AI Model.<5K
CalcisOSSStop your agent before it spends what you can't afford.<5K
WaxellNo AI in your company acts until Waxell says yes.<5K
PromnestMCPYour prompt library with version control<5K
AI Daily CheckOSSHow is AI actually performing today?<5K
Prompt01Manage every prompt with more clarity, speed, and trust<5K
PromptOwlMCPEvery AI your team uses should already know your business — and you should be able to prove what it knows.<5K
TrainlyFind the AI failures your monitoring misses.<5K
ZestShip better AI code.<5K
InfiniumMCPTHE COST OFBLINDINTELLIGENCE.<5K
OriginMCPOSSSource Code Managementfor the agent era<5K
LockLLMAll-in-One AI Proxy<5K
AgentsmithOSSDEVELOP AGENTS WITHPEACE OFMIND<5K
GuardrlyMCPOSSAI Agent API Monitoring for Shopify and Meta Ads<5K
Page 1 of 7 · Showing 1–50 of 317 products