Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Target audience: Developers & Engineering Teams

835 products
Products and research metrics
ProductVisits · OctActions
Conversation ExplorerTurn every AI conversation into insights your team can act on.<5K
TokenUseOSSTokenUse – Token & Cost Observability for Developers<5K
TestMyPromptTest your chatbot's prompts before your users do.<5K
AgentShieldAI agent spend firewall<5K
Prompt EvalStop guessing if your prompt is good. Measure it.<5K
AgentInterdictMCPOSSYour agent is one document away from a breach.<5K
TraceboxMCPSee exactly what your AI agent saw.<5K
CohesorControl Plane for AI Agents<5K
SwarmTraceTime-travel debugger for multi-agent AI pipelines<5K
WickMCPOSSClaudeisburningthroughyourtokens.Watchithappen.<5K
AEGISOSSEnforce policy between your app and any LLM<5K
CuTokenCuToken Multi-Pass Token Optimizer<5K
StraxisWallYour Agents. Under Control.<5K
AgentDiffOSSCatch silent cost surges and broken agent loops before they ship.<5K
RavenRaven | Free AI System Prompt Vulnerability Scanner<5K
Prompt OptimizerOptimize prompts for any AI in seconds.<5K
TrasysMonitor Every AI Request. Understand Every TokenTracked<5K
GQueriesGrounded memory and authorized evidence for production AI<5K
GateCore AIMCPControl what AI agents access, do, and spend.<5K
Unplug AIMCPOSSPull the plug on bad AI.<5K
InspectModularSee what your AI agents read before every API call.<5K
CloudByte PMSKnow exactly how your team uses AI, and what it ships.<5K
sentinelscaAuthority before action.<5K
HuqanMCPOSSVerify AI claims before agents act.<5K
AI Cost GateEvery AI cent, in a box you own. — AI Cost Gate<5K
ReclaimLLMMCPKeep secrets out of LLMs. Observe, secure, and flag sensitive AI sessions.<5K
WAILAI Runtime Control & Governance Layer<5K
Agent LookerYour AI Agent's Lighthouse.<5K
TheMegaPromptTurn your idea into a production-ready Mega-Prompt for Apps & Websites<5K
TokenSwift ProCut Prompt Tokens Significantly Without Losing Accuracy<5K
policyctlOSSGive your coding agents guardrails, not guidelines.<5K
DocSanitizerCensor private data & shrink docs to fit into any AI prompt<5K
MCPulseMCPOSSFind out which of your tools agents get wrong<5K
NuggetsThe trust layer for autonomous AI.<5K
MiloMCPOSSTest your AI support agent before your customers do.<5K
HELIOSH E L I O S<5K
Logify360OSSYour LLM bill. Explained.<5K
AtlasBurnOSSYour AI bill tells you what happened.AtlasBurn tells you WHY.<5K
AIPromptProStop Writing Bad Prompts! Get 10x Outputs in 1-Click<5K
Context PassportYour AI Persona & Memory. Portable Across Every Model.<5K
FirstHelmThe AI Agent Control Plane for Autonomous AI<5K
PromptdooPromptdoo: better AI prompts in minutes<5K
NullRunOSSAI agents can delete the database Trust is the mistake.<5K
QAgentYou wouldn’t ship backend code without tests. Stop shipping AI agents on vibes.<5K
PrompticPromptic - Trace, evaluate, and optimize AI agents and LLM prompts<5K
Guardian LayerENTERPRISE AI GATEWAY<5K
MainLayerSee and govern how AI writes code inside your company<5K
AvarodhZero-Trust AI gateway with DSPy routing & semantic caching<5K
TemprMCPLet your team use any AI. Keep control of all of it.<5K
SoftprobePerformance reviews for AI agents<5K
Page 13 of 17 · Showing 601–650 of 835 products