Voker (YC S24) – Analytics for AI Agents

Hey HN, we're Alex and Tyler, co-founders of Voker.ai (https://voker.ai/), an agent analytics platform for AI product teams. Voker gives full visibility into what users are asking of your agents, and whether your agents are delivering, without having to dig through logs. Our main product is a lightweight SDK that is LLM stack agnostic and purpose-built for agent products. (https://app.voker.ai/docs)Agent Engineers and AI product teams don’t have the right level of visibility into agent performance in production, which results in bad user experiences, churn, and hundreds of hours wasted with spot checks to find and debug issues with agent configurations.Demo: https://www.tella.tv/video/vid_cmoukcsk1000i07jgb4j65u67/vie...We recently conducted a survey of YC Founders and 90%+ of respondents said that the only way they know if their Agents are failing users in production is by hearing complaints from customers. They push a prompt change hoping that it fixes the problem and doesn’t break something somewhere else, and the cycle repeats.We saw tons of observability and evals products popping up to try to address these problems, but we still felt like something was missing in the agent monitoring stack. Obs is good for individual trace debugging but is only accessible to engineers. Evals are good for testing known issues, but don't give insights into trends that teams don’t expect, so engineers are always playing catch up. Traditional product analytics tools do a good job tracking clicks and pageviews across your product surface but weren’t built ground up for agent products. Knowing what users want out of agents, and whether the agent delivered requires specific conversational intelligence / unstructured data processing techniques.We came up with the agent analytics primitives of Intents, Corrections, and Resolutions to describe something pretty much all conversational agents had in common: a user will

Hacker NewsToolAISource
0Sign in to voteCopy link

FL score

78

out of 100

Verdict

BUILD

high confidence

Competition

No competitor data yet

Trend

No signal yet

Purpose-built analytics platform that translates agent behavior into actionable product insights for AI teams, filling the gap between raw observability and business outcomes.

The pain

AI product teams are flying blind in production, 90%+ only discover agent failures through customer complaints. They lack visibility into what users actually want from agents and whether agents deliver, forcing expensive manual debugging cycles and risky blind prompt changes.

The gap

Existing solutions are fragmented: observability tools require engineering access and show traces not trends; evals catch known issues but miss unexpected patterns; traditional product analytics ignore conversational/unstructured data. No tool bridges agent behavior to product-level insights.

Build angle

Start with the three primitives (Intents, Corrections, Resolutions) as the semantic layer that makes agent conversations legible to non-engineers. Build dashboards that surface trends and anomalies automatically, then expand into predictive insights and automated remediation.

Strengths

  • Massive TAM: Every AI agent company needs this; market is nascent with high willingness to pay
  • YC validation: S24 cohort, founders understand the problem deeply from inside the ecosystem
  • Clear positioning: Sits between observability and evals with unique angle on conversational intelligence
  • LLM-agnostic SDK: Reduces switching costs and increases addressable market
  • Founder-market fit: Solving a problem they likely experienced building agents themselves
  • Timing: Agent products are exploding; this is table-stakes infrastructure

Risks

  • Competitive moat unclear: Observability platforms (Datadog, New Relic) and evals companies (Braintrust, Humanloop) could add agent-specific features quickly
  • Customer acquisition: Selling to engineering teams is hard; product analytics adoption requires org-wide buy-in
  • Data privacy/security: Handling conversational data at scale raises compliance concerns (PII, data residency)
  • Churn risk: If customers solve the problem with prompt engineering or better base models, demand evaporates
  • Integration complexity: SDK adoption requires engineering effort; network effects are weak
  • Market timing: Might be too early if agent products themselves are still finding product-market fit

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Voker (YC S24) – Analytics for AI Agents”.

Open FlyBot