Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

Hacker NewsToolOtherSource
0Sign in to voteCopy link

FL score

72

out of 100

Verdict

VALIDATE

medium confidence

Competition

No competitor data yet

Trend

No signal yet

A technical achievement that runs a large language model locally on phones, but lacks a clear business model or customer problem it solves.

The pain

Developers and power users want AI capabilities without cloud dependency, latency, or privacy concerns. Currently they're forced to use cloud APIs or accept slow local inference.

The gap

The gap between 'technically possible' and 'commercially viable' is massive here. Running 120 tok/s on iPhone is impressive engineering, but there's no articulated use case, pricing model, or distribution strategy. Who buys this and why? What do they do with it that they can't do today?

Build angle

If pursuing this: Start by identifying one specific use case where on-device inference creates measurable value (e.g., offline note-taking with AI, privacy-critical medical apps, gaming NPCs). Build a vertical product first, not a general-purpose tool. Prove users will pay before optimizing the model further.

Strengths

  • Genuine technical differentiation, 120 tok/s on-device is non-trivial and hard to replicate
  • Addresses real constraints: latency, privacy, offline capability
  • Ternary quantization is novel and could be defensible IP
  • Growing market demand for edge AI as regulations tighten around data

Risks

  • No clear customer segment or willingness-to-pay signal
  • Apple controls the platform and could replicate this internally
  • Battery drain and thermal throttling on sustained use are unaddressed
  • Competing against free cloud APIs (ChatGPT, Claude) with inferior model quality
  • Requires developer adoption, high friction, low margins
  • Model quality at 20B ternary may be insufficient for real applications
  • Hackernews showcase ≠ market validation

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone”.

Open FlyBot