AI automation tools inefficient for desktop app control: VALIDATE, 72/100 | Ideas Lab

Build native desktop app control APIs that let AI agents directly manipulate applications instead of relying on brittle screenshot analysis.

The pain

Current AI automation tools waste 60-80% of compute on vision processing, fail on UI changes, and can't handle real-time interactions, making RPA prohibitively expensive and unreliable for enterprise workflows.

The gap

No standardized, lightweight protocol exists for AI agents to directly interface with desktop applications. Apps lack machine-readable control layers that bypass the GUI entirely.

Build angle

Create an open SDK/protocol (similar to accessibility APIs but AI-native) that app developers can embed, enabling agents to query app state and execute commands directly. Start with 3-5 high-value apps (Salesforce, SAP, Excel) as reference implementations.

Strengths

Clear technical problem with quantifiable inefficiency (cost/speed)
Large TAM: enterprise RPA market ($15B+) actively seeking better solutions
Network effects: more apps with SDK = more valuable platform
Defensible: becomes infrastructure layer if adopted early
Timing: AI agents maturing, enterprises desperate for automation

Risks

Requires app vendor buy-in (chicken-egg problem); hard to get adoption without critical mass
Fragmentation risk: each app implements differently unless standard emerges
Existing players (UiPath, Automation Anywhere) have distribution; they could copy quickly
Security/compliance concerns: direct app access may face enterprise resistance
Unproven demand: enterprises may accept screenshot inefficiency if it 'just works'
Technical debt: maintaining compatibility across app versions is ongoing burden

Fly Labs Method

Is the pain real, is there a gap, is it the right time, can one person build it.

72

Value Equation

Dream outcome and how likely it feels, against the time and effort it costs.

68

One-Person Business

Curiosity pull, identity fit, and a path from free value to paid for a solo creator.

75

Viral Frameworks

Hook strength, shareability, and how cheaply it can be tested.

70

Builder Lens

Evidence the problem exists, timing, defensibility, and a model that fits on a napkin.

73

Five lenses, one composite. How scoring works

The angle

Create an open SDK/protocol (similar to accessibility APIs but AI-native) that app developers can embed, enabling agents to query app state and execute commands directly. Start with 3-5 high-value apps (Salesforce, SAP, Excel) as reference implementations.

No market research recorded for this idea yet.

Excessive CAPTCHA challenges degrading GitHub login UX for enterprise users

GitHub's anti-bot protection forces users, especially those with organizational emails, to solve 10 blurry puzzles multiple times, creating an extremely painful and frustrating user experience.

Dev

BUILD

86FL score

GTA modders tediously manually edit assembly files for modpacks

Creating .oiv modpacks for GTA is tedious and error-prone due to buggy project manager software, forcing manual editing of assembly files.

Dev

BUILD

85FL score

BreezePDF – Free, in-browser PDF editor

BreezePDF lets you edit, sign, merge, compress, redact, OCR, fill forms, extract tables, and use 30+ more PDF tools — all in the browser, no sign-up. Files never leave your computer.I built it because when people search Google for common PDF tasks, many of the tools they find upload documents to a server. I wanted an option that keeps files local instead.I posted an earlier version on HN last spring: https://news.ycombinator.com/item?id=43880962At the time it only supported a small set of features. Over the last 10 months I rebuilt large parts of it and expanded it to nearly 40 tools, including several ideas that came from comments in that earlier thread.There is also now a desktop app for macOS, Windows, and Linux, plus a CLI/SDK for developers.

Dev

BUILD

85FL score

All Dev ideas