trying ai powered web interaction to automate a gui only app with no api is impossible?

new project needs daily pulls from this ancient windows app. no api, no exports really. support says use their scheduled reports but those lag 24h and miss data. i scripted mouse clicks with python but one update and boom broken. network inspect shows encrypted blobs i cant parse. this definitely doesnt feel like any kind of browser automation infrastructure, just pure survival mode trying to duct tape automation onto something never meant for it. am i missing something obvious? like does everyone just pay for rpa tools? or is there a free way to hook into the process memory or whatever. kinda feels hopeless, maybe just manual copy paste forever. what have you done for stuff like this.

RedditToolProductivitySource
0Sign in to voteCopy link

FL score

62

out of 100

Verdict

VALIDATE

high confidence

Competition

12

competitors found, emerging market, funded players

Trend

8 community mentions

An AI-powered tool to reliably automate data extraction from legacy GUI-only desktop apps, addressing brittleness and high costs of enterprise RPA.

The pain

Businesses and individuals struggle with daily manual data pulls or brittle, frequently breaking scripts for 'ancient' Windows applications that lack APIs. This leads to significant time waste, frustration, and often inaccurate or delayed data, with expensive enterprise RPA being the only 'robust' alternative.

The gap

There's a clear gap for an AI-powered GUI automation solution that is robust (non-brittle), user-friendly, and significantly more affordable than existing enterprise RPA platforms. The current market offers either very complex/expensive tools or highly brittle DIY solutions, leaving a specific underserved audience of small teams/solo builders.

Build angle

Focus on an AI-powered 'agentic' approach that visually identifies and interacts with GUI elements, making it resilient to minor UI changes. Target a specific vertical or common legacy application initially to prove robustness and then expand.

Strengths

  • Addresses a deeply painful and specific problem (brittleness of GUI automation for legacy apps).
  • High willingness to pay for a robust solution that saves significant time/frustration.
  • Aligns with growing market trends in AI and agentic automation.
  • Solves a critical, recurring pain point (daily data pulls).
  • User frustrations with existing solutions (cost, complexity, brittleness) are well-documented and provide a clear angle.

Risks

  • Extremely high technical complexity for a solo builder to create a *truly* robust, generalizable, non-brittle AI-powered solution for desktop apps.
  • Strong incumbents (UiPath, Power Automate) dominate the broader RPA market, despite their cost/complexity.
  • Finding a narrow, identifiable, and reachable niche of legacy app users beyond the user's specific problem.
  • The potential brittleness of an AI-powered solution, especially with diverse, custom, or frequently updated legacy GUIs, could undermine the core value proposition.
  • Long development cycle for an MVP could lead to burnout or market changes.

Next steps

  1. Interview 10-15 potential users (IT managers, data analysts in industries using legacy apps) to deeply understand their specific legacy applications, the exact pain points, frequency of UI changes, and how much they currently spend (time/money) on workarounds or existing RPA.
  2. Research specific legacy software titles that are widely used and lack APIs to identify the most promising 'narrow wedge' for an initial build.
  3. Explore existing open-source computer vision/OCR libraries and AI models for GUI interaction to assess the feasibility of building a *non-brittle* MVP quickly.
  4. Create a landing page and gauge interest for a specific problem statement (e.g., 'Automate data from SAP GUI without API breaks') to validate demand before building.

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “trying ai powered web interaction to automate a gui only app with no api is impossible?”.

Open FlyBot