What should the GUI for AI agents look like?

Hi HN! We’re Akilan and Miguel, the creators of MarbleOS.The inspiration for Marble comes from the GUI work at Xerox PARC, the 1984 Macintosh, and later NeXTSTEP, which became the foundation for Mac OS X. Before GUIs, interacting with a computer was limited to strange terminal commands:C:\> DIRC:\> COPY FILE.TXT A:You had to remember the command, syntax, paths, and parameters.The GUI made those capabilities visible. Instead of remembering commands, you could point at files, drag them, click buttons, and select actions from menus. It didn't necessarily make entirely new things possible; it just made existing capabilities much easier to understand and use. We feel like AI is still somewhere around this command-line stage.Even though the strict syntax has been replaced with natural language, the interaction can still be quite stiff and depend on heavily recall. Tools like Claude Cowork still look surprisingly terminal-like: /skill-name [param1] [param2]. The parameters are written in natural language, but the user still needs to know the capabilities that exist, and how to invoke it. Command-line flags and arguments have just been replaced with tools, skills, and context.ChatGPT works very well for asking questions, but we aren't convinced that it's the final interface for delegating work across multiple agents. A blank text box and a list of chat threads feels limiting. An agent's capabilities are mostly invisible. With Marble, we're exploring an interface that treats AI more like a workspace than another chat app. Each delegated task becomes a card. Multiple jobs can sit next to each other and run at once. Files, tools, and finished artifacts are visible at once. Before a task runs, Marble also shows which tools it expects to use. The basic idea is that the user should not have to hold the entire structure of the task in their head. And the result should be something directly usable, like a spreadsheet, PowerPoint, or other file, r

Hacker NewsToolAISource
0Sign in to voteCopy link

FL score

72

out of 100

Verdict

VALIDATE

high confidence

Competition

No competitor data yet

Trend

No signal yet

A visual workspace for AI agents that replaces chat interfaces with card-based task management, showing tool usage and outputs simultaneously.

The pain

Users struggle with multi-step AI workflows because chat interfaces hide agent capabilities, require manual recall of what tools exist, and produce outputs scattered across conversations. Complex tasks demand holding entire task structures in working memory. Results often need reformatting before use.

The gap

Current AI tools (Claude, ChatGPT) excel at single-turn Q&A but lack visual affordances for orchestrating parallel tasks, previewing tool selection, or managing artifacts. The interface hasn't evolved beyond text-in-text-out despite agents becoming more capable. No standard exists for how to make agent reasoning and capabilities visible.

Build angle

Start by validating whether knowledge workers actually want visual task management for AI work, or if they're satisfied with chat. Build for a specific workflow (e.g., research + report generation, data analysis + visualization) rather than a general agent OS. Focus on making tool selection visible before execution and ensuring outputs are immediately usable files, not chat snippets.

Strengths

  • Strong historical analogy (CLI to GUI) that resonates with how interfaces evolve
  • Addresses a real friction point: chat UIs genuinely hide agent capabilities and create context switching
  • Concrete design direction (cards, parallel execution, visible tools) rather than vague
  • Timing aligns with agent frameworks becoming production-ready
  • Founders have shipped before (credibility signal)

Risks

  • Assumes users want visual task management; many may prefer chat simplicity for occasional use
  • Competes against entrenched chat interfaces (Claude, ChatGPT) with massive distribution and switching costs
  • Unclear if the problem is UI or underlying agent reliability, better UX won't help if agents fail unpredictably
  • No mention of how this integrates with existing tools/APIs; could be a standalone toy
  • Market may consolidate around OpenAI/Anthropic adding these features natively before this ships
  • Requires users to adopt a new tool + new mental model simultaneously

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “What should the GUI for AI agents look like?”.

Open FlyBot