Screen memory without screenshots, just text to Markdown

It's a macOS menu bar app that reads the text of your focused window every few seconds through the Accessibility API. No screenshots, no video, or OCR. It writes plain markdown, one file per day, into a folder you choose.Point Claude Code (or anything with file access) at the folder and ask "what did I work on Tuesday?" or have it build memory about your projects. The folder contains an AGENTS.md explaining the format to the model.Thought it might be useful for someone so chucked it up on GitHub

Hacker NewsToolAISource
0Sign in to voteCopy link

FL score

62

out of 100

Verdict

VALIDATE

medium confidence

Competition

No competitor data yet

Trend

No signal yet

A macOS menu bar app that converts window text into daily markdown logs for AI-assisted work memory and project recall.

The pain

Knowledge workers lose context about what they did. Screenshots are storage-heavy and privacy-invasive. Existing time-tracking tools are intrusive or require manual logging. When you ask Claude about your week, it has no ground truth about your actual work.

The gap

No existing tool captures continuous text activity without screenshots, OCR overhead, or privacy concerns. Most memory tools either require manual input or create massive video/image files. The accessibility API approach is technically clever but underexploited.

Build angle

Start by validating with 20-30 power users (developers, researchers, writers) who already use Claude daily. Measure: Do they actually query the markdown folder? Do they find answers they couldn't get before? Does it reduce time spent context-switching or re-explaining projects? If yes, expand to a paid tier with cloud sync and better search. If no, the problem isn't real enough.

Strengths

  • Solves a real friction point for Claude power users, context loss between sessions
  • Privacy-first design (text only, local storage) is a genuine differentiator vs. screenshot tools
  • Low technical debt, simple markdown format, no complex infrastructure needed
  • Accessibility API approach is elegant and avoids OCR brittleness
  • Founder already shipped it and got HN traction, showing execution ability

Risks

  • Narrow TAM: only macOS, only useful if you already use Claude or similar AI regularly
  • Unclear monetization, hard to charge for a tool that just writes markdown files
  • Adoption requires behavior change (pointing Claude at a folder, asking the right questions)
  • Accessibility API access can be fragile across macOS updates; support burden is high
  • Competitors could add this feature to existing tools (Cursor, VS Code, Claude itself) with minimal effort
  • No evidence users actually want this, HN upvotes ≠ paying customers

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Screen memory without screenshots, just text to Markdown”.

Open FlyBot