Captain (YC W26) – Automated RAG for Files

Hi HN, we’re Lewis and Edgar, building Captain to simplify unstructured data search (https://runcaptain.com). Captain automates the building and maintenance of file-based RAG pipelines. It indexes cloud storage like S3 and GCS, plus SaaS sources like Google Drive. There’s a quick walkthrough at https://youtu.be/EIQkwAsIPmc.We also put up this demo site called “Ask PG’s Essays” which lets you ask/search the corpus of pg’s essays, to get a feel for how it works: https://pg.runcaptain.com. The RAG part of this took Captain about 3 minutes to set up.Here are some sample prompts to get a feel for the experience:“When do we do things that don't scale? When should we be more cautious?” https://pg.runcaptain.com/?q=When%20do%20we%20do%20things%20...“Give me some advice, I'm fundraising” https://pg.runcaptain.com/?q=Give%20me%20some%20advice%2C%20...“What are the biggest advantages of Lisp” https://pg.runcaptain.com/?q=what%20are%20the%20biggest%20ad...A good production RAG pipeline takes substantial effort to build, especially for file workloads. You have to handle ETL or text extraction, chunking, embedding, storage, search, re-ranking, inference, and often compliance and observability – all while optimizing for latency and reliability. It’s a lot to manage. grep works well in some cases, but for agents, semantic search provides significantly higher performance. Cursor uses both and reports 6.5%–23.5% accuracy gains from vector search over grep (https://cursor.com/blog/semsearch).We’ve spent the past four years scaling RAG pipelines for companies, and Edgar’s work at Purdue’s NLP lab directly informed our chunking techniques. In conversations with dozens of engineers, we repeatedly saw DIY pipelines produce inconsistent results, even after weeks of tuning. Many teams lacked clarity on which retrieval strategies best fit their data.We realized that a system t

Hacker NewsMar 13ToolAISource

FL score

out of 100

Verdict

VALIDATE

high confidence

Competition

competitors found, emerging market, funded players

Trend

8 community mentions

Automated RAG for Files simplifies building and maintaining production-ready LLM pipelines from unstructured data, targeting engineers frustrated with complex frameworks and partial solutions.

The pain

Building and maintaining production-grade Retrieval Augmented Generation (RAG) pipelines for unstructured files (from cloud storage or SaaS) is incredibly complex, time-consuming, and often leads to inconsistent results. Engineers struggle with ETL, chunking, embedding, storage, search, re-ranking, compliance, and observability, even with existing frameworks, which are clunky, hard to debug, or only solve part of the problem.

The gap

While many tools and frameworks exist (LangChain, LlamaIndex, Haystack, Unstructured.io, Vertex AI Search), they either offer only partial solutions (e.g., just extraction), are overly complex and hard to debug, or lack full automation across the entire RAG pipeline. There's a gap for a truly automated, end-to-end, 'done-for-you' RAG solution for files that delivers consistency and simplicity, particularly for specific use cases or user types.

Build angle

Develop an automated platform that ingests unstructured data from common cloud/SaaS sources (S3, GCS, Google Drive), handles the entire RAG pipeline (ETL, optimized chunking, embedding, storage, search, re-ranking) with minimal setup, and focuses on delivering consistent, high-accuracy results for specific file types or industry verticals. Start with a very narrow, demonstrable use case that showcases extreme simplicity and superior performance compared to existing options.

Strengths

Addresses a significant, well-documented, and growing pain point in the AI/LLM industry.

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Captain (YC W26) – Automated RAG for Files”.

Open FlyBot

Fly Labs Method

Is the pain real, is there a gap, is it the right time, can one person build it.

Problem clarity: 27
Solution gap: 19
Willingness to pay: 18
Buildability: 7

Captain tackles a significant pain point in building and maintaining RAG pipelines, with clear user frustrations about existing solutions. However, the market is highly competitive and the complexity of building a truly automated, robust solution for files is a very high bar for a solo builder.

Value Equation

Dream outcome and how likely it feels, against the time and effort it costs.

Captain has a strong value proposition in a growing market with clear pain, but building a defensible, comprehensive solution against well-funded incumbents is a significant challenge.

One-Person Business

Curiosity pull, identity fit, and a path from free value to paid for a solo creator.

Captain leverages strong founder expertise to address a clear problem, but the sheer complexity of the solution and market competition make it a challenging solo endeavor.

Viral Frameworks

Hook strength, shareability, and how cheaply it can be tested.

Captain has a clear value prop for a specific audience, but faces significant distribution challenges and high assumption risks in a competitive, complex market.

Builder Lens

Evidence the problem exists, timing, defensibility, and a model that fits on a napkin.

Captain addresses a high-demand, growing problem in the AI space with a clear target user, but the 'narrowest wedge' and initial validation against entrenched competition need refinement.

Why this verdict

The idea for Captain addresses a real and acute problem in a rapidly growing market, backed by strong founder expertise. However, the 'crowded' competitive landscape, coupled with the immense technical challenge of building a truly robust and automated RAG solution as a solo builder, significantly increases risk. While there are clear complaints about existing tools, convincing users to switch to another new tool in such a complex and competitive space requires extremely strong validation and a precisely targeted, highly effective 'narrowest wedge'. It's a high-potential area, but too risky for a full build without further, very specific validation.

Five lenses, one composite. How scoring works

The angle

This weekend

Deeply interview specific target users (e.g., developers at mid-sized e-commerce companies struggling with product documentation RAG) to validate that current solutions' frustrations are truly severe enough to pay for a new, automated alternative.
Identify the absolute narrowest, most painful, and easiest-to-serve vertical/use case (e.g., specific file types within a specific cloud storage for a particular LLM use case) that can be fully automated with a demonstrable, quantifiable improvement.
Develop a robust proof-of-concept for this narrow use case, focusing on ease of setup and measurable performance gains over a 'DIY + LangChain/LlamaIndex' baseline.
Explore partnerships or integrations with existing specialized tools (like Unstructured.io for parsing) to reduce build complexity, rather than reinventing every component of the pipeline.

Who is already there, emerging market

LangChainFundedVisit
A flexible framework for building LLM-powered applications, emphasizing orchestration of prompts, tools, and agents.
Pricing: Open-source and free to use; offers a managed service with potential costs.
LlamaIndexFundedVisit
A data framework focused on connecting custom data sources to LLMs for retrieval-augmented generation (RAG).
Pricing: Free plan available, Starter ($50/month), Pro ($500/month), Enterprise (contact for pricing).
Haystack (by deepset)FundedVisit
An open-source framework for building production-ready LLM applications, particularly strong in document-centric RAG pipelines and semantic search.
Pricing: Free to use; contact deepset for Haystack Enterprise pricing.
Unstructured.ioFundedVisit
A document parsing and extraction platform that transforms unstructured documents into structured data elements for AI applications.
Pricing: Offers open-source version, and API services with improved performance and enterprise features. Pricing for API covers extraction only; other costs are separate.
Vertex AI Search (Google Cloud)FundedVisit
A managed AI platform that offers an agent builder and RAG features as part of the Google Cloud ecosystem.
Pricing: Part of Google Cloud pricing, usage-based.
FlowiseAIFundedVisit
An open-source, low-code platform for building LLM applications and agents with a visual canvas.
Pricing: Free plan available, Starter ($35/month), Pro ($65/month), Enterprise (contact for pricing).
VectorizeFundedVisit
A platform designed to transform unstructured data into optimized vector search indexes, facilitating retrieval-augmented generation pipelines.
Pricing: Not explicitly stated on public pages, but focuses on transforming unstructured data to optimized vector search indexes.

Funded players

What they charge

The pricing landscape for RAG solutions is varied, with both open-source frameworks (like LangChain, LlamaIndex, and Haystack) offering free usage, alongside managed services and enterprise-grade platforms. Free tiers are common for open-source tools, while paid plans for managed services or enhanced features can range from $35-$50/month for basic tiers to $500/month or custom enterprise pricing for more extensive usage and support. Some specialized tools, like Unstructured.io, focus on specific parts of the RAG pipeline (e.g., document extraction) and charge for those services, with additional costs for other infrastructure.

What people say, 8 mentions

I built a mobile IV therapy company from $0 to $2M in 12 months, merged it into a competitor I ran as CEO and scaled from $2.4M to $10M, stepped down, and started completely over. 3 months in 2026 and we're doing $250K/month.
r/Entrepreneur
My YouTube videos get 100 views. They generate $12,000/month.
r/SaaS
I've seen hundreds of pitch decks this year and here is my learnings:
r/Entrepreneur
"Don't code. Just sell." : The rule that saved our SaaS
r/Entrepreneur
What are you working on?
r/SaaS
One huge client isn’t validation. $10,000 from 50 strangers is.
r/Entrepreneur
Built a file automation tool after getting tired of repetitive dev tasks — looking for honest feedback
r/SaaS
Launching MailSprinter: Automate Bulk File Emailing—with Smart PDF Compression for Large Documents 🚀
r/SaaS

r/r/Entrepreneur r/r/SaaS

Captain (YC W26) – Automated RAG for Files

Postgres extension for BM25 relevance-ranked full-text search

boringBar – a taskbar-style dock replacement for macOS

Expose a zero allocation API to Godot C# bindings