All projects

LocalAI

Upload documents and chat with them using local models. Nothing leaves the machine.

5

Document formats supported

100%

On-premises - no third-party API

The problem

Document Q&A tools are everywhere, but almost all of them require uploading the document to a vendor. That rules them out for anything sensitive.

What I built

A full-stack app that ingests PDF, DOC, PPT, Markdown and TXT and answers questions over them conversationally, using locally hosted models. Next.js frontend, FastAPI backend, with ingestion progress tracking and full session data control.

Retrieval details

Your turn. Describe how chunking, embedding and retrieval actually work here - chunk size, which embedding model, whether it's pure vector search or hybrid. You did this work; the resume just didn't have room for it.