LLM Enterprise Search

Let’s say you’re a software engineer, and you’ve been asked to design an enterprise search tool for a company with 10,000 employees and millions of internal documents. The goal is to leverage a large language model (LLM) to help employees quickly find relevant information across emails, PDFs, and wiki pages.

How would you approach building this LLM-powered search system, and what key considerations would you keep in mind to ensure it delivers accurate and useful results?