No, but I index parts of the web that are important to myself, sites I frequently reference. (I have all of Simon Willison's site indexed, for example.) It turns out that a simple SQLite database is a lot more capable and faster than I thought. I index from my laptop, using another tool I built with Claude. I don't crawl or spider, I focus on indexing from sitemap.xml files and RSS feeds. I have about 1.5 Million pages in my local index, and I get search results in 40ms - 70ms, thereabouts.
For every search that doesn't find results - and of course that's still the majority - it falls back to a meta-search combining results from Brave, Mojeek & Marginalia. The core of that metasearch is what Claude 3.5v2 generated for me in a one-shot back in Dec 2024. Kagi is just a metasearch with a very small local index as well, and my main purpose in building this was replacing Kagi for my needs.
The last 10% of my queries were widget queries like currency conversion, distance & temperature conversion etc that I was using for about 10% of my search queries.
For every search that doesn't find results - and of course that's still the majority - it falls back to a meta-search combining results from Brave, Mojeek & Marginalia. The core of that metasearch is what Claude 3.5v2 generated for me in a one-shot back in Dec 2024. Kagi is just a metasearch with a very small local index as well, and my main purpose in building this was replacing Kagi for my needs.
The last 10% of my queries were widget queries like currency conversion, distance & temperature conversion etc that I was using for about 10% of my search queries.