caitp<p>You know how SETI got hundreds of thousands of people crunching numbers on their computers to analyze radiowaves in a hunt for aliens?</p><p>What if we had this, but for crawling and cataloging the internet? Like, producing an open source dataset that anyone could use to run their own ad-free unbiased search clients.</p><p>Could it work? would you volunteer idle computer time to crawl the web for it? Did I just invent something cool, or is it actually stupid?</p><p><a href="https://mstdn.social/tags/Search" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Search</span></a> <a href="https://mstdn.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a> <a href="https://mstdn.social/tags/Distributed" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Distributed</span></a></p>