make own search engine with API based crawlers and data collectors.

 usearch.com  https://ahrefs.com/

Get Access To Usearch’s or ahrefs Web Data Archive and build custom search engine

The Usearch data archive contains 10 billions of web pages including2 billion news articles. It contains data in a machine readable format, including the title, description and full text of every webpage published since 2008

Search API The gateway to the entire web

can build custom search engines like for a selected topic or city or country.

5B Total Webpages

10K Custom Search Engines Built

100B Processed API Search Requests

5M+ Signals Delivered