Description: Powerful, flexible, and portable open-source web crawler. and filesystem crawler. Store collected content to a search engine, database, or else (e.g., Apache Solr, Elasticsearch, IDOL, Neo4j, ...).
Keywords: Web crawler, Filesystem crawler, open-source, collector, search engine, Solr, Elasticsearch, Neo4j, IDOL, Google
Computers Open Source Software Internet Search Engines 网站
2025年03月02日