Crawler
fr.pilato.elasticsearch.crawler:fscrawler-crawler-ssh
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-crawler-fs
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v6
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v7
FS Crawler offers a simple way to index binary files into elasticsearch.
us.codecraft:webmagic-samples
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
us.fatehi:schemacrawler-jdbc-drivers
Free database schema discovery and comprehension tool
fr.pilato.elasticsearch.crawler:fscrawler-crawler-ftp
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v5
FS Crawler offers a simple way to index binary files into elasticsearch.
com.gwtplatform:gwtp-crawler-service
A complete model-view-presenter framework to simplify your next GWT project.
us.fatehi:schemacrawler-loader
Free database schema discovery and comprehension tool
org.archive.heritrix:heritrix-engine
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
us.fatehi:schemacrawler-timesten
Free database schema discovery and comprehension tool
com.xuxueli:xxl-crawler
A lightweight web crawler framework.
fr.pilato.elasticsearch.crawler:fscrawler-crawler
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-it-common
FS Crawler offers a simple way to index binary files into elasticsearch.
com.github.brianway:webporter-data-elasticsearch
Java crawler application based on webmagic.
com.github.brianway:webporter-core
Java crawler application based on webmagic.
us.codecraft:webmagic-parent
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
us.fatehi:schemacrawler-diff
Free database schema discovery and comprehension tool
org.archive:heritrix
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
us.fatehi:schemacrawler-docker
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-derby
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-h2
Free database schema discovery and comprehension tool
edu.uci.ics:crawler4j-parent
Open Source Web Crawler for Java
edu.uci.ics:crawler4j-examples-base
Open Source Web Crawler for Java - base examples
com.squareup.okhttp3.sample:crawler
An HTTP+HTTP/2 client for Android and Java applications
com.squareup.okhttp.sample:crawler
An HTTP+SPDY client for Android and Java applications
org.apache.any23.plugins:apache-any23-basic-crawler
Any23 plugin for crawling sites.
com.digitalpebble.stormcrawler:storm-crawler-elasticsearch
Elasticsearch resources for StormCrawler
edu.uci.ics:crawler4j-examples-postgres
Open Source Web Crawler for Java - example with jdbc and Postgres
com.digitalpebble.stormcrawler:storm-crawler-tika
Tika-based parser bolt for StormCrawler
org.apache.oodt:cas-crawler
The Catalog and Archive Service Crawling Framework.
com.digitalpebble.stormcrawler:storm-crawler-opensearch
Opensearch resources for StormCrawler
org.codelibs.fess:fess-crawler
Fess Crawler is a crawler framework.
org.codelibs.fess:fess-crawler-lasta
This is LastaFlute support.
org.archive.heritrix:heritrix
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
us.fatehi:schemacrawler-dbtest
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-parent
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-hana
Free database schema discovery and comprehension tool
com.digitalpebble.stormcrawler:storm-crawler-warc
WARC resources for StormCrawler
com.digitalpebble:storm-crawler
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.digitalpebble.stormcrawler:storm-crawler-urlfrontier
URL Frontier resources for StormCrawler
com.digitalpebble.stormcrawler:storm-crawler-langid
Language Identification for StormCrawler
com.digitalpebble.stormcrawler:storm-crawler-solr
Solr resources for StormCrawler
com.digitalpebble:storm-crawler-tika
Tika-based parser bolt for StormCrawler
com.digitalpebble:storm-crawler-aws
AWS resources for StormCrawler
com.digitalpebble.stormcrawler:storm-crawler-sql
SQL-based resources for StormCrawler
com.digitalpebble:storm-crawler-sql
SQL-based resources for StormCrawler
org.apache.tuweni:tuweni-eth-crawler
Ethereum Network Crawler.
com.github.annypatel.retrocrawler:core
Annotation based Retrofit converter for HTML