Crawler
com.github.annypatel.retrocrawler:core
Annotation based Retrofit converter for HTML
fr.pilato.elasticsearch.crawler:fscrawler-3rdparty
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-parent
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-distribution
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-docs
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-it
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-es7
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-es6
FS Crawler offers a simple way to index binary files into elasticsearch.
fr.pilato.elasticsearch.crawler:fscrawler-es5
FS Crawler offers a simple way to index binary files into elasticsearch.
us.fatehi:schemacrawler-archetype-plugin-lint
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-archetype-plugin-dbconnector
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-archetype-maven-project
Free database schema discovery and comprehension tool
us.fatehi:schemacrawler-archetype-plugin-command
Free database schema discovery and comprehension tool
com.digitalpebble:storm-crawler-solr
Solr resources for StormCrawler
com.digitalpebble:storm-crawler-external
Storm-Crawler Java API with external dependencies.
com.digitalpebble:storm-crawler-elasticsearch
Elasticsearch resources for StormCrawler
com.digitalpebble.stormcrawler:storm-crawler-aws
AWS resources for StormCrawler
com.digitalpebble.stormcrawler:storm-crawler-external
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.digitalpebble.stormcrawler:storm-crawler-archetype
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.digitalpebble.stormcrawler:storm-crawler
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.digitalpebble.stormcrawler:storm-crawler-elasticsearch-archetype
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.digitalpebble.stormcrawler:storm-crawler-opensearch-archetype
A collection of resources for building low-latency, scalable web crawlers on Apache Storm.
com.github.crawler-commons:urlfrontier-API
URLFrontier Java API
in.jlibs:jlibs-xml-crawler
Crawl XML(wsdl, xsd, xsl) documents
com.github.brianway:webporter-parent
Java crawler application based on webmagic.
com.github.brianway:webporter-collector-zhihu
Java crawler application based on webmagic.
com.iveely:com.iveely.crawler
A simple distributed crawling system.
com.societegenerale:github-crawler-autoconfigure
Parent pom providing dependency and plugin management for applications built with Maven
com.societegenerale:github-crawler-core
Parent pom providing dependency and plugin management for applications built with Maven
me.xethh.libs.toolkits:crawler
Library of crawler based on akka actor
cn.wanghaomiao:SeimiCrawler
一个支持分布式的可以高效开发且可以高效运行的爬虫框架。设计思想上融合了spring与scrapy的优点。An powerful,agile,powerful,distributed crawler framework.
org.ow2.weblab.components:folder-crawler
Use this component crawl a folder. This is a basic component, no thread, no complex timings, no data comparison. A real crawler could use multiple instances of this component.
com.soulgalore:crawler
Simple java (1.6) crawler to crawl web pages on one and same domain.
com.geccocrawler:gecco-spring
Gecco Crawler With Spring
com.brucezee.jspider:jspider-core
A simple, scalable, and highly efficient web crawler framework for Java.
com.societegenerale.github-crawler:github-crawler-core
Parent pom providing dependency and plugin management for applications built with Maven
com.societegenerale.github-crawler:github-crawler-autoconfigure
Parent pom providing dependency and plugin management for applications built with Maven
org.codelibs.fess:fess-crawler-es
Fess Crawler is Crawler Framework.
com.github.abola:crawler
This is a open project of Java. The project integrated Apache Commons-VFS and Jsoup. It can be grabbing data much easy.
com.jaeksoft:opensearchserver
OpenSearchServer is a powerful, enterprise-class, search engine program. Using the web user interface, the crawlers (web, file, database, ...) and the REST/RESTFul API you will be able to integrate quickly and easily advanced full-text search capabilities in your application. OpenSearchServer runs on Windows and Linux/Unix/BSD.
net.vidageek:crawler
Simple and extensible crawler.
it.unimi.di.law:bubing
BUbiNG is an open-source Java fully distributed crawler
com.bowriverstudio:fscrawler-test-framework
FS Crawler with custom OCR(Microsoft Computer Vision) offers a simple way to index binary files into elasticsearch.
com.norconex.collectors:norconex-collector-http
Norconex HTTP Collector is a web spider, or crawler that aims to be very flexible, easy to extend, and portable
com.github.xbynet:crawler-core
A simple and flexible web crawler framework for java.
io.github.biezhi:elves
crawler framework
com.bowriverstudio:fscrawler-framework
FS Crawler with custom OCR(Microsoft Computer Vision) offers a simple way to index binary files into elasticsearch.
com.bowriverstudio:fscrawler-settings
FS Crawler with custom OCR(Microsoft Computer Vision) offers a simple way to index binary files into elasticsearch.
com.societegenerale:github-crawler-starter
Parent pom providing dependency and plugin management for applications built with Maven