Crawler
mihatter
Simple Twitter crawler
crawler-address-gouv-fr
This rubygem does not have a description or summary.
gcrawler
Crawling link text and link url by keywords on Google.com.
browser_crawler
Simple site crawler using Capybara
itunes_crawler
ITunesCrawler provides an easy way to download the requested iTunes data through Apple's Search API.
reddit_junkie
This little library helps people download images from different subs much easier. It's actually like a crawler for the images posted on a subreddit. Actually, it's a great tool to have your favorite memes locally!
circleci_crawler
This gem crawls the latest CircleCI artifact file you specified. For Example, you can get the result JSON of simplecov.gem etc.
nicocrawler
crawler of niconico-douga
rakuten-travel-crawler
Empower World Travel Information Technology
watir_crawler
A watir based web crawler
fua
Fake User-Agents of about %80 of real devices to use in headers of web crawlers. It keeps your script away from being nested by many UA strings.
roro_crawler
This rubygem does not have a description or summary.
ro_crawler
This rubygem does not have a description or summary.
scottburton11-MovieBot
A simple movie converter, queue and directory crawler, all in one!
simple_crawler
Simple web crawler to crawl a domain and generate sitemap
ruby-crawler
Simple ruby web crawler
jpstock-crawler
株価情報を取得してあれこれするライブラリ
caule
DSL to build crawlers easily
wcrawler
This is a tool to provide a easy way to download the resources from weipan
job_crawler
Jobs crawler
tjcrawler
Simple crawling tool.
vscinemas
The Taiwan VSCinema crawler to get latest film list.
rumba-crawler
Web crawler with JSON-based DSL and EventMachine-powered page fetching
crabbs
A crawler for a single domain web application
book_price
book's price crawler
current-price
A ruby stock price & option chain crawler
refract
Crawler that auto generates SitePrism Page Objects
instagram_crawler
image download from instagram
kitcrawler
Crawl lecture websites and fetch the PDFs automatically. It currently supports the studium.kit.edu and other HTTP password protected sites.
watir-for-crawler
Simple Gem Using Watir For Phantom Crawler
kudzu-adapter-active_record
ActiveRecord adapter for kudzu crawler
ruby-web-crawler
A simple ruby gem to recursively traverse all URLs on a Root URL. It returns all the URLs it encountered
logstash-input-crawler
This plugin need set the initial url.
crawler-cinema-core
This rubygem does not have a description or summary.
samao
Samao is a web crawler written in ruby.
booking-com-crawler
Empower World Travel Information Technology
expedia-crawler
Empower World Travel Information Technology
arachnidish
Arachnidish is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.
capybara_crawler
a simple web crawler using DSL of capybara
restaurant_crawler
A simply web crawler.
rack-pesticide
Block crawlers who spam your site with fake HTTP referers
marvel_crawler
Lightweight interface to communicate with the Marvel Comics API
zhSieve
A ruby based zhihu content crawler.
by_crawler
a demo for study ruby
agoda-crawler
Empower World Travel Information Technology
crashlytics-crawler
A crappy crawler for crashlytics
jalan-crawler
Empower World Travel Information Technology
zy_crawler
A simple crawler demo crawler
bc_crawler
Allows to crawl bandcamp sites, including release and track information
nicoquery-crawler
crawler of niconico