Scraper API
market_bot
Market Bot is a high performance Ruby scraper for Google's Android Market with a simple to use API. It is built on top of Nokogiri and Typhoeus.
monkeyshines
A simple scraper for directed scrapes of APIs, feed or structured HTML. Plays nicely with wuclan and wukong.
ruby-instagram-scraper
А simple module for requests to Instagram without an API key.
securities
Financial information scraper gem. Uses Yahoo Finance API.
instascraper
A scraper for instapaper to provide a basic api without hacing to pay per month
espn_scraper
a simple scraping api for espn stats and data
instagram_scraper
A instagram scraper to get user instagram data thought public api (search and media)
gis_scraper
Scrape ArcGIS data from REST API and export to postgres db
bugguide
BugGuide.net is a website for sharing insect photos from North America. Over the years it as acrued many experts and a great deal of excellent data, but not an API. This gem is little more than a scraper for conveniently extracting data from the website.
web_scraper
Web Scraper is a library to build APIs by scraping static sites and use data as models.
scraper_rb
Ruby wrapper for Prompt API's Scraper Checker API
github_organizations_scraper
Scrape Github Organization member information. Currently, the Github API doesn't support the new Organizations feature. This CLI scrapes the list of members for an Organization.
campaign_monitor_private
A screen-scraper to retrieve vital information not available via the public API
opal_card_api
A screen-scraper to retrieve your cards and transactions from the Opal Card website
jekyll-darkvisitors
Jekyll plugin to generate a robots.txt to block AI scrapers via the Dark Visitors API (https://darkvisitors.com)