Crawler
tia-crawler
Gem para acessar os dados do TIA Mackenzista
sengi
A web crawler using Ruby and Redis.
suitoru
A crawler for such as mailing lists.
murmuring_spider
MurmuringSpider is a concise Twitter crawler. When we write a data-mining / text-mining application based on twitter timeline, we have to collect and store tweets first. I am irritated with writing such crawler repeatedly, so I wrote this. What you have to do is only to add query and to run them periodically. Thanks to consistent Twitter API and twitter gem (http://twitter.rubyforge.org/), it is quite easy to track various types of timelines (such as user_timeline, home_timeline, search...)
youtube-crawler
plugin-container totally sucks..
links_crawler
check how many links are available inside the website
content_crawler
This will be crawling data from websites. Need to give the xpaths clearly. Will be updating with new functionalities in future
yz_crawler
A simple web crawler gem
harvestman
Lightweight web crawler
outlander
Multithreaded web crawler with transparent DSL and requests caching.
webcream
A web crawler dsl.
resay_crawler
A simple web crawler gem
crawler_guru
Crawler Guru provides all basic functionalities to extract data from web pages
lattes
A crawler and parser to the Currículo Lattes.
mymav_crawler
Web crawler to get courses from XML pages at mymav.uta
dk_crawler
A simple web crawler gem
wpcrawler
A simple crawler that gets posts and pages from wordpress websites that have an exposed api
czj_crawler
A simple web crawler gem
srawler
s7o crawler optimized for programmer happiness and sustainable productivity.
ranunculus
Another Web crawler running with Amazon SQS and ElastiCache(Redis)
my_crawler
A simple web crawler gem
WebTitle
With just a few lines of code, developers can effortlessly integrate this gem into their projects, enabling seamless retrieval of page titles from HTML documents. Whether you're building web scrapers, crawlers, or any application that requires fetching webpage titles, WebTitle streamlines the process, providing a clean and efficient solution.