New:Microsoft Teams Notifications Are Now Available in Socket.Learn more
Get Started

apify-data-scrapers

Package Overview
Dependencies
Maintainers
1
Versions
18
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

apify-data-scrapers

MCP server exposing 40 Apify public-data scrapers as tools (Google Maps, news, SEO, jobs, SEC, procurement, registries, and more)

Source
pipPyPI
Version
1.4.0
Weekly downloads
1.5K
258.84%
Maintainers
1
Weekly downloads
 
Created

mcp-name: io.github.jlucasmcrell/apify-scrapers

Apify Public Data MCP: 40 Production Data Tools & Public Records

Python 3.10+ Node.js 18+ Apify Verified Glama MCP Server License: MIT Smithery Listed on mcpservers.org One MCP server gives an AI agent 40 production data extractors - Google Maps business leads, Google News, Google Autocomplete, LinkedIn and Glassdoor jobs, SEC EDGAR, USAspending, Grants.gov, TED tenders, NHTSA recalls, FEC, EPA, ClinicalTrials.gov, openFDA, Europe PMC, GLEIF, CMS providers, Census geocoding, state business registries, contractor licences, Airbnb, YouTube, Twitch and Google Play - each running as an Actor on your own Apify account. Install with uvx apify-data-scrapers (Claude Desktop, Cursor, any MCP client), or call the same Actors directly from Python, Node.js or no-code tools.

Each actor is built with strict schema validation, deterministic field mapping, self-healing DOM selectors, and pay-per-event pricing (per-result rates from $0.00015, Actor-start from $0.0005; the live Apify Store price is authoritative).

Runtime contract and spending control

Since version 1.1.0, calls return {results, status, run?} in both MCP structured content and text. Status is success, partial, empty_unverified, or error; errors include a stable code and retry guidance. Zero rows are not proof that no matching records exist. Existing integrations that parsed a bare result array must now read results. Native dataset field names are preserved.

Each call requests a 120-second Actor timeout and a pay-per-event charge cap of $1 by default. Set APIFY_MAX_CHARGE_USD to adjust the cap. This is per run, not a total account spending limit; platform fees outside Actor event charges may still apply. Up to four calls may run concurrently. Cancelling a request attempts to abort its cloud run; check the returned run ID if confirmation fails. An ambiguous start is never retried automatically.

The MCP executable is Python; Node.js files are direct Actor API examples, not a second MCP server. Private queued Actors are omitted from this public catalog.

Quick Navigation

Choose your tools

Choose a focused tool profile and generate your installation configuration.

Version 1.2.0 adds the optional APIFY_TOOL_PROFILE environment variable: all (default), leads, market, government, or research. These correspond to the four catalog categories below. Profiles restrict tool discovery and calls, prompts, and the Actor catalog. Restart the MCP server and refresh/reconnect your client after changing the profile. Keep only the focused server entry if you do not also want the full catalog loaded. Direct Actor API examples are unchanged; this setting is not an Apify account permission boundary.

Choose your first workflow

Your goalStart hereWhat to expect
Build a local contractor lead listDallas electrician example taskReview the prefilled input, set a small result limit, then run and export the dataset.
Track company filingsSEC filing-monitor tutorialChoose companies and form types; retain filing identifiers to avoid duplicate alerts.
Compare healthcare providers over timeCMS provider-monitor tutorialSave snapshots and compare changes in the source dataset, not real-time clinical outcomes.
Use an AI chat interfaceChatGPT and Apify MCP setupConnect your own Apify account and choose the Actor explicitly.

No separate subscription to this MCP package is required. Actor runs are billed through your Apify account at the displayed Store price. Start with a small run and inspect its output before scheduling recurring work; public-source data can be delayed, incomplete, or temporarily unavailable.

Privacy Policy

The MCP server collects nothing. It runs on your machine, reads APIFY_TOKEN from your environment, and its only outbound calls are to the Apify API to run the Actor you asked for — on your own Apify account. No telemetry, no logs, no data sent to us. Full policy: apify.revenuesystemslabs.com/privacy.

Make.com templates

Eight published Make scenarios, one click to copy into your own Make account. Each asks for your Apify token and your destination (Google Sheets or Slack) in the setup wizard.

TemplateActor it runs
Google Maps Leads to Google Sheetsgoogle-maps-business-search
Glassdoor Jobs to Google Sheetsglassdoor-jobs-scraper
California Contractor Licenses to Google Sheetsca-contractor-license-search
SEC EDGAR Filing Alerts to Slacksec-edgar-filings-search
Export Google News Results to Google Sheetsgoogle-news-search
Export Grants.gov Opportunities to Google Sheetsgrants-gov-opportunity-search
Export TED EU Tenders to Google Sheetsted-eu-tender-search
Export NHTSA Vehicle Recalls to Google Sheetsnhtsa-vehicle-recall-search

Use-case guides

One page per question an agent gets asked, each listing the tools, arguments, returned fields and prices for that job:

Focused, end-to-end tutorials:

Available Extractors & Store Listings

Every extractor below is both an Apify Store listing and an MCP tool of the same server; the sections are the questions buyers arrive with.

Business intelligence & lead generation

Also available: Cross-border company registry search, combining UK, French and GLEIF records where available.

ToolStore LinkKey Output FieldsBest For
Google Maps Business Leadscaptainhandsome/google-maps-business-searchName, phone, website, rating, reviews, address, coordinates, hoursB2B lead generation, local agency prospecting
Website Tech Stack & Ecommerce Scannercaptainhandsome/tech-stack-detectortechnologies, cms, ecommerce_platform, payments, emailsBest for competitive tech research and B2B lead qualification across a batch of company websites.
US Business Entity Registriescaptainhandsome/us-business-entity-searchLegal entity name, filing number, jurisdiction, statusLegal due diligence, corporate registration checks
Alabama Business Entity Searchcaptainhandsome/al-business-entity-searchentity id, entity name, location, entity type, statusSearch Alabama business entities by company name and export entity IDs
Florida Sunbiz Business Entity Searchcaptainhandsome/fl-sos-new-filingsentity name, document number, status, entity type, date filedSearch Florida Sunbiz company-name results and export legal entity nam
Florida Sunbiz Officer & Registered Agent Searchcaptainhandsome/fl-sunbiz-officer-searchofficer name, entity name, document number, detail url, entity typeSearch Florida Sunbiz by officer or registered-agent name and export o
French Company Searchcaptainhandsome/french-company-searchsiren, name, legal name, acronym, statusSearch France's official company register by name, activity, postcode,
GLEIF LEI Lookupcaptainhandsome/gleif-lei-searchlei, legal_name, registered_as, legal_form_name, statusBest for KYC and counterparty due diligence: resolving a company's Legal Entity Identifier, registration status, and own national registry number before onboarding.
US Contractor Licensescaptainhandsome/us-contractor-license-searchContractor name, license number, classification, status, stateTrades verification, subcontractor diligence
California Contractor License Searchcaptainhandsome/ca-contractor-license-searchcontractor name, name type, license number, city, statusSearch California CSLB contractor records by contractor name and expor

Jobs, market & consumer intelligence

ToolStore LinkKey Output FieldsBest For
Glassdoor Jobs & Salariescaptainhandsome/glassdoor-jobs-scraperTitle, company, salary estimate, rating, location, job URL, posting dateHiring intelligence, compensation benchmarking
LinkedIn Public Jobscaptainhandsome/linkedin-public-jobs-searchJob title, employer, location, direct apply URL, posting ageRecruitment, tech talent monitoring
Airbnb Vacation Rentalscaptainhandsome/airbnb-listings-searchTitle, room type, nightly price, rating, reviews count, listing URLReal estate research, market rate tracking
Google Play App Reviewscaptainhandsome/google-play-reviews-scraperReview text, star score, thumbs up, date, reviewer nameApp store sentiment, competitor feedback
Apple App Store Reviewscaptainhandsome/app-store-reviews-searchapp_name, review_rating, review_body, review_version, app_average_ratingiOS review mining, ASO research and cross-platform sentiment
YouTube Video Searchcaptainhandsome/youtube-search-scraperTitle, video URL, channel, views count, duration, publish dateContent tracking, creator outreach
Twitch Live Streamscaptainhandsome/twitch-live-streams-scraperStreamer username, title, viewer count, language, categoryEsports analytics, live stream monitoring

Government & public records

Also available: SEC Form 4 insider transactions, OFAC sanctions, CourtListener cases, and NVD/CISA vulnerability intelligence.

ToolStore LinkKey Output FieldsBest For
SEC EDGAR Corporate Filingscaptainhandsome/sec-edgar-filings-searchTicker, CIK, form (10-K, 10-Q, 8-K), filing date, primary document URLFinancial diligence, equity research, compliance
USAspending Federal Awardscaptainhandsome/usaspending-federal-awardsRecipient vendor, award amount, awarding agency, description, datesGovernment contracting, procurement intel
Grants.gov Funding Opportunitiescaptainhandsome/grants-gov-opportunity-searchOpportunity number, agency, deadline, award range, eligibility, contactsFederal grant prospecting and funding monitoring
TED European Tenderscaptainhandsome/ted-eu-tender-searchBuyer, country, CPV code, deadline, estimated value, source documentsEuropean procurement and bid discovery
NHTSA Vehicle Recallscaptainhandsome/nhtsa-vehicle-recall-searchCampaign number, component, defect, consequence, remedy, affected unitsVehicle-safety checks and recall monitoring
FEC Campaign Finance Searchcaptainhandsome/fec-campaign-finance-searchrecord type, id, name, party, officeSearch US federal candidates, PACs and campaign contributions by state
EPA ECHO Facility Compliance & Violationscaptainhandsome/epa-echo-facility-searchregistry id, name, street, city, stateSearch EPA-regulated US facilities by state, ZIP, NAICS, name, program
US Census Address Geocodercaptainhandsome/us-census-geocodermatched_address, county_name, tract_geoid, block_geoid, congressional_district_geoidBest for appending census tract, county FIPS and district GEOIDs to US addresses for demographic joins and compliance reporting.

Research & health data

ToolStore LinkKey Output FieldsBest For
ClinicalTrials.gov Searchcaptainhandsome/clinical-trials-searchnct id, title, official title, acronym, org study idSearch the official ClinicalTrials.gov API by condition, intervention,
Europe PMC Paper Searchcaptainhandsome/europe-pmc-paper-searchtitle, doi, pmid, abstract, cited_by_countBest for biomedical literature reviews, citation tracking, and open-access discovery across PubMed and Europe PMC.
openFDA Drug Labels, Recalls & Adverse Eventscaptainhandsome/openfda-searchdataset, id, brand name, generic name, manufacturerSearch official FDA drug labels, approvals, adverse events, and drug,
CMS Healthcare Provider Searchcaptainhandsome/cms-healthcare-provider-searchname, provider_type, city, state, star_ratingCompare CMS-certified hospitals, nursing homes, and other Medicare providers by location, ownership, and star rating.

Python Quickstart

1. Install dependencies

pip install apify-client pandas python-dotenv

2. Export 50 Google Maps Leads to CSV

import os
from apify_client import ApifyClient
import pandas as pd

# Get your API token from https://console.apify.com/account/integrations
client = ApifyClient(os.getenv("APIFY_TOKEN"))

# Run the actor
run = client.actor("captainhandsome/google-maps-business-search").call(run_input={
    "search_query": "commercial electricians",
    "location": "Dallas, Texas",
    "max_items": 50,
    "include_details": True,
})

# Fetch dataset items and export to CSV
items = list(client.dataset(run["defaultDatasetId"]).iterate_items())
df = pd.DataFrame(items)
df.to_csv("dallas_electricians.csv", index=False)
print(f"Exported {len(df)} leads to dallas_electricians.csv")

See examples/google_maps_leads_to_csv.py for the full script.

Node.js Quickstart

1. Install dependencies

npm install apify-client

2. Query SEC EDGAR Filings

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });

const run = await client.actor('captainhandsome/sec-edgar-filings-search').call({
  companies: ['AAPL', 'NVDA', 'MSFT'],
  forms: ['10-K'],
  max_items: 15,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach(filing => {
  console.log(`[${filing.ticker}] ${filing.form} (${filing.filing_date}): ${filing.filing_url}`);
});

See examples/sec_filings.js for the full script.

No-Code & Automation Workflows

If you automate via n8n, Make, Zapier, or Google Sheets, ready-to-import blueprints are included in workflows/:

Open a template in Make: Google Maps, Glassdoor, California contractors, SEC filings to Slack, Google News, Grants.gov, TED tenders, or NHTSA recalls.

Pre-Built Example Tasks (Zero Code)

If you prefer runnable web UI tasks without writing any code, each actor includes pre-configured tasks published on Apify Store:

Google Maps Leads

Glassdoor Jobs

Airbnb Rentals

YouTube & Google Play

Free Sample Datasets

Looking for clean data to benchmark, analyze, or train models? Verified sample bundles with metadata schemas are available in datasets/ and hosted publicly on Hugging Face Datasets:

Eight verified sample bundles, each exported from a production run of the Actor named beside it. Every one is served from this repository and mirrored to Hugging Face, where the dataset card links back to the Actor that produced it.

AI Agent & MCP Integration

All actors in this repository conform to OpenAPI and JSON Schema standards, making them directly callable by AI agents via the Model Context Protocol (MCP):

Add this to your claude_desktop_config.json or Cursor MCP settings:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "uvx",
      "args": ["apify-data-scrapers"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 2: Docker Container (Glama / Cloud)

Run via Docker:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "docker",
      "args": ["run", "-i", "--rm", "-e", "APIFY_TOKEN", "glcr.b-cdn.net/jlucasmcrell/apify-scrapers:latest"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 3: Local Python Stdio Runner

Install via pip or run directly:

pip install apify-data-scrapers
export APIFY_TOKEN="your_token_here"
apify-data-scrapers

Or from local source:

python mcp_server.py

Agent Prompts That Work Out-of-the-Box:

  • "Search Google Maps for 50 commercial roofers in Atlanta with phone numbers and websites."
  • "Retrieve Apple and Microsoft Form 10-K filings from SEC EDGAR for the last 2 years."
  • "Search Glassdoor for remote product manager jobs with salary estimates."

In-Depth Engineering Guides

Technical case studies and problem-solution writeups are located in articles/:

Repository Structure

apify-scrapers/
 README.md                                # Documentation and quickstart
 LICENSE                                  # MIT License
 requirements.txt                         # Python client dependencies
 package.json                             # Node.js dependencies
 mcp.json                                 # MCP tool registry specification
 mcp_server.py                            # Native Python stdio MCP server
 articles/                                # In-depth engineering case studies
    airbnb_playwright_pagination_guide.md
    glassdoor_posting_dates_guide.md
    reddit_community_responses.md        # Reference technical answers for forums
 datasets/                                # Sample benchmark datasets
    phoenix_hvac_leads/
    california_solar_contractors/
    austin_software_jobs/
 workflows/                               # No-code automation templates
    n8n_google_maps_to_sheets.json
    n8n_sec_edgar_to_slack.json
    n8n_google_news_competitor_monitor.json
    n8n_grants_gov_opportunity_monitor.json
    n8n_ted_eu_tender_monitor.json
    README.md
 examples/                                # Standalone developer scripts
     google_maps_leads_to_csv.py
     sec_edgar_filings_downloader.py
     glassdoor_jobs_tracker.py
     airbnb_market_scraper.py
     usaspending_defense_awards.py
     twitch_live_stream_monitor.py
     google_maps_leads.js
     sec_filings.js

Author & Support

Maintained by Joseph McRell.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Keywords

apify

FAQs

Related posts