pipelinewise-tap-twilio
Advanced tools
Singer.io tap for extracting data from the Twilio API - PipelineWise compatible
Singer tap that extracts data from a Twilio API and produces JSON-formatted data following the Singer spec.
This is a PipelineWise compatible tap connector.
This tap:
Extracts the following resources:
Extracts TaskRouter resources:
Extracts Programmable Chat resources (members and chat_messages are FULL_TABLE synced, so take care syncing them, they result in a lot of request/data):
Outputs the schema for each resource
Incrementally pulls data based on the input state
available_phone_number_countries
available_phone_numbers_mobile
available_phone_numbers_toll_free
This tap authenticates to the Twilio API using Basic Auth.
To set up authentication simply include your Twilio account_sid and auth_token in the tap config.
Install
python3 -m venv venv
. venv/bin/activate
pip install --upgrade pip
pip install .
Create your tap's config.json file. The api_key is available in the twilio Console UI (see Authentication above). The date_window_days is the integer number of days (between the from and to dates) for date-windowing through the date-filtered endpoints (default = 30). The start_date is the absolute beginning date from which incremental loading on the initial load will start.
{
"account_sid": "YOUR_ACCOUNT_SID",
"auth_token": "YOUR_AUTH_TOKEN",
"start_date": "2019-01-01T00:00:00Z",
"user_agent": "tap-twilio <api_user_email@your_company.com>",
}
Optionally, also create a state.json file. currently_syncing is an optional attribute used for identifying the last object to be synced in case the job is interrupted mid-stream. The next run would begin where the last job left off.
{
"currently_syncing": "registers",
"bookmarks": {
"acounts": "2020-03-23T10:31:14.000000Z",
"...": "2020-03-23T00:00:00.000000Z"
}
}
Run the Tap in Discovery Mode This creates a catalog.json for selecting objects/fields to integrate:
tap-twilio --config config.json --discover > catalog.json
See the Singer docs on discovery mode here.
Run the Tap in Sync Mode (with catalog)
For Sync mode:
> tap-twilio --config tap_config.json --catalog catalog.json
Messages are written to standard output following the Singer specification. The resultant stream of JSON data can be consumed by a Singer target.
python3 -m venv venv
. venv/bin/activate
pip install --upgrade pip
pip install -e .[test]
pytest tests/unit
FAQs
Singer.io tap for extracting data from the Twilio API - PipelineWise compatible
We found that pipelinewise-tap-twilio demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
ECMAScript 2025 introduces Iterator Helpers, Set methods, JSON modules, and more in its latest spec update approved by Ecma in June 2025.
Security News
A new Node.js homepage button linking to paid support for EOL versions has sparked a heated discussion among contributors and the wider community.
Research
North Korean threat actors linked to the Contagious Interview campaign return with 35 new malicious npm packages using a stealthy multi-stage malware loader.