pipelinewise-tap-twilio
Advanced tools
Singer.io tap for extracting data from the Twilio API - PipelineWise compatible
Singer tap that extracts data from a Twilio API and produces JSON-formatted data following the Singer spec.
This is a PipelineWise compatible tap connector.
This tap:
Extracts the following resources:
Extracts TaskRouter resources:
Extracts Programmable Chat resources (members and chat_messages are FULL_TABLE synced, so take care syncing them, they result in a lot of request/data):
Outputs the schema for each resource
Incrementally pulls data based on the input state
available_phone_number_countries
available_phone_numbers_mobile
available_phone_numbers_toll_free
This tap authenticates to the Twilio API using Basic Auth.
To set up authentication simply include your Twilio account_sid and auth_token in the tap config.
Install
python3 -m venv venv
. venv/bin/activate
pip install --upgrade pip
pip install .
Create your tap's config.json file. The api_key is available in the twilio Console UI (see Authentication above). The date_window_days is the integer number of days (between the from and to dates) for date-windowing through the date-filtered endpoints (default = 30). The start_date is the absolute beginning date from which incremental loading on the initial load will start.
{
"account_sid": "YOUR_ACCOUNT_SID",
"auth_token": "YOUR_AUTH_TOKEN",
"start_date": "2019-01-01T00:00:00Z",
"user_agent": "tap-twilio <api_user_email@your_company.com>",
}
Optionally, also create a state.json file. currently_syncing is an optional attribute used for identifying the last object to be synced in case the job is interrupted mid-stream. The next run would begin where the last job left off.
{
"currently_syncing": "registers",
"bookmarks": {
"acounts": "2020-03-23T10:31:14.000000Z",
"...": "2020-03-23T00:00:00.000000Z"
}
}
Run the Tap in Discovery Mode This creates a catalog.json for selecting objects/fields to integrate:
tap-twilio --config config.json --discover > catalog.json
See the Singer docs on discovery mode here.
Run the Tap in Sync Mode (with catalog)
For Sync mode:
> tap-twilio --config tap_config.json --catalog catalog.json
Messages are written to standard output following the Singer specification. The resultant stream of JSON data can be consumed by a Singer target.
python3 -m venv venv
. venv/bin/activate
pip install --upgrade pip
pip install -e .[test]
pytest tests/unit
FAQs
Singer.io tap for extracting data from the Twilio API - PipelineWise compatible
We found that pipelinewise-tap-twilio demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
vlt's new "reproduce" tool verifies npm packages against their source code, outperforming traditional provenance adoption in the JavaScript ecosystem.
Research
Security News
Socket researchers uncovered a malicious PyPI package exploiting Deezer’s API to enable coordinated music piracy through API abuse and C2 server control.
Research
The Socket Research Team discovered a malicious npm package, '@ton-wallet/create', stealing cryptocurrency wallet keys from developers and users in the TON ecosystem.