Security News
Cloudflare Adds Security.txt Setup Wizard
Cloudflare has launched a setup wizard allowing users to easily create and manage a security.txt file for vulnerability disclosure on their websites.
@bluecadet/launchpad-content
Advanced tools
The content
package downloads and locally caches content from various common web APIs.
To download content, all you need to do is define content sources and provide credentials as needed.
The following launchpad.json
would download jsons and images from the Flickr API to .downloads/flickr-images
(a combination of the default .downloads/
directory and the id
field of the content source):
{
"content": {
"sources": [
{
"id": "flickr-images",
"type": "json",
"files": {
"spaceships.json": "https://api.flickr.com/services/feeds/photos_public.gne?format=json&nojsoncallback=1&tags=spaceship",
"rockets.json": "https://api.flickr.com/services/feeds/photos_public.gne?format=json&nojsoncallback=1&tags=rocket"
}
}
]
}
}
See ContentOptions Parameters for a full list of content settings.
Every source needs:
id
: ID of the individual source (required)type
: Source type (default: json
)Currently supported sources are:
json
(via HTTP)airtable
contentful
sanity
strapi
Some content sources require credentials to access their APIs.
These can all be stored in a local .credentials.json
file which maps content-source IDs to their credentials. For example:
.credentials.json
{
"airtable-cms": {
"apiKey": "<YOUR_AIRTABLE_API_KEY>"
},
"contentful-cms": {
"previewToken": "<YOUR_CONTENTFUL_PREVIEW_TOKEN>",
"deliveryToken": "<YOUR_CONTENTFUL_DELIVERY_TOKEN>",
"usePreviewApi": false
},
"sanity-cms": {
"apiToken": "<YOUR_API_TOKEN>"
},
"strapi-cms": {
"identifier": "<YOUR_API_USER>",
"password": "<YOUR_API_PASS>"
}
}
launchpad.json
{
"content": {
"sources": [{
"id": "airtable-cms",
"type": "airtable",
//...
}, {
"id": "contentful-cms",
"type": "contentful",
//...
}, {
"id": "sanity-cms",
"type": "sanity",
//...
}, {
"id": "strapi-cms",
"type": "strapi",
//...
}]
}
}
Once content is downloaded it can be processed to transform text and images. For example, launchpad can convert markdown to html and create scaled derivatives of each image.
Options for all content and media downloads. Each of these settings can also be configured per ContentSource
.
Property | Type | Default | Description |
---|---|---|---|
sources | Array.<SourceOptions> | [] | A list of content source options. This defines which content is downloaded from where. |
imageTransforms | Array.<Object.<string, number>> | [] | A list of image transforms to apply to a copy of each downloaded image. |
contentTransforms | Object.<string, string> | {} | A list of content transforms to apply to all donwloaded content. |
downloadPath | string | '.downloads/' | The path at which to store all downloaded files. |
credentialsPath | string | '.credentials.json' | The path to the json containing credentials for all content sources. |
tempPath | boolean | '%DOWNLOAD_PATH%/.tmp/' | Temp file directory path. |
backupPath | boolean | '%DOWNLOAD_PATH%/.backups/' | Temp directory path where all downloaded content will be backed up before removal. |
keep | boolean | '' | Which files to keep in dest if clearOldFilesOnSuccess or clearOldFilesOnStart are true . E.g. '\*.json|\*.csv|\*.xml|\*.git\*' |
strip | string | '' | Strips this string from all media file paths when saving them locally |
backupAndRestore | boolean | true | Back up files before downloading and restore originals for all sources on failure of any single source. |
maxConcurrent | number | 4 | Max concurrent downloads. |
maxTimeout | number | 30000 | Max request timeout in ms. |
clearOldFilesOnSuccess | boolean | true | Remove all existing files in dest dir when downloads succeed. Ignores files that match keep |
clearOldFilesOnStart | boolean | false | Will remove all existing files _before_ downloads starts. false will ensure that existing files are only deleted after a download succeeds. |
ignoreCache | boolean | false | Will always download files regardless of whether they've been cached |
enableIfModifiedSinceCheck | boolean | true | Enables the HTTP if-modified-since check. Disabling this will assume that the local file is the same as the remote file if it already exists. |
enableContentLengthCheck | boolean | true | Compares the HTTP header content-length with the local file size. Disabling this will assume that the local file is the same as the remote file if it already exists. |
abortOnError | boolean | true | If set to true , errors will cause syncing to abort all remaining tasks immediately |
ignoreImageTransformCache | boolean | false | Set to true to always re-generate transformed images, even if cached versions of the original and transformed image already exist. |
ignoreImageTransformErrors | boolean | true | Set to false if you want to abort a content source from downloading if any of the image transforms fail. Leaving this to true will allow for non-image files to fail quietly. |
forceClearTempFiles | boolean | true | Set to false if you want to keep all contents of the tempPath dir before downloading |
FAQs
Content syncing pipeline for various sources
The npm package @bluecadet/launchpad-content receives a total of 12 weekly downloads. As such, @bluecadet/launchpad-content popularity was classified as not popular.
We found that @bluecadet/launchpad-content demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 0 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Cloudflare has launched a setup wizard allowing users to easily create and manage a security.txt file for vulnerability disclosure on their websites.
Security News
The Socket Research team breaks down a malicious npm package targeting the legitimate DOMPurify library. It uses obfuscated code to hide that it is exfiltrating browser and crypto wallet data.
Security News
ENISA’s 2024 report highlights the EU’s top cybersecurity threats, including rising DDoS attacks, ransomware, supply chain vulnerabilities, and weaponized AI.