Huge News!Announcing our $40M Series B led by Abstract Ventures.Learn More
Socket
Sign inDemoInstall
Socket

third-party-web

Package Overview
Dependencies
Maintainers
1
Versions
54
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

third-party-web

Categorized data on third party entities on the web.

  • 0.10.0
  • Source
  • npm
  • Socket score

Version published
Weekly downloads
941K
decreased by-0.97%
Maintainers
1
Weekly downloads
 
Created
Source

Third Party Web

Check out the shiny new web UI https://www.thirdpartyweb.today/

Data on third party entities and their impact on the web.

This document is a summary of which third party scripts are most responsible for excessive JavaScript execution on the web today.

Table of Contents

  1. Goals
  2. Methodology
  3. NPM Module
  4. Updates
  5. Data
    1. Summary
    2. How to Interpret
    3. Third Parties by Category
      1. Advertising
      2. Analytics
      3. Social
      4. Video
      5. Developer Utilities
      6. Hosting Platforms
      7. Marketing
      8. Customer Success
      9. Content & Publishing
      10. CDNs
      11. Tag Management
      12. Mixed / Other
    4. Third Parties by Total Impact
  6. Future Work
  7. FAQs
  8. Contributing

Goals

  1. Quantify the impact of third party scripts on the web.
  2. Identify the third party scripts on the web that have the greatest performance cost.
  3. Give developers the information they need to make informed decisions about which third parties to include on their sites.
  4. Incentivize responsible third party script behavior.
  5. Make this information accessible and useful.

Methodology

HTTP Archive is an inititiave that tracks how the web is built. Every month, ~4 million sites are crawled with Lighthouse on mobile. Lighthouse breaks down the total script execution time of each page and attributes the execution to a URL. Using BigQuery, this project aggregates the script execution to the origin-level and assigns each origin to the responsible entity.

NPM Module

The entity classification data is available as an NPM module.

const {getEntity} = require('third-party-web')
const entity = getEntity('https://d36mpcpuzc4ztk.cloudfront.net/js/visitor.js')
console.log(entity)
//   {
//     "name": "Freshdesk",
//     "homepage": "https://freshdesk.com/",
//     "categories": ["customer-success"],
//     "domains": ["d36mpcpuzc4ztk.cloudfront.net"]
//   }

Updates

2019-02-01 dataset

Huge props to WordAds for reducing their impact from ~2.5s to ~200ms on average! A few entities are showing considerably less data this cycle (Media Math, Crazy Egg, DoubleVerify, Bootstrap CDN). Perhaps they've added new CDNs/hostnames that we haven't identified or the basket of sites in HTTPArchive has shifted away from their usage.

2019-03-01 dataset

Almost 2,000 entities tracked now across ~3,000+ domains! Huge props to @simonhearne for making this massive increase possible. Tag Managers have now been split out into their own category since they represented such a large percentage of the "Mixed / Other" category.

2019-05-06 dataset

Google Ads clarified that www.googletagservices.com serves more ad scripts than generic tag management, and it has been reclassified accordingly. This has dropped the overall Tag Management share considerably back down to its earlier position.

2019-05-13 dataset

A shortcoming of the attribution approach has been fixed. Total usage is now reported based on the number of pages in the dataset that use the third-party, not the number of scripts. Correspondingly, all average impact times are now reported per page rather than per script. Previously, a third party could appear to have a lower impact or be more popular simply by splitting their work across multiple files.

Third-parties that performed most of their work from a single script should see little to no impact from this change, but some entities have seen significant ranking movement. Hosting providers that host entire pages are, understandably, the most affected.

Some notable changes below:

Third-PartyPreviously (per-script)Now (per-page)
Beeketing137 ms465 ms
Sumo263 ms798 ms
Tumblr324 ms1499 ms
Yandex APIs393 ms1231 ms
Google Ads402 ms1285 ms
Wix972 ms5393 ms

Data

Summary

Across top ~4 million sites, ~2700 origins account for ~57% of all script execution time with the top 50 entities already accounting for ~47%. Third party script execution is the majority chunk of the web today, and it's important to make informed choices.

How to Interpret

Each entity has a number of data points available.

  1. Usage (Total Number of Occurrences) - how many scripts from their origins were included on pages
  2. Total Impact (Total Execution Time) - how many seconds were spent executing their scripts across the web
  3. Average Impact (Average Execution Time) - on average, how many milliseconds were spent executing each script
  4. Category - what type of script is this

Third Parties by Category

This section breaks down third parties by category. The third parties in each category are ranked from first to last based on the average impact of their scripts. Perhaps the most important comparisons lie here. You always need to pick an analytics provider, but at least you can pick the most well-behaved analytics provider.

Overall Breakdown

Unsurprisingly, ads account for the largest identifiable chunk of third party script execution.

breakdown by category

Advertising

These scripts are part of advertising networks, either serving or measuring.

RankNameUsageAverage Impact
1Nend1,71340 ms
2ExoClick4,26356 ms
3Elastic Ad1,76263 ms
4fluct4,24064 ms
5MailMunch9,26365 ms
6Affiliate Window1,84968 ms
7CleverDATA1,19771 ms
8FreakOut7,27972 ms
9Adyoulike2,75074 ms
10Tradelab1,24075 ms
11BlueKai11,37275 ms
12Tail Target2,21776 ms
13District M19,21676 ms
14Rakuten Marketing2,97777 ms
15Tynt52,23780 ms
16Geniee1,25681 ms
17Constant Contact3,03683 ms
18GetResponse1,53584 ms
19Crowd Control4,50585 ms
20PushCrew7,65585 ms
21Effective Measure1,02485 ms
22The Trade Desk1,14286 ms
23LinkedIn Ads1,22086 ms
24Autopilot1,31487 ms
25Rocket Fuel1,32289 ms
26Outbrain9,00389 ms
27Gemius15,97090 ms
28F@N Communications1,21690 ms
29Scorecard Research56,91091 ms
30Nativo1,14092 ms
31DialogTech1,75194 ms
32OwnerIQ1,47697 ms
33Unbounce5,583104 ms
34Amazon Ads37,633105 ms
35Pubmatic239,535107 ms
36DTSCOUT10,470107 ms
37Refersion2,484108 ms
38AudienceSearch1,355108 ms
39Adroll5,475112 ms
40plista1,488116 ms
41Popads7,435117 ms
42Sharethrough4,307118 ms
43Rubicon Project64,786120 ms
44Smart AdServer4,855121 ms
45rewardStyle.com1,165121 ms
46JuicyAds4,980121 ms
47Permutive1,172124 ms
48OptiMonk2,755126 ms
49Lytics1,255128 ms
50Bizible2,050139 ms
51Yahoo!42,141139 ms
52Skimbit37,640140 ms
53Bridgewell DSP72,535142 ms
54Bing Ads31,774149 ms
55DMD Marketing1,311151 ms
56Digital ad Consortium5,737152 ms
57AOL / Oath / Verizon Media3,688157 ms
58Criteo178,755157 ms
59RevJet5,763160 ms
60Media Math3,427162 ms
61Media.net53,308168 ms
62SmartAdServer5,903169 ms
63Teads16,806172 ms
64Adform37,341180 ms
65sovrn7,038184 ms
66Cxense8,958184 ms
67TrafficStars3,973186 ms
68eBay1,585187 ms
69Adocean2,378188 ms
70IPONWEB1,728190 ms
71Adverline Board2,345193 ms
72Index Exchange6,240206 ms
73Smarter Click1,093207 ms
74Sortable2,729210 ms
75Celtra1,384211 ms
76Snacktools1,598211 ms
77Auto Link Maker2,421223 ms
78Taboola43,546223 ms
79Branch Metrics2,076226 ms
80Perfect Market1,829232 ms
81VigLink16,444238 ms
82LongTail Ad Solutions8,052240 ms
83Infolinks7,283248 ms
84MGID18,885249 ms
85One by AOL3,525255 ms
86Klaviyo21,188258 ms
87WordAds47,149265 ms
88OpenX13,508266 ms
89Privy24,476270 ms
90GumGum5,832275 ms
91Adloox7,979276 ms
92piano1,739286 ms
93Intent Media4,506286 ms
94Market GID2,072288 ms
95Adnium3,882290 ms
96AppNexus55,728296 ms
97Between Digital2,337304 ms
9833 Across16,956338 ms
99Neodata2,708344 ms
100iBillboard3,754348 ms
101Sizmek13,924361 ms
102Polar1,353371 ms
103Yieldmo3,013381 ms
104Digioh2,150390 ms
105BannerFlow8,849392 ms
106Media Management Technologies1,349395 ms
107Technorati1,091408 ms
108DoubleVerify25,251426 ms
109MediaVine14,060429 ms
110Integral Ad Science62,677431 ms
111Tribal Fusion3,706438 ms
112Google/Doubleclick Ads3,531,833459 ms
113Simplicity Marketing6,128464 ms
114Admixer for Publishers3,289473 ms
115Yandex Ads24,094476 ms
116Ooyala1,360502 ms
117Vidible4,406549 ms
118Meetrics1,623582 ms
119LoyaltyLion3,047606 ms
120Yieldify1,835667 ms
121AdMatic4,062710 ms
122Moat41,664834 ms
123AdScore2,654860 ms
124Supership1,1281034 ms
125LKQD4,7331048 ms
126fam5,0321325 ms
127StickyADS.tv7,6931393 ms

Analytics

These scripts measure or track users and their actions. There's a wide range in impact here depending on what's being tracked.

RankNameUsageAverage Impact
1Alexa2,35055 ms
2WordPress Site Stats10,17464 ms
3Roxr Software4,80469 ms
4Treasure Data11,28370 ms
5StatCounter16,37472 ms
6Amplitude Mobile Analytics5,40074 ms
7Searchanise4,75075 ms
8Heap4,21178 ms
9Quantcast6,56378 ms
10Mixpanel13,17980 ms
11Chartbeat13,10480 ms
12Google Analytics2,509,86781 ms
13Hotjar286,46591 ms
14Smart Insight Tracking1,46792 ms
15Radar1,35793 ms
16Usabilla1,61196 ms
17etracker3,877100 ms
18CallRail13,947106 ms
19Marchex8,566109 ms
20ContentSquare2,288109 ms
21Nielsen NetRatings SiteCensus24,220111 ms
22Parse.ly6,259111 ms
23Snowplow6,077114 ms
24Baidu Analytics27,003119 ms
25Crazy Egg28,656122 ms
26Picreel1,042128 ms
27VWO11,885131 ms
28Survicate1,142133 ms
29Net Reviews5,520136 ms
30Convert Insights1,968136 ms
31Nosto5,112142 ms
32BounceX2,744150 ms
33Marketo2,516150 ms
34Monetate1,932153 ms
35PowerReviews1,342161 ms
36Kampyle1,360163 ms
37Trust Pilot30,441167 ms
38Evidon15,544168 ms
39Mather Economics1,496169 ms
40Gigya7,027178 ms
41ForeSee4,507185 ms
42DigiTrust8,804188 ms
43Segment19,443192 ms
44Clicktale3,814193 ms
45FullStory12,228219 ms
46Maxymiser2,539234 ms
47Clerk.io ApS1,678242 ms
48UserReport2,659243 ms
49Bazaarvoice4,825265 ms
50mPulse22,192273 ms
51Ezoic7,870282 ms
52Optimizely24,691305 ms
53Keen5,043311 ms
54Histats28,082337 ms
55Feefo.com4,355367 ms
56Reviews.co.uk1,197367 ms
57Inspectlet11,796396 ms
58Decibel Insight1,116414 ms
59TrackJS1,660423 ms
60Snapchat16,476427 ms
61SessionCam3,128467 ms
62Lucky Orange15,254501 ms
63Yandex Metrica497,461506 ms
64Mouseflow3,345618 ms
65Revolver Maps1,558644 ms
66IBM Digital Analytics1,812709 ms
67AB Tasty6,661732 ms
68Salesforce101,775951 ms

Social

These scripts enable social features.

RankNameUsageAverage Impact
1VK54,05759 ms
2Micropat48,42774 ms
3Shareaholic9,53288 ms
4Kakao23,27494 ms
5Pinterest31,567107 ms
6LinkedIn33,425110 ms
7Twitter535,642129 ms
8AddShoppers1,100133 ms
9Yandex Share93,048141 ms
10Instagram18,393143 ms
11Facebook3,590,088161 ms
12ShareThis88,885233 ms
13Stackla PTY1,307311 ms
14AddThis378,302328 ms
15SocialShopWave2,855434 ms
16Disqus5,702529 ms
17Pixlee1,588535 ms
18PIXNET113,430619 ms
19Tumblr49,240715 ms
20LiveJournal10,4511057 ms

Video

These scripts enable video player and streaming functionality.

RankNameUsageAverage Impact
1Vimeo70,542477 ms
2Wistia44,577523 ms
3Twitch3,058651 ms
4Brightcove12,629697 ms
5YouTube1,215,399700 ms

Developer Utilities

These scripts are developer utilities (API clients, site monitoring, fraud detection, etc).

RankNameUsageAverage Impact
1Trusted Shops3,82939 ms
2LightWidget5,62365 ms
3Riskified1,03871 ms
4Symantec2,34878 ms
5Optanon1,93178 ms
6OneSignal40,88979 ms
7GetSiteControl3,47386 ms
8iubenda26,53488 ms
9Siteimprove3,27889 ms
10TRUSTe1,91790 ms
11New Relic11,81393 ms
12Cookiebot22,102102 ms
13iovation2,215103 ms
14Other Google APIs/SDKs1,144,404120 ms
15Github1,115125 ms
16Bold Commerce22,797129 ms
17AppDynamics3,118137 ms
18AddEvent1,395143 ms
19Sift Science3,432146 ms
20Forensiq2,038154 ms
21Amazon Pay27,030156 ms
22MaxCDN Enterprise5,000166 ms
23Swiftype2,941169 ms
24Shopgate1,228178 ms
25Po.st2,418185 ms
26TrustArc17,277191 ms
27Google Maps1,029,420202 ms
28Fraudlogix1,641216 ms
29Seznam3,966219 ms
30WisePops1,062234 ms
31Affirm2,742251 ms
32GitHub2,469278 ms
33Cloudflare27,866302 ms
34Fastly9,893302 ms
35Stripe40,199320 ms
36PayPal30,278323 ms
37Rambler17,774335 ms
38Distil Networks21,147344 ms
39GoDaddy25,895369 ms
40Secomapp2,606387 ms
41Datacamp26,376408 ms
42Vidyard1,532422 ms
43Sentry21,759425 ms
44Bugsnag2,323461 ms
45Okas Concepts1,903737 ms
46Yandex APIs24,6281105 ms
47Mapbox9,9331170 ms
48Esri ArcGIS4,5931624 ms
49Blindado1,5671915 ms

Hosting Platforms

These scripts are from web hosting platforms (WordPress, Wix, Squarespace, etc). Note that in this category, this can sometimes be the entirety of script on the page, and so the "impact" rank might be misleading. In the case of WordPress, this just indicates the libraries hosted and served by WordPress not all sites using self-hosted WordPress.

RankNameUsageAverage Impact
1WordPress267,613190 ms
2Rackspace1,381284 ms
3Shopify359,922293 ms
4Dealer51,793298 ms
5Salesforce Commerce Cloud4,380370 ms
6Blogger69,145404 ms
7CDK Dealer Management17,453481 ms
8Ecwid1,811496 ms
9Squarespace163,470514 ms
10Weebly69,962563 ms
11Hatena Blog102,990609 ms
12Adobe Business Catalyst5,3331050 ms
13Wix488,0051104 ms
14WebsiteBuilder.com1,4223136 ms

Marketing

These scripts are from marketing tools that add popups/newsletters/etc.

RankNameUsageAverage Impact
1iZooto1,40070 ms
2RD Station3,54271 ms
3Madison Logic1,26086 ms
4Dataxu11,29597 ms
5Beeketing46,576107 ms
6Bronto Software1,864115 ms
7Listrak2,153124 ms
8Hubspot52,412140 ms
9Ve6,509145 ms
10Mailchimp51,011156 ms
11Yotpo24,868216 ms
12OptinMonster16,882243 ms
13Sumo86,955322 ms
14Drift29,364364 ms
15Bigcommerce25,497422 ms
16Pardot2,500432 ms
17Wishpond Technologies1,363446 ms
18Albacross3,842679 ms
19Tray Commerce9,4181176 ms
20PureCars5,1031962 ms

Customer Success

These scripts are from customer support/marketing providers that offer chat and contact solutions. These scripts are generally heavier in weight.

RankNameUsageAverage Impact
1SnapEngage2,13862 ms
2ClickDesk1,23475 ms
3Foursixty2,51086 ms
4iPerceptions4,16598 ms
5LivePerson9,838103 ms
6Comm1003,177119 ms
7WebEngage1,277134 ms
8Pure Chat8,189143 ms
9iAdvize SAS3,652143 ms
10ContactAtOnce10,595215 ms
11LiveChat53,109252 ms
12Tawk.to108,512314 ms
13Tidio Live Chat17,081329 ms
14Jivochat61,315353 ms
15Olark24,902365 ms
16Intercom35,357372 ms
17Help Scout2,884377 ms
18LiveTex7,185408 ms
19ZenDesk175,823518 ms
20Dynamic Yield2,637622 ms

Content & Publishing

These scripts are from content providers or publishing-specific affiliate tracking.

RankNameUsageAverage Impact
1Accuweather3,08869 ms
2Clicktripz6,19483 ms
3Adobe Scene71,23483 ms
4Covert Pics1,021106 ms
5CPEx1,759113 ms
6Revcontent1,233115 ms
7Tencent2,445117 ms
8OpenTable5,458145 ms
9SnapWidget7,989147 ms
10Booking.com5,723147 ms
11Cloudinary1,043188 ms
12Medium4,756229 ms
13AMP133,133247 ms
14Vox Media1,431265 ms
15Embedly8,268488 ms
16issuu6,457491 ms
17Spotify5,243500 ms
18Dailymotion5,365519 ms
19SoundCloud9,106858 ms
20Hotmart2,788875 ms
21Kaltura Video Platform1,634982 ms

CDNs

These are a mixture of publicly hosted open source libraries (e.g. jQuery) served over different public CDNs and private CDN usage. This category is unique in that the origin may have no responsibility for the performance of what's being served. Note that rank here does not imply one CDN is better than the other. It simply indicates that the scripts being served from that origin are lighter/heavier than the ones served by another.

RankNameUsageAverage Impact
1Bootstrap CDN2,84959 ms
2Adobe TypeKit20,72394 ms
3Microsoft Hosted Libs11,263166 ms
4Yandex CDN3,636176 ms
5jQuery CDN343,212195 ms
6Google CDN1,094,288222 ms
7FontAwesome CDN56,240228 ms
8Unpkg8,489244 ms
9Akamai24,867260 ms
10Azure Web Services13,035263 ms
11Cloudflare CDN219,769273 ms
12JSDelivr CDN64,286355 ms
13Fort Awesome1,774531 ms
14Monotype10,906691 ms
15CreateJS CDN13,0152853 ms

Tag Management

These scripts tend to load lots of other scripts and initiate many tasks.

RankNameUsageAverage Impact
1BrightTag / Signal23,13694 ms
2TagCommander2,803119 ms
3Google Tag Manager1,199,366141 ms
4Opentag1,987205 ms
5Adobe Tag Manager74,192243 ms
6Tealium30,953252 ms
7Ensighten14,717310 ms

Mixed / Other

These are miscellaneous scripts delivered via a shared origin with no precise category or attribution. Help us out by identifying more origins!

RankNameUsageAverage Impact
1Skype1,705143 ms
2Amazon Web Services80,948153 ms
3All Other 3rd Parties1,421,438246 ms
4Pagely1,828251 ms
5ResponsiveVoice2,296302 ms
6Parking Crew6,550483 ms
7uLogin4,8621139 ms

Third Parties by Total Impact

This section highlights the entities responsible for the most script execution across the web. This helps inform which improvements would have the largest total impact.

NamePopularityTotal ImpactAverage Impact
Google/Doubleclick Ads3,531,8331,621,163 s459 ms
YouTube1,215,399851,147 s700 ms
Facebook3,590,088578,109 s161 ms
Wix488,005538,579 s1104 ms
All Other 3rd Parties1,421,438349,368 s246 ms
Yandex Metrica497,461251,897 s506 ms
Google CDN1,094,288242,755 s222 ms
Google Maps1,029,420207,618 s202 ms
Google Analytics2,509,867202,171 s81 ms
Google Tag Manager1,199,366169,474 s141 ms
Other Google APIs/SDKs1,144,404137,524 s120 ms
AddThis378,302123,970 s328 ms
Shopify359,922105,346 s293 ms
Salesforce101,77596,802 s951 ms
ZenDesk175,82391,048 s518 ms
Squarespace163,47083,977 s514 ms
PIXNET113,43070,177 s619 ms
Twitter535,64269,190 s129 ms
jQuery CDN343,21267,062 s195 ms
Hatena Blog102,99062,680 s609 ms
Cloudflare CDN219,76960,094 s273 ms
WordPress267,61350,940 s190 ms
Weebly69,96239,402 s563 ms
CreateJS CDN13,01537,128 s2853 ms
Tumblr49,24035,194 s715 ms
Moat41,66434,732 s834 ms
Tawk.to108,51234,118 s314 ms
Vimeo70,54233,641 s477 ms
AMP133,13332,887 s247 ms
Criteo178,75528,095 s157 ms
Sumo86,95527,982 s322 ms
Blogger69,14527,950 s404 ms
Yandex APIs24,62827,215 s1105 ms
Integral Ad Science62,67727,041 s431 ms
Hotjar286,46525,950 s91 ms
Pubmatic239,53525,544 s107 ms
Wistia44,57723,321 s523 ms
JSDelivr CDN64,28622,848 s355 ms
Jivochat61,31521,637 s353 ms
ShareThis88,88520,692 s233 ms
Wicked Reports64019,323 s30193 ms
Adobe Tag Manager74,19218,054 s243 ms
AppNexus55,72816,496 s296 ms
Dealer51,79315,445 s298 ms
LiveChat53,10913,371 s252 ms
Intercom35,35713,155 s372 ms
Yandex Share93,04813,084 s141 ms
Stripe40,19912,856 s320 ms
FontAwesome CDN56,24012,847 s228 ms
WordAds47,14912,510 s265 ms
Amazon Web Services80,94812,399 s153 ms
Mapbox9,93311,619 s1170 ms
Yandex Ads24,09411,457 s476 ms
Tray Commerce9,41811,073 s1176 ms
LiveJournal10,45111,050 s1057 ms
Bigcommerce25,49710,772 s422 ms
Datacamp26,37610,763 s408 ms
DoubleVerify25,25110,751 s426 ms
StickyADS.tv7,69310,713 s1393 ms
Drift29,36410,674 s364 ms
Bridgewell DSP72,53510,270 s142 ms
PureCars5,10310,010 s1962 ms
PayPal30,2789,792 s323 ms
Taboola43,5469,708 s223 ms
GoDaddy25,8959,552 s369 ms
Histats28,0829,475 s337 ms
Sentry21,7599,243 s425 ms
Olark24,9029,089 s365 ms
Media.net53,3088,955 s168 ms
Brightcove12,6298,801 s697 ms
Cloudflare27,8668,411 s302 ms
CDK Dealer Management17,4538,390 s481 ms
Mailchimp51,0117,942 s156 ms
Tealium30,9537,813 s252 ms
SoundCloud9,1067,810 s858 ms
Rubicon Project64,7867,785 s120 ms
Lucky Orange15,2547,647 s501 ms
Monotype10,9067,535 s691 ms
Optimizely24,6917,527 s305 ms
Esri ArcGIS4,5937,459 s1624 ms
Hubspot52,4127,329 s140 ms
Distil Networks21,1477,281 s344 ms
Snapchat16,4767,038 s427 ms
Adform37,3416,739 s180 ms
fam5,0326,670 s1325 ms
Privy24,4766,606 s270 ms
Akamai24,8676,456 s260 ms
mPulse22,1926,064 s273 ms
MediaVine14,0606,025 s429 ms
Rambler17,7745,960 s335 ms
Yahoo!42,1415,872 s139 ms
33 Across16,9565,723 s338 ms
Tidio Live Chat17,0815,628 s329 ms
Adobe Business Catalyst5,3335,598 s1050 ms
uLogin4,8625,538 s1139 ms
Klaviyo21,1885,477 s258 ms
Yotpo24,8685,360 s216 ms
Skimbit37,6405,270 s140 ms
Scorecard Research56,9105,174 s91 ms
Trust Pilot30,4415,078 s167 ms
Sizmek13,9245,032 s361 ms
Beeketing46,5764,972 s107 ms
LKQD4,7334,961 s1048 ms
AB Tasty6,6614,876 s732 ms
Bing Ads31,7744,731 s149 ms
MGID18,8854,703 s249 ms
Inspectlet11,7964,667 s396 ms
Ensighten14,7174,561 s310 ms
WebsiteBuilder.com1,4224,460 s3136 ms
Amazon Pay27,0304,215 s156 ms
Tynt52,2374,184 s80 ms
OptinMonster16,8824,104 s243 ms
Embedly8,2684,038 s488 ms
Amazon Ads37,6333,950 s105 ms
VigLink16,4443,910 s238 ms
Segment19,4433,731 s192 ms
LinkedIn33,4253,690 s110 ms
OpenX13,5083,596 s266 ms
Micropat48,4273,583 s74 ms
Crazy Egg28,6563,500 s122 ms
BannerFlow8,8493,467 s392 ms
Azure Web Services13,0353,429 s263 ms
Pinterest31,5673,377 s107 ms
TrustArc17,2773,294 s191 ms
OneSignal40,8893,245 s79 ms
Baidu Analytics27,0033,219 s119 ms
VK54,0573,215 s59 ms
issuu6,4573,169 s491 ms
Parking Crew6,5503,165 s483 ms
Disqus5,7023,017 s529 ms
Blindado1,5673,001 s1915 ms
Fastly9,8932,987 s302 ms
LiveTex7,1852,934 s408 ms
Bold Commerce22,7972,931 s129 ms
Teads16,8062,887 s172 ms
AdMatic4,0622,882 s710 ms
Simplicity Marketing6,1282,841 s464 ms
Dailymotion5,3652,782 s519 ms
Nielsen NetRatings SiteCensus24,2202,688 s111 ms
FullStory12,2282,674 s219 ms
Instagram18,3932,638 s143 ms
Spotify5,2432,622 s500 ms
Evidon15,5442,614 s168 ms
Albacross3,8422,609 s679 ms
Hotmart2,7882,441 s875 ms
Vidible4,4062,418 s549 ms
iubenda26,5342,323 s88 ms
AdScore2,6542,281 s860 ms
ContactAtOnce10,5952,276 s215 ms
Cookiebot22,1022,252 s102 ms
Ezoic7,8702,217 s282 ms
Adloox7,9792,199 s276 ms
BrightTag / Signal23,1362,184 s94 ms
Kakao23,2742,181 s94 ms
Unpkg8,4892,070 s244 ms
Mouseflow3,3452,066 s618 ms
Twitch3,0581,989 s651 ms
Adobe TypeKit20,7231,941 s94 ms
LongTail Ad Solutions8,0521,936 s240 ms
Microsoft Hosted Libs11,2631,866 s166 ms
LoyaltyLion3,0471,847 s606 ms
Infolinks7,2831,806 s248 ms
DigiTrust8,8041,657 s188 ms
Cxense8,9581,647 s184 ms
Dynamic Yield2,6371,640 s622 ms
Tribal Fusion3,7061,625 s438 ms
Salesforce Commerce Cloud4,3801,619 s370 ms
Kaltura Video Platform1,6341,605 s982 ms
GumGum5,8321,601 s275 ms
Feefo.com4,3551,596 s367 ms
Opta8741,581 s1809 ms
Keen5,0431,567 s311 ms
Admixer for Publishers3,2891,557 s473 ms
VWO11,8851,552 s131 ms
CallRail13,9471,481 s106 ms
District M19,2161,466 s76 ms
SessionCam3,1281,462 s467 ms
Gemius15,9701,436 s90 ms
Okas Concepts1,9031,402 s737 ms
iBillboard3,7541,307 s348 ms
sovrn7,0381,291 s184 ms
Intent Media4,5061,290 s286 ms
IBM Digital Analytics1,8121,285 s709 ms
Index Exchange6,2401,282 s206 ms
Bazaarvoice4,8251,278 s265 ms
Gigya7,0271,248 s178 ms
SocialShopWave2,8551,238 s434 ms
Yieldify1,8351,224 s667 ms
WebpageFX9111,215 s1334 ms
StatCounter16,3741,183 s72 ms
SnapWidget7,9891,171 s147 ms
Pure Chat8,1891,170 s143 ms
Supership1,1281,167 s1034 ms
Yieldmo3,0131,147 s381 ms
Adnium3,8821,127 s290 ms
DTSCOUT10,4701,121 s107 ms
Dataxu11,2951,100 s97 ms
New Relic11,8131,099 s93 ms
Medium4,7561,091 s229 ms
Help Scout2,8841,088 s377 ms
Pardot2,5001,080 s432 ms
Bugsnag2,3231,072 s461 ms
Mixpanel13,1791,053 s80 ms
Chartbeat13,1041,048 s80 ms
LivePerson9,8381,016 s103 ms
Secomapp2,6061,010 s387 ms
Revolver Maps1,5581,003 s644 ms
SmartAdServer5,903998 s169 ms
Meetrics1,623944 s582 ms
Fort Awesome1,774942 s531 ms
Ve6,509941 s145 ms
Marchex8,566936 s109 ms
Neodata2,708932 s344 ms
Sekindo413926 s2242 ms
RevJet5,763924 s160 ms
Ecwid1,811899 s496 ms
One by AOL3,525898 s255 ms
Digital ad Consortium5,737871 s152 ms
Seznam3,966870 s219 ms
Popads7,435870 s117 ms
BlueKai11,372857 s75 ms
Pixlee1,588850 s535 ms
Booking.com5,723842 s147 ms
Shareaholic9,532839 s88 ms
Digioh2,150839 s390 ms
ForeSee4,507833 s185 ms
MaxCDN Enterprise5,000831 s166 ms
Outbrain9,003805 s89 ms
OpenTable5,458792 s145 ms
Treasure Data11,283791 s70 ms
Cedato551776 s1409 ms
Net Reviews5,520748 s136 ms
TrafficStars3,973741 s186 ms
Clicktale3,814738 s193 ms
Audience 360800725 s906 ms
Nosto5,112724 s142 ms
Between Digital2,337710 s304 ms
TrackJS1,660703 s423 ms
TINT695697 s1003 ms
Parse.ly6,259696 s111 ms
ResponsiveVoice2,296694 s302 ms
Snowplow6,077693 s114 ms
Affirm2,742688 s251 ms
GitHub2,469685 s278 ms
Ooyala1,360683 s502 ms
LeasdBoxer229663 s2894 ms
Hola Networks428654 s1528 ms
WordPress Site Stats10,174653 s64 ms
PushCrew7,655649 s85 ms
Vidyard1,532646 s422 ms
UserReport2,659646 s243 ms
Yandex CDN3,636639 s176 ms
Adroll5,475616 s112 ms
Wishpond Technologies1,363608 s446 ms
JuicyAds4,980605 s121 ms
MailMunch9,263599 s65 ms
Market GID2,072596 s288 ms
Maxymiser2,539593 s234 ms
Smart AdServer4,855586 s121 ms
Unbounce5,583581 s104 ms
AOL / Oath / Verizon Media3,688578 s157 ms
Sortable2,729573 s210 ms
Media Math3,427555 s162 ms
Zmags395551 s1396 ms
Verizon Digital Media CDN722548 s759 ms
Auto Link Maker2,421539 s223 ms
Media Management Technologies1,349532 s395 ms
ThreatMetrix558526 s943 ms
FreakOut7,279524 s72 ms
iAdvize SAS3,652523 s143 ms
Quantcast6,563514 s78 ms
Clicktripz6,194512 s83 ms
Signyfyd504508 s1007 ms
Sharethrough4,307506 s118 ms
Polar1,353502 s371 ms
Sift Science3,432501 s146 ms
Swiftype2,941497 s169 ms
piano1,739497 s286 ms
Quantum Metric684495 s723 ms
Branch Metrics2,076470 s226 ms
PerimeterX Bot Defender582467 s803 ms
Decibel Insight1,116462 s414 ms
Experian Cross-Channel Marketing Platform276462 s1673 ms
Pagely1,828459 s251 ms
Adverline Board2,345452 s193 ms
Adocean2,378447 s188 ms
Po.st2,418446 s185 ms
Technorati1,091445 s408 ms
Mobify442442 s999 ms
Reviews.co.uk1,197440 s367 ms
Gleam878439 s500 ms
AppDynamics3,118429 s137 ms
Perfect Market1,829425 s232 ms
Trip Advisor805420 s522 ms
BounceX2,744411 s150 ms
iPerceptions4,165410 s98 ms
Opentag1,987408 s205 ms
Stackla PTY1,307407 s311 ms
Clerk.io ApS1,678407 s242 ms
infogr.am295402 s1362 ms
Amplitude Mobile Analytics5,400398 s74 ms
Touch Commerce418394 s943 ms
Rackspace1,381392 s284 ms
etracker3,877389 s100 ms
Crowd Control4,505382 s85 ms
Expedia889382 s430 ms
SearchSpring858380 s443 ms
ShopiMind614380 s619 ms
Vox Media1,431380 s265 ms
Marketo2,516377 s150 ms
Comm1003,177377 s119 ms
LightWidget5,623367 s65 ms
Searchanise4,750356 s75 ms
Fraudlogix1,641354 s216 ms
GetIntent RTBSuite593352 s594 ms
OptiMonk2,755348 s126 ms
SpotXchange789344 s436 ms
MonetizeMore279338 s1212 ms
Snacktools1,598337 s211 ms
LoopMe906337 s372 ms
TagCommander2,803334 s119 ms
StreamRail399334 s836 ms
Roxr Software4,804333 s69 ms
Qubit Deliver768332 s432 ms
Heap4,211328 s78 ms
IPONWEB1,728328 s190 ms
Connatix402321 s799 ms
Forensiq2,038313 s154 ms
GetSiteControl3,473299 s86 ms
eBay1,585296 s187 ms
Monetate1,932295 s153 ms
Celtra1,384292 s211 ms
Siteimprove3,278290 s89 ms
Tencent2,445286 s117 ms
Bizible2,050284 s139 ms
fluct4,240271 s64 ms
Global-e876269 s307 ms
Refersion2,484268 s108 ms
Convert Insights1,968267 s136 ms
Listrak2,153267 s124 ms
FirstImpression587259 s441 ms
AvantLink315255 s809 ms
Mather Economics1,496253 s169 ms
Constant Contact3,036252 s83 ms
RD Station3,542250 s71 ms
Fanplayr373250 s671 ms
ContentSquare2,288250 s109 ms
WisePops1,062248 s234 ms
Gfycat314245 s779 ms
Skype1,705243 s143 ms
Calendly722240 s332 ms
ExoClick4,263239 s56 ms
Moovweb160238 s1487 ms
Curalate796233 s292 ms
[24]7395229 s579 ms
Rakuten Marketing2,977228 s77 ms
iovation2,215228 s103 ms
Adtech (AOL)781226 s290 ms
Evergage974226 s232 ms
Smarter Click1,093226 s207 ms
Apester641223 s348 ms
Kampyle1,360222 s163 ms
Flowplayer839220 s262 ms
GIPHY452218 s483 ms
Shopgate1,228218 s178 ms
Knight Lab280217 s776 ms
PowerReviews1,342216 s161 ms
Foursixty2,510215 s86 ms
Bronto Software1,864213 s115 ms
Accuweather3,088212 s69 ms
Bootstrap Chinese network822209 s255 ms
mParticle450207 s461 ms
Conversant583206 s353 ms
Adyoulike2,750204 s74 ms
ZEDO710203 s285 ms
AddEvent1,395200 s143 ms
CPEx1,759199 s113 ms
DMD Marketing1,311198 s151 ms
Flickr580196 s338 ms
Cloudinary1,043196 s188 ms
Marketplace Web Service675192 s284 ms
Auth0489184 s377 ms
Interpublic Group937184 s197 ms
Symantec2,348182 s78 ms
Yottaa505182 s361 ms
Reviews.io361180 s499 ms
plista1,488173 s116 ms
TRUSTe1,917172 s90 ms
WebEngage1,277172 s134 ms
Tail Target2,217169 s76 ms
Bootstrap CDN2,849168 s59 ms
DialogTech1,751165 s94 ms
Janrain246164 s665 ms
Lytics1,255161 s128 ms
Intercept Interactive952160 s168 ms
Better Business Bureau193159 s823 ms
Adkontekst815158 s194 ms
Key CDN508155 s305 ms
Usabilla1,611155 s96 ms
WalkMe634154 s244 ms
TubeMogul500152 s305 ms
Zanox971152 s157 ms
AdSniper453152 s335 ms
Underdog Media545151 s278 ms
Survicate1,142151 s133 ms
Optanon1,931151 s78 ms
smartclip866151 s174 ms
Chitika711150 s211 ms
Livefyre569150 s264 ms
Sidecar602150 s249 ms
Trusted Shops3,829150 s39 ms
eXelate476148 s311 ms
AudienceSearch1,355147 s108 ms
Time446147 s329 ms
AddShoppers1,100147 s133 ms
PERFORM383145 s379 ms
Permutive1,172145 s124 ms
Investis113144 s1275 ms
ReTargeter410143 s349 ms
OwnerIQ1,476143 s97 ms
Highcharts816142 s174 ms
Revcontent1,233141 s115 ms
rewardStyle.com1,165141 s121 ms
Github1,115139 s125 ms
Smart Insight Tracking1,467135 s92 ms
The Hut Group802134 s167 ms
Reevoo641134 s209 ms
SnapEngage2,138133 s62 ms
Picreel1,042133 s128 ms
FoxyCart652133 s204 ms
Glassdoor100132 s1325 ms
Freshdesk862130 s151 ms
Adobe Test & Target366130 s355 ms
Alexa2,350130 s55 ms
GetResponse1,535129 s84 ms
Kameleoon303128 s424 ms
White Ops490128 s262 ms
Concert729127 s174 ms
Radar1,357126 s93 ms
Affiliate Window1,849125 s68 ms
ShopRunner289123 s427 ms
BoldChat982123 s125 ms
Best Of Media S.A.405121 s299 ms
Simpli.fi747119 s160 ms
Rocket Fuel1,322118 s89 ms
C3 Metrics609118 s193 ms
PlayAd Media Group355116 s326 ms
WebSpectator677115 s170 ms
unpkg588115 s195 ms
Autopilot1,314114 s87 ms
RebelMouse112112 s999 ms
Sajari Pty472111 s234 ms
Elastic Ad1,762110 s63 ms
F@N Communications1,216110 s90 ms
Arbor637108 s170 ms
Madison Logic1,260108 s86 ms
Covert Pics1,021108 s106 ms
Unruly Media825107 s129 ms
Weborama725105 s145 ms
Nativo1,140105 s92 ms
LinkedIn Ads1,220105 s86 ms
Onet220104 s474 ms
AdsWizz301104 s345 ms
Adobe Scene71,234103 s83 ms
Geniee1,256102 s81 ms
Sparkflow854101 s118 ms
Kaizen Platform50299 s197 ms
TripleLift35499 s279 ms
iZooto1,40098 s70 ms
The Trade Desk1,14298 s86 ms
Playbuzz45098 s217 ms
Heroku39697 s244 ms
Forter16694 s568 ms
Tradelab1,24093 s75 ms
Ambassador41493 s225 ms
Adthink26293 s355 ms
ClickDesk1,23492 s75 ms
InSkin Media19592 s472 ms
Edge Web Fonts62091 s147 ms
Adition78191 s116 ms
Reflektion31687 s275 ms
Effective Measure1,02487 s85 ms
CleverDATA1,19786 s71 ms
Typepad54485 s157 ms
Adscale83283 s100 ms
Profitshare59683 s140 ms
Republer90882 s90 ms
Socialphotos44481 s183 ms
Keywee49080 s164 ms
SkyScanner27279 s291 ms
ReadSpeaker74979 s105 ms
Mediahawk27678 s284 ms
TruConversion49677 s156 ms
Kargo14577 s533 ms
Transifex29777 s258 ms
Triblio18577 s414 ms
SpringServer20076 s379 ms
Appier84275 s89 ms
Qualaroo92875 s80 ms
Riskified1,03874 s71 ms
NetFlix83474 s89 ms
ReCollect15073 s489 ms
MLveda17173 s424 ms
SaleCycle99072 s72 ms
SurveyMonkey48471 s146 ms
Dynamic Converter18869 s366 ms
FuelX35269 s195 ms
News33068 s207 ms
Nend1,71368 s40 ms
BlueCava20868 s325 ms
Talkable67767 s100 ms
Omniconvert73867 s90 ms
Sooqr Search88065 s74 ms
Tagboard27365 s237 ms
Fresh Relevance76864 s84 ms
Moxie20364 s315 ms
LiveHelpNow69763 s91 ms
InAuth17063 s370 ms
Vee2420263 s311 ms
Petametrics42863 s146 ms
Pusher28962 s216 ms
Kiosked12662 s493 ms
Viacom36062 s172 ms
JustPremium Ads68662 s90 ms
Conversant Tag Manager31261 s197 ms
Pixalate35460 s170 ms
Opinion Stage48358 s121 ms
User Replay16257 s351 ms
Dropbox11257 s506 ms
Postcode Anywhere (Holdings)31956 s177 ms
Browsealoud94756 s59 ms
Steelhouse62956 s89 ms
reEmbed30655 s180 ms
Resonance Insights24455 s225 ms
Aggregate Knowledge20055 s274 ms
DemandBase66054 s82 ms
FLXone32454 s166 ms
VoiceFive58953 s91 ms
KISSmetrics76653 s69 ms
Feedbackify61752 s85 ms
Pingdom RUM23651 s216 ms
Innovid13251 s385 ms
SublimeSkinz83450 s60 ms
CNET Content Solutions14250 s349 ms
Zolando11249 s436 ms
Ipify47249 s103 ms
Connexity11448 s418 ms
Attentive55548 s86 ms
Advance Magazine Group38247 s123 ms
Widespace35946 s128 ms
Customer.io38246 s119 ms
Performio33545 s136 ms
Council ad Network35645 s126 ms
linkpulse61845 s73 ms
Google Plus49744 s89 ms
Zarget41843 s103 ms
Accordant Media48942 s86 ms
Sirv43042 s97 ms
Alliance for Audited Media16641 s249 ms
Snack Media24941 s164 ms
TechTarget17041 s239 ms
Ad6Media16240 s247 ms
United Internet11840 s336 ms
Proper Media21839 s181 ms
Wow Analytics24239 s162 ms
MaxMind28839 s136 ms
fifty-five25439 s152 ms
Silverpop52638 s73 ms
Sweet Tooth42238 s90 ms
Reklama10938 s350 ms
Vergic AB16638 s229 ms
Highwinds10538 s361 ms
SlimCut Media Outstream25638 s148 ms
Salesforce.com53437 s69 ms
Delta Projects AB55537 s67 ms
VidPulse17237 s214 ms
AWeber31835 s111 ms
epoq internet services34235 s103 ms
Borderfree13034 s261 ms
bRealTime23333 s144 ms
NetAffiliation35433 s93 ms
Hull.js20833 s158 ms
Bookatable30433 s108 ms
Storygize21632 s150 ms
PebblePost12832 s253 ms
Hupso Website Analyzer48732 s66 ms
AdsNative30432 s105 ms
ResponseTap44132 s72 ms
AdvertServe24731 s126 ms
AdTrue40031 s77 ms
The Publisher Desk12530 s243 ms
Vergic Engage Platform13430 s226 ms
The ADEX47030 s64 ms
TrafficJunky2829 s1047 ms
Fonecall14929 s195 ms
Byside19229 s151 ms
AdRiver19429 s149 ms
LoginRadius16029 s180 ms
Impact Radius30028 s94 ms
Conversio36228 s78 ms
Infinity Tracking31128 s90 ms
Ceros11128 s250 ms
Civic43628 s63 ms
Datawrapper15428 s179 ms
Drip57827 s47 ms
Meltwater Group15027 s182 ms
Iterate11427 s238 ms
Rakuten LinkShare21227 s127 ms
Klevu Search41626 s64 ms
Prezi19626 s134 ms
Exactag25426 s102 ms
Raygun21126 s122 ms
Betgenius27026 s95 ms
AdSpruce10425 s245 ms
Cookie-Script.com27925 s90 ms
cloudIQ24125 s104 ms
HP Optimost7025 s356 ms
PowerFront12024 s203 ms
Acceptable Ads22224 s109 ms
CyberSource (Visa)35924 s67 ms
Woopra33924 s71 ms
Sourcepoint12024 s196 ms
Navegg37223 s61 ms
Mopinion19023 s120 ms
Adobe Marketing Cloud27622 s81 ms
Flockler16022 s139 ms
Vibrant Media27522 s80 ms
Vertical Mass13422 s163 ms
GoSquared27722 s78 ms
VisScore31821 s68 ms
AnswerDash22321 s96 ms
DemandJump12821 s165 ms
Admitad28821 s72 ms
Datonics28421 s73 ms
RichRelevance11620 s177 ms
CANDDi18620 s108 ms
Polyfill service12020 s167 ms
Ekm Systems23819 s82 ms
Cookie Reports20019 s94 ms
Friendbuy22219 s83 ms
SecuredVisit26418 s69 ms
Twitter Online Conversion Tracking21918 s83 ms
HotelsCombined13618 s132 ms
Extole14618 s122 ms
Oracle Recommendations On Demand21218 s84 ms
Freespee20518 s86 ms
Reactful16818 s104 ms
Elecard StreamEye12817 s134 ms
Braintree Payments16117 s106 ms
Scoota9416 s175 ms
CleverTap18616 s88 ms
Cross Pixel Media11416 s142 ms
Optimove16216 s99 ms
Netlify22016 s71 ms
Barilliance14815 s103 ms
Exponential Interactive32915 s46 ms
Remintrex18615 s81 ms
Web Dissector11315 s133 ms
Cachefly13015 s115 ms
Spot.IM10015 s148 ms
OnScroll12614 s114 ms
UPS i-parcel11014 s131 ms
Attribution18614 s76 ms
Exponea19914 s70 ms
AdSupply11813 s113 ms
Video Media Groep13113 s101 ms
AIR.TV19713 s67 ms
content.ad12913 s101 ms
Bet36514013 s92 ms
Site24x7 Real User Monitoring17412 s71 ms
RightNow Service Cloud12212 s100 ms
Ziff Davis Tech18012 s68 ms
TurnTo11512 s103 ms
Adunity10312 s114 ms
Swoop16612 s70 ms
Browser-Update.org18611 s61 ms
Boomtrain14811 s74 ms
Ghostery Enterprise12911 s85 ms
Microad13611 s79 ms
ShopStorm13211 s81 ms
Sailthru18410 s57 ms
NaviStone11610 s89 ms
Tag Inspector11510 s89 ms
StumbleUpon10610 s94 ms
Channel.me8310 s118 ms
Wufoo14810 s66 ms
Hawk Search1419 s64 ms
Bluecore1129 s80 ms
UpSellit1059 s86 ms
emetriq1578 s54 ms
MailPlus1168 s72 ms
Bidswitch1188 s65 ms
Realytics1088 s70 ms
Catchpoint1447 s49 ms
Sonobi397 s172 ms
DialogTech SourceTrak1167 s57 ms
Intilery1026 s63 ms
Polldaddy756 s85 ms
Flipboard1126 s55 ms
Improve Digital466 s126 ms
Qualtrics466 s123 ms
JustUno3286 s17 ms
Webtrends296 s190 ms
MathJax464 s98 ms
Xaxis444 s80 ms
ConvertMedia453 s76 ms
ARM293 s117 ms
Research Online433 s75 ms
DistroScale433 s74 ms
StackExchange423 s76 ms
StackAdapt353 s90 ms
eGain413 s75 ms
Soundest443 s66 ms
YoYo243 s116 ms
BuySellAds423 s66 ms
Sociomantic Labs463 s58 ms
AdCurve383 s67 ms
Nanorep333 s78 ms
Webtrekk242 s100 ms
AliveChat382 s57 ms
Click4Assistance272 s77 ms
Fastest Forward332 s57 ms
Pagefair352 s53 ms
Fastly Insights231 s64 ms
PrintFriendly281 s49 ms
PhotoBucket151 s89 ms
Eyeota151 s75 ms
Pictela (AOL)31 s367 ms
ContextWeb141 s74 ms
Vindico41 s190 ms
Captify Media80 s60 ms
Intent IQ40 s68 ms
Freshchat20 s57 ms
PubNation20 s55 ms

Future Work

  1. Introduce URL-level data for more fine-grained analysis, i.e. which libraries from Cloudflare/Google CDNs are most expensive.
  2. Expand the scope, i.e. include more third parties and have greater entity/category coverage.

FAQs

I don't see entity X in the list. What's up with that?

This can be for one of several reasons:

  1. The entity does not have references to their origin on at least 50 pages in the dataset.
  2. The entity's origins have not yet been identified. See How can I contribute?

What is "Total Occurences"?

Total Occurrences is the number of pages on which the entity is included.

How is the "Average Impact" determined?

The HTTP Archive dataset includes Lighthouse reports for each URL on mobile. Lighthouse has an audit called "bootup-time" that summarizes the amount of time that each script spent on the main thread. The "Average Impact" for an entity is the total execution time of scripts whose domain matches one of the entity's domains divided by the total number of pages that included the entity.

Average Impact = Total Execution Time / Total Occurrences

How does Lighthouse determine the execution time of each script?

Lighthouse's bootup time audit attempts to attribute all toplevel main-thread tasks to a URL. A main thread task is attributed to the first script URL found in the stack. If you're interested in helping us improve this logic, see Contributing for details.

The data for entity X seems wrong. How can it be corrected?

Verify that the origins in data/entities.json5 are correct. Most issues will simply be the result of mislabelling of shared origins. If everything checks out, there is likely no further action and the data is valid. If you still believe there's errors, file an issue to discuss futher.

How can I contribute?

Only about 90% of the third party script execution has been assigned to an entity. We could use your help identifying the rest! See Contributing for details.

Contributing

Thanks

A huge thanks to @simonhearne and @soulgalore for their assistance in classifying additional domains!

Updating the Entities

The domain->entity mapping can be found in data/entities.json5. Adding a new entity is as simple as adding a new array item with the following form.

{
    "name": "Facebook",
    "homepage": "https://www.facebook.com",
    "categories": ["social"],
    "domains": [
        "*.facebook.com",
        "*.fbcdn.net"
    ],
    "examples": [
        "www.facebook.com",
        "connect.facebook.net",
        "staticxx.facebook.com",
        "static.xx.fbcdn.net",
        "m.facebook.com"
    ]
}

Updating Attribution Logic

The logic for attribution to individual script URLs can be found in the Lighthouse repo. File an issue over there to discuss further.

Updating the Data

The queries used to compute the data are in the sql/ directory.

  1. Edit bootup-time-scripting.partial.sql to query the correct month's HTTPArchive run.
  2. Run origin-query.generated.sql in BigQuery.
  3. Download the results and check them in at data/YYYY-MM-DD-origin-scripting.json.
  4. Run yarn build to regenerate the latest canonical domain mapping.
  5. Create a new table in lighthouse-infrastructure.third_party_web BigQuery table of the format YYYY_MM_DD with the csv in dist/domain-map.csv with three columns domain, canonicalDomain, and category.
  6. Edit bootup-time-scripting.partial.sql to join on the table you just created.
  7. Run yarn build to regenerate the queries.
  8. Run entity-per-page.generated.sql in BigQuery.
  9. Download the results and check them in at data/YYYY-MM-DD-entity-scripting.json.

Updating this README

This README is auto-generated from the templates lib/ and the computed data. In order to update the charts, you'll need to make sure you have cairo installed locally in addition to yarn install.

# Install `cairo` and dependencies for node-canvas
brew install pkg-config cairo pango libpng jpeg giflib
# Build the requirements in this repo
yarn build
# Regenerate the README
yarn start

Updating the website

The web code is located in www/ directory of this repository. Open a PR to make changes.

Keywords

FAQs

Package last updated on 25 Jul 2019

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc