Huge News!Announcing our $40M Series B led by Abstract Ventures.Learn More
Socket
Sign inDemoInstall
Socket

third-party-web

Package Overview
Dependencies
Maintainers
1
Versions
54
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

third-party-web

Categorized data on third party entities on the web.

  • 0.11.1
  • Source
  • npm
  • Socket score

Version published
Weekly downloads
941K
decreased by-0.97%
Maintainers
1
Weekly downloads
 
Created
Source

Third Party Web

Check out the shiny new web UI https://www.thirdpartyweb.today/

Data on third party entities and their impact on the web.

This document is a summary of which third party scripts are most responsible for excessive JavaScript execution on the web today.

Table of Contents

  1. Goals
  2. Methodology
  3. NPM Module
  4. Updates
  5. Data
    1. Summary
    2. How to Interpret
    3. Third Parties by Category
      1. Advertising
      2. Analytics
      3. Social
      4. Video
      5. Developer Utilities
      6. Hosting Platforms
      7. Marketing
      8. Customer Success
      9. Content & Publishing
      10. CDNs
      11. Tag Management
      12. Mixed / Other
    4. Third Parties by Total Impact
  6. Future Work
  7. FAQs
  8. Contributing

Goals

  1. Quantify the impact of third party scripts on the web.
  2. Identify the third party scripts on the web that have the greatest performance cost.
  3. Give developers the information they need to make informed decisions about which third parties to include on their sites.
  4. Incentivize responsible third party script behavior.
  5. Make this information accessible and useful.

Methodology

HTTP Archive is an inititiave that tracks how the web is built. Every month, ~4 million sites are crawled with Lighthouse on mobile. Lighthouse breaks down the total script execution time of each page and attributes the execution to a URL. Using BigQuery, this project aggregates the script execution to the origin-level and assigns each origin to the responsible entity.

NPM Module

The entity classification data is available as an NPM module.

const {getEntity} = require('third-party-web')
const entity = getEntity('https://d36mpcpuzc4ztk.cloudfront.net/js/visitor.js')
console.log(entity)
//   {
//     "name": "Freshdesk",
//     "homepage": "https://freshdesk.com/",
//     "categories": ["customer-success"],
//     "domains": ["d36mpcpuzc4ztk.cloudfront.net"]
//   }

Updates

2019-02-01 dataset

Huge props to WordAds for reducing their impact from ~2.5s to ~200ms on average! A few entities are showing considerably less data this cycle (Media Math, Crazy Egg, DoubleVerify, Bootstrap CDN). Perhaps they've added new CDNs/hostnames that we haven't identified or the basket of sites in HTTPArchive has shifted away from their usage.

2019-03-01 dataset

Almost 2,000 entities tracked now across ~3,000+ domains! Huge props to @simonhearne for making this massive increase possible. Tag Managers have now been split out into their own category since they represented such a large percentage of the "Mixed / Other" category.

2019-05-06 dataset

Google Ads clarified that www.googletagservices.com serves more ad scripts than generic tag management, and it has been reclassified accordingly. This has dropped the overall Tag Management share considerably back down to its earlier position.

2019-05-13 dataset

A shortcoming of the attribution approach has been fixed. Total usage is now reported based on the number of pages in the dataset that use the third-party, not the number of scripts. Correspondingly, all average impact times are now reported per page rather than per script. Previously, a third party could appear to have a lower impact or be more popular simply by splitting their work across multiple files.

Third-parties that performed most of their work from a single script should see little to no impact from this change, but some entities have seen significant ranking movement. Hosting providers that host entire pages are, understandably, the most affected.

Some notable changes below:

Third-PartyPreviously (per-script)Now (per-page)
Beeketing137 ms465 ms
Sumo263 ms798 ms
Tumblr324 ms1499 ms
Yandex APIs393 ms1231 ms
Google Ads402 ms1285 ms
Wix972 ms5393 ms

Data

Summary

Across top ~4 million sites, ~2700 origins account for ~57% of all script execution time with the top 50 entities already accounting for ~47%. Third party script execution is the majority chunk of the web today, and it's important to make informed choices.

How to Interpret

Each entity has a number of data points available.

  1. Usage (Total Number of Occurrences) - how many scripts from their origins were included on pages
  2. Total Impact (Total Execution Time) - how many seconds were spent executing their scripts across the web
  3. Average Impact (Average Execution Time) - on average, how many milliseconds were spent executing each script
  4. Category - what type of script is this

Third Parties by Category

This section breaks down third parties by category. The third parties in each category are ranked from first to last based on the average impact of their scripts. Perhaps the most important comparisons lie here. You always need to pick an analytics provider, but at least you can pick the most well-behaved analytics provider.

Overall Breakdown

Unsurprisingly, ads account for the largest identifiable chunk of third party script execution.

breakdown by category

Advertising

These scripts are part of advertising networks, either serving or measuring.

RankNameUsageAverage Impact
1Nend1,25136 ms
2ExoClick1,77852 ms
3SublimeSkinz1,21653 ms
4MailMunch4,65462 ms
5Branch Metrics1,05064 ms
6Tynt25,00370 ms
7Adyoulike1,61472 ms
8Rakuten Marketing1,61173 ms
9FreakOut3,87076 ms
10PushCrew3,62178 ms
11BlueKai3,97678 ms
12Constant Contact1,56379 ms
13District M6,74481 ms
14Gemius7,34488 ms
15Nativo1,12496 ms
16i-mobile4,57799 ms
17Adroll5,404100 ms
18Media Math2,081104 ms
19Popads2,997105 ms
20Unbounce2,684110 ms
21DTSCOUT4,476113 ms
22STINGRAY2,475113 ms
23LINE Corporation4,292114 ms
24Sharethrough2,059114 ms
25Outbrain4,723116 ms
26Refersion1,371117 ms
27Intercept Interactive1,005117 ms
28JuicyAds2,030120 ms
29Bizible1,260133 ms
30SmartAdServer3,396142 ms
31Index Exchange5,008143 ms
32Rubicon Project35,955145 ms
33Scorecard Research28,766148 ms
34IPONWEB1,185149 ms
35Bing Ads16,223151 ms
36Skimbit20,440159 ms
37Smart AdServer2,419163 ms
38Yahoo!9,248165 ms
39OptiMonk1,374172 ms
40Sortable1,580176 ms
41Adform8,220182 ms
42Celtra3,706184 ms
43Media.net25,352185 ms
44Cxense4,788185 ms
45Permutive1,098186 ms
46Intent Media6,992187 ms
47Amazon Ads20,719188 ms
48Teads4,827201 ms
49AOL / Oath / Verizon Media2,073212 ms
50AppNexus3,499215 ms
51Pubmatic63,997225 ms
52Perfect Market1,142227 ms
53Criteo77,325227 ms
54TrafficStars2,707246 ms
55WordAds21,071251 ms
56sovrn2,921260 ms
57Adverline Board1,052268 ms
58Privy11,761278 ms
59VigLink8,175279 ms
60LongTail Ad Solutions3,287323 ms
61OpenX1,759324 ms
62Klaviyo11,891350 ms
63Taboola23,206360 ms
64piano1,123397 ms
65Yandex Ads25,094399 ms
66MGID7,087403 ms
67RevJet4,646414 ms
68Digioh1,102437 ms
69HyperInzerce1,377455 ms
70iBillboard1,020505 ms
71Sizmek3,909535 ms
72MediaVine5,647625 ms
73Bridgewell DSP21,594638 ms
74Admixer for Publishers1,136643 ms
75Moat20,045666 ms
76Simplicity Marketing3,045687 ms
77SpringServer1,385709 ms
78DoubleVerify11,760746 ms
79LoyaltyLion1,104780 ms
80Vidible1,569936 ms
81Adloox5,057968 ms
82Infolinks3,657983 ms
83Integral Ad Science28,273983 ms
84LKQD1,7471545 ms
85fam2,1881779 ms
86Google/Doubleclick Ads650,7271803 ms

Analytics

These scripts measure or track users and their actions. There's a wide range in impact here depending on what's being tracked.

RankNameUsageAverage Impact
1Alexa1,12331 ms
2WordPress Site Stats2,20661 ms
3Treasure Data4,49363 ms
4Roxr Software2,14265 ms
5Amplitude Mobile Analytics1,80868 ms
6StatCounter10,17168 ms
7Searchanise2,73970 ms
8Heap2,83174 ms
9Google Analytics1,314,34474 ms
10Mixpanel6,23578 ms
11Chartbeat4,90178 ms
12Hotjar157,25488 ms
13Quantcast3,03189 ms
14CallRail7,39294 ms
15Parse.ly3,198102 ms
16etracker1,732103 ms
17Snowplow7,030112 ms
18ContentSquare1,452115 ms
19Marchex4,398115 ms
20Nielsen NetRatings SiteCensus11,993115 ms
21Baidu Analytics12,418119 ms
22Net Reviews2,464162 ms
23VWO4,343167 ms
24Evidon6,074175 ms
25Nosto2,045183 ms
26Trust Pilot13,820189 ms
27Crazy Egg19,547190 ms
28Segment9,598192 ms
29ForeSee1,098195 ms
30FullStory6,815196 ms
31BounceX1,266202 ms
32UserReport1,555221 ms
33mPulse12,514237 ms
34Optimizely11,328248 ms
35Histats10,663252 ms
36Marketo1,315256 ms
37Ezoic4,219292 ms
38Gigya5,826308 ms
39Clicktale1,091378 ms
40Bazaarvoice1,740380 ms
41Keen2,615405 ms
42Inspectlet5,822411 ms
43Snapchat11,148431 ms
44Feefo.com1,674494 ms
45Yandex Metrica270,514501 ms
46Lucky Orange8,042517 ms
47DigiTrust1,701519 ms
48Salesforce19,599575 ms
49Revolver Maps1,106583 ms
50Mouseflow1,743625 ms
51IBM Digital Analytics1,082875 ms
52AB Tasty3,3631559 ms

Social

These scripts enable social features.

RankNameUsageAverage Impact
1AddToAny25,06969 ms
2Shareaholic3,46582 ms
3Pinterest16,30297 ms
4VK15,50397 ms
5Kakao12,590100 ms
6LinkedIn15,987119 ms
7Twitter234,572134 ms
8Instagram9,351146 ms
9Facebook1,444,810223 ms
10Yandex Share29,685230 ms
11ShareThis36,317279 ms
12SocialShopWave1,405417 ms
13AddThis126,104462 ms
14Disqus1,816822 ms
15PIXNET48,1461088 ms
16LiveJournal3,4941622 ms
17Tumblr8,7702146 ms

Video

These scripts enable video player and streaming functionality.

RankNameUsageAverage Impact
1Vimeo14,147249 ms
2Brightcove6,438693 ms
3Wistia12,612870 ms
4YouTube390,0541618 ms

Developer Utilities

These scripts are developer utilities (API clients, site monitoring, fraud detection, etc).

RankNameUsageAverage Impact
1Trusted Shops2,28036 ms
2LightWidget3,24257 ms
3Siteimprove2,02382 ms
4GetSiteControl1,63895 ms
5TRUSTe1,86999 ms
6iubenda13,02999 ms
7Optanon1,682101 ms
8Affirm1,927105 ms
9iovation1,132105 ms
10New Relic6,954107 ms
11Cookiebot9,126126 ms
12Bold Commerce11,050138 ms
13Sift Science1,043147 ms
14Other Google APIs/SDKs532,252157 ms
15AddEvent1,326161 ms
16Swiftype1,528161 ms
17TrustArc4,796163 ms
18Amazon Pay5,356184 ms
19Seznam1,844186 ms
20MaxCDN Enterprise2,085223 ms
21AppDynamics1,667223 ms
22GitHub1,198257 ms
23Distil Networks10,078336 ms
24PayPal12,485353 ms
25Cloudflare36,203361 ms
26Stripe18,462397 ms
27Google Maps270,086398 ms
28Secomapp1,635438 ms
29Bugsnag1,314465 ms
30Sentry11,033466 ms
31Rambler9,143612 ms
32Fastly5,142716 ms
33GoDaddy6,086831 ms
34Mapbox5,3781048 ms
35Yandex APIs22,9711057 ms
36Esri ArcGIS1,3953005 ms

Hosting Platforms

These scripts are from web hosting platforms (WordPress, Wix, Squarespace, etc). Note that in this category, this can sometimes be the entirety of script on the page, and so the "impact" rank might be misleading. In the case of WordPress, this just indicates the libraries hosted and served by WordPress not all sites using self-hosted WordPress.

RankNameUsageAverage Impact
1WordPress131,777214 ms
2Salesforce Commerce Cloud2,659357 ms
3Blogger24,739464 ms
4Squarespace38,716888 ms
5Shopify81,850901 ms
6Adobe Business Catalyst3,9271004 ms
7CDK Dealer Management3,5171190 ms
8Weebly15,2861227 ms
9Dealer9,0171427 ms
10Hatena Blog16,3141834 ms
11Wix49,6665321 ms

Marketing

These scripts are from marketing tools that add popups/newsletters/etc.

RankNameUsageAverage Impact
1RD Station4,16670 ms
2iZooto1,05777 ms
3Beeketing3,36981 ms
4Listrak1,132145 ms
5Ve2,795151 ms
6Dataxu3,325152 ms
7Hubspot28,497169 ms
8Yotpo12,756203 ms
9Mailchimp21,068211 ms
10OptinMonster9,053264 ms
11Pardot1,398436 ms
12Albacross1,894516 ms
13Bigcommerce9,546609 ms
14Sumo19,970682 ms
15Drift6,1721105 ms
16PureCars2,6602017 ms
17Tray Commerce2,3732448 ms

Customer Success

These scripts are from customer support/marketing providers that offer chat and contact solutions. These scripts are generally heavier in weight.

RankNameUsageAverage Impact
1SnapEngage1,21258 ms
2Pure Chat3,59366 ms
3Foursixty1,31070 ms
4LivePerson4,447116 ms
5iPerceptions2,237124 ms
6Comm1001,310141 ms
7iAdvize SAS1,023333 ms
8Tidio Live Chat9,086350 ms
9ContactAtOnce3,478368 ms
10LiveChat18,439381 ms
11Tawk.to56,580385 ms
12Help Scout1,949403 ms
13Intercom14,468411 ms
14Jivochat38,980501 ms
15Smartsupp13,932565 ms
16Olark7,205653 ms
17ZenDesk69,743756 ms

Content & Publishing

These scripts are from content providers or publishing-specific affiliate tracking.

RankNameUsageAverage Impact
1Research Online1,26160 ms
2Accuweather1,783117 ms
3Tencent1,258137 ms
4SnapWidget3,085157 ms
5OpenTable2,442160 ms
6Booking.com2,472170 ms
7AMP57,906243 ms
8Embedly3,778428 ms
9Medium1,238429 ms
10issuu2,069627 ms
11Spotify2,930751 ms
12SoundCloud4,276956 ms
13Dailymotion2,3901258 ms

CDNs

These are a mixture of publicly hosted open source libraries (e.g. jQuery) served over different public CDNs and private CDN usage. This category is unique in that the origin may have no responsibility for the performance of what's being served. Note that rank here does not imply one CDN is better than the other. It simply indicates that the scripts being served from that origin are lighter/heavier than the ones served by another.

RankNameUsageAverage Impact
1Adobe TypeKit11,673105 ms
2Yandex CDN2,037150 ms
3Microsoft Hosted Libs5,218164 ms
4jQuery CDN169,655197 ms
5Unpkg4,845212 ms
6Google CDN903,117236 ms
7Azure Web Services8,410260 ms
8Cloudflare CDN110,489275 ms
9JSDelivr CDN37,062328 ms
10Akamai10,541336 ms
11FontAwesome CDN37,844357 ms
12Monotype4,992552 ms
13CreateJS CDN8,9922674 ms

Tag Management

These scripts tend to load lots of other scripts and initiate many tasks.

RankNameUsageAverage Impact
1BrightTag / Signal7,780114 ms
2TagCommander1,205119 ms
3Google Tag Manager612,837120 ms
4Adobe Tag Manager32,900309 ms
5Tealium13,033340 ms
6Ensighten5,412476 ms

Mixed / Other

These are miscellaneous scripts delivered via a shared origin with no precise category or attribution. Help us out by identifying more origins!

RankNameUsageAverage Impact
1Amazon Web Services40,733153 ms
2ResponsiveVoice1,039290 ms
3All Other 3rd Parties1,359,375298 ms
4Parking Crew11,470362 ms
5uLogin2,3121192 ms

Third Parties by Total Impact

This section highlights the entities responsible for the most script execution across the web. This helps inform which improvements would have the largest total impact.

NamePopularityTotal ImpactAverage Impact
Google/Doubleclick Ads650,7271,173,204 s1803 ms
YouTube390,054631,295 s1618 ms
All Other 3rd Parties1,359,375404,459 s298 ms
Facebook1,444,810322,129 s223 ms
Wix49,666264,250 s5321 ms
Google CDN903,117212,688 s236 ms
Yandex Metrica270,514135,500 s501 ms
Google Maps270,086107,550 s398 ms
Google Analytics1,314,34497,492 s74 ms
Other Google APIs/SDKs532,25283,662 s157 ms
Shopify81,85073,774 s901 ms
Google Tag Manager612,83773,394 s120 ms
AddThis126,10458,199 s462 ms
ZenDesk69,74352,694 s756 ms
PIXNET48,14652,368 s1088 ms
Squarespace38,71634,398 s888 ms
jQuery CDN169,65533,429 s197 ms
Twitter234,57231,320 s134 ms
Cloudflare CDN110,48930,408 s275 ms
Hatena Blog16,31429,919 s1834 ms
WordPress131,77728,140 s214 ms
Integral Ad Science28,27327,793 s983 ms
Yandex APIs22,97124,273 s1057 ms
CreateJS CDN8,99224,041 s2674 ms
Tawk.to56,58021,773 s385 ms
Jivochat38,98019,527 s501 ms
Tumblr8,77018,816 s2146 ms
Weebly15,28618,754 s1227 ms
Criteo77,32517,566 s227 ms
Pubmatic63,99714,390 s225 ms
AMP57,90614,063 s243 ms
Hotjar157,25413,817 s88 ms
Bridgewell DSP21,59413,785 s638 ms
Sumo19,97013,627 s682 ms
FontAwesome CDN37,84413,505 s357 ms
Moat20,04513,350 s666 ms
Cloudflare36,20313,058 s361 ms
Dealer9,01712,870 s1427 ms
JSDelivr CDN37,06212,163 s328 ms
Blogger24,73911,482 s464 ms
Salesforce19,59911,270 s575 ms
Wistia12,61210,968 s870 ms
Adobe Tag Manager32,90010,173 s309 ms
ShareThis36,31710,135 s279 ms
Yandex Ads25,09410,005 s399 ms
DoubleVerify11,7608,768 s746 ms
Taboola23,2068,344 s360 ms
Smartsupp13,9327,872 s565 ms
Stripe18,4627,329 s397 ms
LiveChat18,4397,029 s381 ms
Yandex Share29,6856,834 s230 ms
Drift6,1726,821 s1105 ms
Amazon Web Services40,7336,235 s153 ms
Intercom14,4685,945 s411 ms
Bigcommerce9,5465,812 s609 ms
Tray Commerce2,3735,809 s2448 ms
LiveJournal3,4945,669 s1622 ms
Mapbox5,3785,634 s1048 ms
Rambler9,1435,597 s612 ms
PureCars2,6605,366 s2017 ms
WordAds21,0715,297 s251 ms
AB Tasty3,3635,243 s1559 ms
Rubicon Project35,9555,229 s145 ms
Sentry11,0335,144 s466 ms
GoDaddy6,0865,055 s831 ms
Adloox5,0574,895 s968 ms
Hubspot28,4974,829 s169 ms
Snapchat11,1484,808 s431 ms
Olark7,2054,708 s653 ms
Media.net25,3524,691 s185 ms
Brightcove6,4384,459 s693 ms
Mailchimp21,0684,441 s211 ms
Tealium13,0334,425 s340 ms
PayPal12,4854,412 s353 ms
Scorecard Research28,7664,267 s148 ms
Esri ArcGIS1,3954,191 s3005 ms
CDK Dealer Management3,5174,184 s1190 ms
Klaviyo11,8914,160 s350 ms
Lucky Orange8,0424,154 s517 ms
Parking Crew11,4704,151 s362 ms
SoundCloud4,2764,086 s956 ms
Adobe Business Catalyst3,9273,942 s1004 ms
fam2,1883,892 s1779 ms
Amazon Ads20,7193,889 s188 ms
Crazy Egg19,5473,721 s190 ms
Fastly5,1423,680 s716 ms
Infolinks3,6573,594 s983 ms
Akamai10,5413,543 s336 ms
MediaVine5,6473,528 s625 ms
Vimeo14,1473,520 s249 ms
Distil Networks10,0783,391 s336 ms
Privy11,7613,266 s278 ms
Skimbit20,4403,259 s159 ms
Tidio Live Chat9,0863,179 s350 ms
Dailymotion2,3903,007 s1258 ms
mPulse12,5142,962 s237 ms
MGID7,0872,853 s403 ms
Optimizely11,3282,808 s248 ms
Monotype4,9922,757 s552 ms
uLogin2,3122,755 s1192 ms
LKQD1,7472,700 s1545 ms
Histats10,6632,684 s252 ms
Trust Pilot13,8202,606 s189 ms
Yotpo12,7562,591 s203 ms
Ensighten5,4122,577 s476 ms
Bing Ads16,2232,442 s151 ms
Inspectlet5,8222,393 s411 ms
OptinMonster9,0532,386 s264 ms
VigLink8,1752,284 s279 ms
Spotify2,9302,200 s751 ms
Azure Web Services8,4102,186 s260 ms
WebsiteBuilder.com6722,146 s3194 ms
Sizmek3,9092,091 s535 ms
Simplicity Marketing3,0452,091 s687 ms
RevJet4,6461,924 s414 ms
LinkedIn15,9871,902 s119 ms
Segment9,5981,840 s192 ms
Gigya5,8261,792 s308 ms
Tynt25,0031,748 s70 ms
AddToAny25,0691,721 s69 ms
Embedly3,7781,615 s428 ms
Pinterest16,3021,576 s97 ms
Bold Commerce11,0501,527 s138 ms
Yahoo!9,2481,521 s165 ms
VK15,5031,501 s97 ms
Adform8,2201,495 s182 ms
Twitch8231,494 s1816 ms
Blindado6811,494 s2193 ms
Disqus1,8161,492 s822 ms
Baidu Analytics12,4181,482 s119 ms
Vidible1,5691,469 s936 ms
Nielsen NetRatings SiteCensus11,9931,382 s115 ms
Instagram9,3511,370 s146 ms
FullStory6,8151,335 s196 ms
Intent Media6,9921,307 s187 ms
issuu2,0691,297 s627 ms
iubenda13,0291,296 s99 ms
ContactAtOnce3,4781,278 s368 ms
Kakao12,5901,259 s100 ms
Ezoic4,2191,234 s292 ms
Adobe TypeKit11,6731,230 s105 ms
Cookiebot9,1261,149 s126 ms
Mouseflow1,7431,090 s625 ms
AdMatic9961,074 s1079 ms
LongTail Ad Solutions3,2871,062 s323 ms
Evidon6,0741,060 s175 ms
Keen2,6151,059 s405 ms
Dynamic Yield9421,028 s1091 ms
Unpkg4,8451,026 s212 ms
Amazon Pay5,356983 s184 ms
SpringServer1,385982 s709 ms
Albacross1,894978 s516 ms
Teads4,827971 s201 ms
Salesforce Commerce Cloud2,659950 s357 ms
IBM Digital Analytics1,082946 s875 ms
Cxense4,788887 s185 ms
BrightTag / Signal7,780885 s114 ms
DigiTrust1,701884 s519 ms
LoyaltyLion1,104861 s780 ms
Microsoft Hosted Libs5,218854 s164 ms
Feefo.com1,674827 s494 ms
Help Scout1,949786 s403 ms
Snowplow7,030785 s112 ms
TrustArc4,796781 s163 ms
StickyADS.tv858775 s904 ms
sovrn2,921759 s260 ms
AppNexus3,499752 s215 ms
New Relic6,954746 s107 ms
Yieldify566735 s1299 ms
Admixer for Publishers1,136730 s643 ms
VWO4,343727 s167 ms
Ecwid973716 s735 ms
Secomapp1,635715 s438 ms
Index Exchange5,008714 s143 ms
Kaltura Video Platform487697 s1432 ms
CallRail7,392697 s94 ms
StatCounter10,171697 s68 ms
SessionCam888683 s769 ms
Celtra3,706681 s184 ms
TINT288680 s2363 ms
TrafficStars2,707666 s246 ms
Bazaarvoice1,740660 s380 ms
Gemius7,344650 s88 ms
Revolver Maps1,106645 s583 ms
Okas Concepts622642 s1032 ms
HyperInzerce1,377627 s455 ms
Heroku949626 s659 ms
Bugsnag1,314611 s465 ms
Pardot1,398610 s436 ms
SocialShopWave1,405586 s417 ms
33 Across744574 s772 ms
OpenX1,759570 s324 ms
Wicked Reports657567 s863 ms
Quantum Metric536559 s1043 ms
Outbrain4,723550 s116 ms
District M6,744545 s81 ms
Adroll5,404538 s100 ms
Medium1,238531 s429 ms
Sekindo296526 s1775 ms
LivePerson4,447516 s116 ms
iBillboard1,020515 s505 ms
Hotmart239507 s2119 ms
Marchex4,398506 s115 ms
Dataxu3,325504 s152 ms
DTSCOUT4,476504 s113 ms
LINE Corporation4,292490 s114 ms
SnapWidget3,085486 s157 ms
Mixpanel6,235485 s78 ms
SmartAdServer3,396481 s142 ms
Digioh1,102481 s437 ms
Meetrics780472 s605 ms
MaxCDN Enterprise2,085464 s223 ms
BannerFlow828454 s549 ms
i-mobile4,577451 s99 ms
Supership697447 s642 ms
piano1,123446 s397 ms
AOL / Oath / Verizon Media2,073440 s212 ms
Adocean818427 s521 ms
Fort Awesome825426 s516 ms
Ve2,795421 s151 ms
Vidyard412420 s1020 ms
Booking.com2,472419 s170 ms
Clicktale1,091412 s378 ms
Net Reviews2,464400 s162 ms
Smart AdServer2,419393 s163 ms
OpenTable2,442392 s160 ms
Zmags159385 s2422 ms
Chartbeat4,901384 s78 ms
Media Management Technologies663377 s569 ms
Nosto2,045374 s183 ms
AppDynamics1,667372 s223 ms
TrackJS840365 s434 ms
Tribal Fusion915353 s386 ms
LoopMe510344 s675 ms
UserReport1,555343 s221 ms
Seznam1,844342 s186 ms
iAdvize SAS1,023341 s333 ms
StreamRail223340 s1526 ms
Marketo1,315337 s256 ms
Parse.ly3,198327 s102 ms
Signyfyd282321 s1137 ms
Audience 360432320 s741 ms
Technorati637315 s495 ms
Popads2,997314 s105 ms
BlueKai3,976309 s78 ms
ThreatMetrix253308 s1219 ms
GitHub1,198307 s257 ms
Yandex CDN2,037306 s150 ms
Dynatrace397305 s767 ms
ResponsiveVoice1,039301 s290 ms
Wishpond Technologies667300 s449 ms
Unbounce2,684296 s110 ms
FreakOut3,870295 s76 ms
RD Station4,166292 s70 ms
MailMunch4,654288 s62 ms
Treasure Data4,493285 s63 ms
Shareaholic3,465282 s82 ms
Adverline Board1,052282 s268 ms
PushCrew3,621281 s78 ms
STINGRAY2,475280 s113 ms
Between Digital516279 s541 ms
Sortable1,580279 s176 ms
iPerceptions2,237278 s124 ms
Verizon Digital Media CDN272278 s1020 ms
Decibel Insight567275 s485 ms
Beeketing3,369274 s81 ms
Ooyala367273 s745 ms
Quantcast3,031269 s89 ms
Maxymiser899264 s294 ms
Perfect Market1,142259 s227 ms
Yieldmo748257 s344 ms
BounceX1,266256 s202 ms
Auto Link Maker891252 s283 ms
ZEDO418250 s598 ms
Pixlee447247 s553 ms
Swiftype1,528247 s161 ms
Opta407245 s603 ms
FirstImpression465244 s524 ms
JuicyAds2,030244 s120 ms
Reviews.co.uk622242 s390 ms
Pure Chat3,593238 s66 ms
SearchSpring383238 s621 ms
Market GID731237 s324 ms
OptiMonk1,374236 s172 ms
Sharethrough2,059236 s114 ms
Experian Cross-Channel Marketing Platform139233 s1679 ms
Polar841229 s272 ms
GIPHY187223 s1195 ms
Media Math2,081217 s104 ms
AddEvent1,326214 s161 ms
ForeSee1,098214 s195 ms
Accuweather1,783209 s117 ms
Heap2,831208 s74 ms
Knight Lab172206 s1200 ms
Permutive1,098205 s186 ms
Connatix223205 s918 ms
Affirm1,927202 s105 ms
Kampyle882196 s222 ms
Po.st815193 s237 ms
Snacktools644192 s298 ms
Searchanise2,739191 s70 ms
LightWidget3,242186 s57 ms
TRUSTe1,869186 s99 ms
Comm1001,310185 s141 ms
Pagely757182 s240 ms
etracker1,732179 s103 ms
Stackla PTY297179 s602 ms
IPONWEB1,185176 s149 ms
Monetate870175 s201 ms
Opentag869174 s200 ms
Rackspace801173 s216 ms
Tencent1,258172 s137 ms
Optanon1,682169 s101 ms
Expedia131169 s1289 ms
Bizible1,260168 s133 ms
ContentSquare1,452166 s115 ms
Siteimprove2,023166 s82 ms
Listrak1,132164 s145 ms
LiveTex751163 s217 ms
Clerk.io ApS884162 s183 ms
PowerReviews906161 s177 ms
SpotXchange537160 s298 ms
Refersion1,371160 s117 ms
eBay819157 s192 ms
WisePops649157 s242 ms
Fraudlogix628156 s249 ms
GetSiteControl1,638156 s95 ms
Convert Insights977155 s159 ms
Sift Science1,043153 s147 ms
Click Guardian265153 s577 ms
MonetizeMore256152 s593 ms
Touch Commerce154151 s978 ms
Vox Media355149 s419 ms
Hola Networks200148 s741 ms
PageSense903148 s164 ms
Forter471146 s310 ms
Bronto Software954145 s152 ms
TagCommander1,205144 s119 ms
Investis74140 s1895 ms
Roxr Software2,142139 s65 ms
Reviews.io217137 s630 ms
WordPress Site Stats2,206134 s61 ms
Calendly196134 s683 ms
Global-e291133 s459 ms
mParticle349132 s378 ms
PerimeterX Bot Defender248130 s526 ms
Qubit Deliver318130 s410 ms
Forensiq524130 s248 ms
Marketplace Web Service273128 s468 ms
Constant Contact1,563123 s79 ms
Amplitude Mobile Analytics1,808122 s68 ms
plista726122 s168 ms
Moovweb58121 s2086 ms
Curalate379120 s317 ms
Skype709120 s170 ms
iovation1,132119 s105 ms
Intercept Interactive1,005118 s117 ms
Cloudinary395117 s297 ms
Rakuten Marketing1,611117 s73 ms
AvantLink181116 s643 ms
Adyoulike1,614116 s72 ms
Underdog Media303116 s381 ms
WebpageFX405113 s279 ms
Evergage493112 s227 ms
Gfycat66108 s1634 ms
Nativo1,124107 s96 ms
Auth0252107 s423 ms
TripAdvisor603106 s176 ms
Freshdesk738105 s143 ms
Flickr240105 s436 ms
GetIntent RTBSuite173103 s594 ms
Yottaa263102 s388 ms
[24]7131100 s760 ms
Unruly Media44999 s221 ms
Bootstrap Chinese network37899 s263 ms
Symantec97899 s101 ms
Mather Economics71198 s138 ms
Github80398 s122 ms
Revcontent47896 s201 ms
Flowplayer39696 s242 ms
Apester37895 s253 ms
ExoClick1,77893 s52 ms
Covert Pics37892 s242 ms
Foursixty1,31092 s70 ms
Adthink7788 s1142 ms
Concert35687 s245 ms
Usabilla85087 s103 ms
WebEngage59085 s144 ms
Trusted Shops2,28083 s36 ms
Playbuzz19382 s426 ms
iZooto1,05781 s77 ms
Lytics60981 s133 ms
Livefyre23881 s340 ms
infogr.am6681 s1220 ms
WalkMe14979 s528 ms
Interpublic Group44978 s173 ms
Attentive64978 s120 ms
GetResponse88678 s87 ms
Onet15077 s515 ms
Smart Insight Tracking89576 s85 ms
Research Online1,26176 s60 ms
Sidecar25675 s293 ms
BoldChat45174 s163 ms
Geniee90173 s81 ms
AIR.TV69273 s106 ms
Shopgate32471 s221 ms
Janrain12271 s583 ms
SnapEngage1,21271 s58 ms
DMD Marketing32071 s221 ms
Snack Media29471 s240 ms
rewardStyle.com49171 s144 ms
AddShoppers46769 s148 ms
Kameleoon18269 s377 ms
Keywee43568 s156 ms
Typepad33368 s204 ms
Arbor35768 s189 ms
Picreel51167 s132 ms
FoxyCart32967 s205 ms
Branch Metrics1,05067 s64 ms
Adkontekst23867 s281 ms
Weborama50564 s127 ms
SublimeSkinz1,21664 s53 ms
AdSniper16063 s394 ms
Mobify12063 s523 ms
Adobe Test & Target9262 s670 ms
Adition30062 s205 ms
News19261 s320 ms
Wufoo77761 s79 ms
The Hut Group23661 s258 ms
InSkin Media8261 s739 ms
MaxMind33060 s182 ms
Simpli.fi34759 s170 ms
Radar60759 s97 ms
Impact Radius21158 s274 ms
ClickDesk66458 s87 ms
Ambassador21057 s271 ms
Affiliate Window90756 s61 ms
PlayAd Media Group11156 s501 ms
unpkg29555 s187 ms
Reevoo19555 s280 ms
Pendo51253 s104 ms
Cachefly15452 s336 ms
Tail Target51751 s99 ms
Bootstrap CDN93651 s54 ms
Best Of Media S.A.20251 s250 ms
ReachForce5650 s888 ms
RebelMouse5049 s987 ms
Postcode Anywhere (Holdings)15949 s308 ms
OneSignal42848 s112 ms
Adobe Scene752548 s91 ms
Autopilot55448 s86 ms
ReCollect6948 s690 ms
WebSpectator20547 s230 ms
LinkedIn Ads39747 s118 ms
AdsWizz18346 s253 ms
Highcharts35346 s130 ms
ShopRunner9646 s479 ms
Profitshare25845 s175 ms
Nend1,25145 s36 ms
JustPremium Ads37845 s118 ms
Google Plus49444 s89 ms
Reflektion12943 s333 ms
Kaizen Platform19743 s216 ms
Pusher12842 s332 ms
Sajari Pty24442 s173 ms
Ad6Media14442 s292 ms
LiveHelpNow35242 s119 ms
reEmbed20642 s204 ms
Moxie11942 s352 ms
Adnium22941 s181 ms
SurveyMonkey25641 s161 ms
Crowd Control58241 s71 ms
Spot.IM11241 s366 ms
ReadSpeaker38241 s107 ms
Survicate23541 s174 ms
CPEx27541 s149 ms
SaleCycle58041 s70 ms
Zanox31141 s131 ms
Appier47340 s86 ms
Adyen5640 s715 ms
Fresh Relevance43040 s92 ms
Adscale33140 s120 ms
Usersnap12839 s305 ms
The Trade Desk44039 s89 ms
AdRiver20039 s195 ms
Riskified54837 s68 ms
Conversant Tag Manager14737 s254 ms
Gleam39737 s94 ms
Clicktripz36537 s102 ms
Tradelab45137 s82 ms
Dynamic Converter8537 s430 ms
IBM Acoustic Campaign52036 s70 ms
Petametrics24636 s148 ms
AudienceSearch54636 s66 ms
Talkable38236 s93 ms
Rocket Fuel45035 s78 ms
Key CDN28835 s122 ms
Alexa1,12335 s31 ms
Socialphotos20735 s169 ms
Effective Measure45834 s74 ms
Madison Logic46534 s73 ms
Braze31334 s108 ms
Kargo5434 s623 ms
Ipify30734 s110 ms
Salesforce Live Agent5633 s596 ms
Fastly Insights56333 s58 ms
Vibrant Media26932 s120 ms
Alchemy8132 s397 ms
TruConversion21632 s148 ms
ZergNet5432 s591 ms
Sooqr Search48131 s65 ms
fluct74731 s42 ms
SkyScanner12631 s246 ms
Vergic AB10630 s285 ms
Tagboard13430 s222 ms
MLveda7430 s401 ms
Omniconvert33230 s89 ms
Browsealoud57729 s50 ms
DemandBase33928 s83 ms
Salesforce.com46328 s61 ms
Expedia USA8428 s333 ms
Resonance Insights12228 s229 ms
Advance Magazine Group19128 s145 ms
Luigi’s Box22728 s122 ms
Viacom16928 s163 ms
Proper Media12427 s220 ms
VoiceFive28327 s96 ms
GumGum52427 s51 ms
Transifex12626 s207 ms
Conversion Labs6726 s390 ms
Sparkflow21326 s122 ms
KISSmetrics39626 s66 ms
CNET Content Solutions7725 s329 ms
Mediahawk8625 s294 ms
User Replay6725 s377 ms
Zarget17225 s146 ms
Steelhouse26625 s94 ms
Delta Projects AB29425 s85 ms
Turn30525 s82 ms
Reklama21124 s115 ms
Qualaroo36624 s66 ms
Customer.io20624 s116 ms
Feedbackify29024 s82 ms
Fanplayr21323 s110 ms
FLXone14823 s158 ms
Pingdom RUM8223 s276 ms
Mopinion13622 s164 ms
Sirv25022 s89 ms
SlimCut Media Outstream13022 s170 ms
Rakuten LinkShare15022 s146 ms
Vivocha S.p.A15622 s139 ms
Expedia Australia5522 s395 ms
Edge Web Fonts26622 s81 ms
bRealTime16122 s134 ms
Vee247321 s294 ms
linkpulse31721 s67 ms
Wow Analytics11821 s175 ms
DialogTech21321 s97 ms
Polldaddy12020 s171 ms
Infinity Tracking25720 s80 ms
AI Media Group10320 s198 ms
Travelocity USA5420 s377 ms
Vergic Engage Platform8020 s250 ms
Sweet Tooth23020 s87 ms
Opinion Stage15220 s131 ms
Iterate7019 s274 ms
Storygize14419 s132 ms
PebblePost6519 s291 ms
Civic29319 s64 ms
Triblio9819 s189 ms
epoq internet services17718 s103 ms
Userzoom10318 s176 ms
TechTarget5718 s316 ms
CleverTap22818 s78 ms
Barilliance12618 s141 ms
AWeber16917 s101 ms
LoginRadius8317 s206 ms
Flockler10317 s166 ms
ResponseTap24717 s69 ms
Conversio22417 s75 ms
Acceptable Ads14917 s112 ms
NetAffiliation17417 s96 ms
Dropbox5417 s308 ms
Borderfree5716 s286 ms
VidPulse7916 s205 ms
RichRelevance6516 s249 ms
Ghostery Enterprise7216 s219 ms
Hull.js9216 s170 ms
Republer16715 s93 ms
Elastic Ad17615 s87 ms
Alliance for Audited Media6115 s250 ms
The Publisher Desk5515 s275 ms
Cookie-Script.com16315 s93 ms
Smartlook5115 s295 ms
Accordant Media21115 s71 ms
Hupso Website Analyzer25115 s60 ms
OnScroll14015 s106 ms
Bookatable14814 s95 ms
Widespace14013 s96 ms
Twitter Online Conversion Tracking9513 s141 ms
Meltwater Group8413 s158 ms
cloudIQ11713 s113 ms
Qualtrics11213 s118 ms
Klevu Search21813 s59 ms
Friendbuy11613 s111 ms
reddit11813 s108 ms
Bluecore15912 s78 ms
Fonecall7412 s168 ms
The ADEX21312 s58 ms
Pixalate8012 s152 ms
Netlify16612 s73 ms
Vertical Mass6912 s171 ms
GoSquared18612 s64 ms
Cookie Reports11912 s97 ms
Elecard StreamEye5611 s201 ms
CANDDi8011 s141 ms
Woopra15111 s74 ms
Optimove10211 s109 ms
Prezi5911 s187 ms
Tag Inspector9911 s111 ms
One by AOL5111 s215 ms
Rakuten MediaForge6911 s155 ms
Drip25811 s41 ms
Site24x7 Real User Monitoring12411 s85 ms
CyberSource (Visa)16711 s63 ms
Adobe Marketing Cloud15011 s70 ms
Byside6210 s166 ms
PowerFront5410 s185 ms
Navegg19210 s52 ms
Web Dissector6710 s145 ms
MaxPoint Interactive899 s105 ms
TripleLift819 s115 ms
Datonics1289 s72 ms
Exponea1469 s63 ms
AnswerDash729 s127 ms
Microad1139 s80 ms
Sonobi759 s121 ms
Reactful839 s107 ms
MailPlus809 s111 ms
Polyfill service919 s95 ms
Oracle Recommendations On Demand968 s88 ms
OwnerIQ1528 s55 ms
JingDong578 s145 ms
HotelsCombined698 s119 ms
Raygun838 s97 ms
UPS i-parcel658 s121 ms
Exactag808 s98 ms
Betgenius1108 s68 ms
Braintree Payments777 s97 ms
Remintrex917 s81 ms
AdTrue647 s115 ms
Attribution1127 s65 ms
SecuredVisit1147 s64 ms
StackAdapt617 s117 ms
Filestack687 s104 ms
CleverDATA877 s79 ms
Exponential Interactive1717 s40 ms
ShopStorm737 s92 ms
Netmining1347 s49 ms
Extole607 s109 ms
Ziff Davis Tech1007 s65 ms
DistroScale547 s121 ms
Swoop1106 s59 ms
TurnTo596 s108 ms
RightNow Service Cloud606 s105 ms
Council ad Network916 s69 ms
Freespee776 s81 ms
AdvertServe726 s85 ms
Sojern926 s64 ms
Realytics916 s65 ms
Video Media Groep666 s88 ms
Ekm Systems1136 s50 ms
Mux606 s93 ms
UpSellit645 s86 ms
emetriq925 s59 ms
NaviStone635 s83 ms
Datacamp655 s80 ms
OneSoon725 s71 ms
AdSupply515 s95 ms
Intilery625 s78 ms
Sailthru775 s61 ms
Holimetrix715 s66 ms
Boomtrain634 s70 ms
Cardosa Enterprises614 s72 ms
Neodata704 s61 ms
DialogTech SourceTrak774 s55 ms
Aggregate Knowledge654 s63 ms
Perfect Audience554 s72 ms
Klarna564 s65 ms
Hawk Search634 s57 ms
JustUno1533 s20 ms
Xaxis543 s56 ms
Catchpoint563 s53 ms
Fastest Forward552 s43 ms
Gravatar522 s38 ms
Reach Group671 s18 ms

Future Work

  1. Introduce URL-level data for more fine-grained analysis, i.e. which libraries from Cloudflare/Google CDNs are most expensive.
  2. Expand the scope, i.e. include more third parties and have greater entity/category coverage.

FAQs

I don't see entity X in the list. What's up with that?

This can be for one of several reasons:

  1. The entity does not have references to their origin on at least 50 pages in the dataset.
  2. The entity's origins have not yet been identified. See How can I contribute?

What is "Total Occurences"?

Total Occurrences is the number of pages on which the entity is included.

How is the "Average Impact" determined?

The HTTP Archive dataset includes Lighthouse reports for each URL on mobile. Lighthouse has an audit called "bootup-time" that summarizes the amount of time that each script spent on the main thread. The "Average Impact" for an entity is the total execution time of scripts whose domain matches one of the entity's domains divided by the total number of pages that included the entity.

Average Impact = Total Execution Time / Total Occurrences

How does Lighthouse determine the execution time of each script?

Lighthouse's bootup time audit attempts to attribute all toplevel main-thread tasks to a URL. A main thread task is attributed to the first script URL found in the stack. If you're interested in helping us improve this logic, see Contributing for details.

The data for entity X seems wrong. How can it be corrected?

Verify that the origins in data/entities.json5 are correct. Most issues will simply be the result of mislabelling of shared origins. If everything checks out, there is likely no further action and the data is valid. If you still believe there's errors, file an issue to discuss futher.

How can I contribute?

Only about 90% of the third party script execution has been assigned to an entity. We could use your help identifying the rest! See Contributing for details.

Contributing

Thanks

A huge thanks to @simonhearne and @soulgalore for their assistance in classifying additional domains!

Updating the Entities

The domain->entity mapping can be found in data/entities.json5. Adding a new entity is as simple as adding a new array item with the following form.

{
    "name": "Facebook",
    "homepage": "https://www.facebook.com",
    "categories": ["social"],
    "domains": [
        "*.facebook.com",
        "*.fbcdn.net"
    ],
    "examples": [
        "www.facebook.com",
        "connect.facebook.net",
        "staticxx.facebook.com",
        "static.xx.fbcdn.net",
        "m.facebook.com"
    ]
}

Updating Attribution Logic

The logic for attribution to individual script URLs can be found in the Lighthouse repo. File an issue over there to discuss further.

Updating the Data

The queries used to compute the data are in the sql/ directory.

  1. Edit all-observed-domains-query.sql to query the correct month's HTTPArchive run.
  2. Run all-observed-domains-query.sql in BigQuery.
  3. Download the results and check them in at data/YYYY-MM-01-observed-domains.json.
  4. Edit bootup-time-scripting.partial.sql to query the correct month's HTTPArchive run.
  5. Run origin-query.generated.sql in BigQuery.
  6. Download the results and check them in at data/YYYY-MM-01-origin-scripting.json.
  7. Run yarn build to regenerate the latest canonical domain mapping.
  8. Create a new table in lighthouse-infrastructure.third_party_web BigQuery table of the format YYYY_MM_01 with the csv in dist/domain-map.csv with three columns domain, canonicalDomain, and category.
  9. Edit bootup-time-scripting.partial.sql to join on the table you just created.
  10. Run yarn build to regenerate the queries.
  11. Run entity-per-page.generated.sql in BigQuery.
  12. Download the results and check them in at data/YYYY-MM-01-entity-scripting.json.
  13. Run web-almanac-all-observed-domains-identification.sql in BigQuery.
  14. Save the results to a BigQuery table YYYY_MM_01_all_observed_domains.

Updating this README

This README is auto-generated from the templates lib/ and the computed data. In order to update the charts, you'll need to make sure you have cairo installed locally in addition to yarn install.

# Install `cairo` and dependencies for node-canvas
brew install pkg-config cairo pango libpng jpeg giflib
# Build the requirements in this repo
yarn build
# Regenerate the README
yarn start

Updating the website

The web code is located in www/ directory of this repository. Open a PR to make changes.

Keywords

FAQs

Package last updated on 17 Jan 2020

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc