third-party-web

Third Party Web

Check out the shiny new web UI https://www.thirdpartyweb.today/

Data on third party entities and their impact on the web.

This document is a summary of which third party scripts are most responsible for excessive JavaScript execution on the web today.

Table of Contents

1. Goals
2. Methodology
3. NPM Module
4. Updates
5. Data
   1. Summary
   2. How to Interpret
   3. Third Parties by Category
      1. Advertising
      2. Analytics
      3. Social
      4. Video
      5. Developer Utilities
      6. Hosting Platforms
      7. Marketing
      8. Customer Success
      9. Content & Publishing
      10. CDNs
      11. Tag Management
      12. Consent Management Provider
      13. Mixed / Other
   4. Third Parties by Total Impact
6. Future Work
7. FAQs
8. Contributing

Goals

1. Quantify the impact of third party scripts on the web.
2. Identify the third party scripts on the web that have the greatest performance cost.
3. Give developers the information they need to make informed decisions about which third parties to include on their sites.
4. Incentivize responsible third party script behavior.
5. Make this information accessible and useful.

Methodology

HTTP Archive is an inititiave that tracks how the web is built. Every month, ~4 million sites are crawled with Lighthouse on mobile. Lighthouse breaks down the total script execution time of each page and attributes the execution to a URL. Using BigQuery, this project aggregates the script execution to the origin-level and assigns each origin to the responsible entity.

NPM Module

The entity classification data is available as an NPM module.

const {getEntity} = require('third-party-web')
const entity = getEntity('https://d36mpcpuzc4ztk.cloudfront.net/js/visitor.js')
console.log(entity)
//   {
//     "name": "Freshdesk",
//     "homepage": "https://freshdesk.com/",
//     "categories": ["customer-success"],
//     "domains": ["d36mpcpuzc4ztk.cloudfront.net"]
//   }

Updates

2021-01-01 dataset

Due to a change in HTTPArchive measurement which temporarily disabled site-isolation (out-of-process iframes), all of the third-parties whose work previously took place off the main-thread are now counted on the main thread (and thus appear in our stats). This is most evident in the change to Google-owned properties such as YouTube and Doubleclick whose complete cost are now captured.

2019-05-13 dataset

A shortcoming of the attribution approach has been fixed. Total usage is now reported based on the number of pages in the dataset that use the third-party, not the number of scripts. Correspondingly, all average impact times are now reported per page rather than per script. Previously, a third party could appear to have a lower impact or be more popular simply by splitting their work across multiple files.

Third-parties that performed most of their work from a single script should see little to no impact from this change, but some entities have seen significant ranking movement. Hosting providers that host entire pages are, understandably, the most affected.

Some notable changes below:

Third-Party	Previously (per-script)	Now (per-page)
Beeketing	137 ms	465 ms
Sumo	263 ms	798 ms
Tumblr	324 ms	1499 ms
Yandex APIs	393 ms	1231 ms
Google Ads	402 ms	1285 ms
Wix	972 ms	5393 ms

2019-05-06 dataset

Google Ads clarified that www.googletagservices.com serves more ad scripts than generic tag management, and it has been reclassified accordingly. This has dropped the overall Tag Management share considerably back down to its earlier position.

2019-03-01 dataset

Almost 2,000 entities tracked now across ~3,000+ domains! Huge props to @simonhearne for making this massive increase possible. Tag Managers have now been split out into their own category since they represented such a large percentage of the "Mixed / Other" category.

2019-02-01 dataset

Huge props to WordAds for reducing their impact from ~2.5s to ~200ms on average! A few entities are showing considerably less data this cycle (Media Math, Crazy Egg, DoubleVerify, Bootstrap CDN). Perhaps they've added new CDNs/hostnames that we haven't identified or the basket of sites in HTTPArchive has shifted away from their usage.

Data

Summary

Across top ~4 million sites, ~2700 origins account for ~57% of all script execution time with the top 50 entities already accounting for ~47%. Third party script execution is the majority chunk of the web today, and it's important to make informed choices.

How to Interpret

Each entity has a number of data points available.

1. Usage (Total Number of Occurrences) - how many scripts from their origins were included on pages
2. Total Impact (Total Execution Time) - how many seconds were spent executing their scripts across the web
3. Average Impact (Average Execution Time) - on average, how many milliseconds were spent executing each script
4. Category - what type of script is this

Third Parties by Category

This section breaks down third parties by category. The third parties in each category are ranked from first to last based on the average impact of their scripts. Perhaps the most important comparisons lie here. You always need to pick an analytics provider, but at least you can pick the most well-behaved analytics provider.

Overall Breakdown

Unsurprisingly, ads account for the largest identifiable chunk of third party script execution.

Advertising

These scripts are part of advertising networks, either serving or measuring.

Rank	Name	Usage	Average Impact
1	Bidswitch	2,969	6 ms
2	ContextWeb	4,743	6 ms
3	DeepIntent	7,406	7 ms
4	Beachfront Media	2,012	9 ms
5	RTB House AdPilot	1,533	11 ms
6	OneTag	8,364	16 ms
7	TripleLift	4,566	21 ms
8	33 Across	7,950	21 ms
9	Sharethrough	4,238	25 ms
10	Constant Contact	9,430	26 ms
11	Yieldmo	2,067	28 ms
12	Tribal Fusion	9,670	34 ms
13	AppNexus	57,074	40 ms
14	Reklama	2,448	41 ms
15	SiteScout	2,998	42 ms
16	Quora Ads	1,895	43 ms
17	StackAdapt	3,254	45 ms
18	Sonobi	3,294	49 ms
19	bRealTime	1,602	51 ms
20	District M	20,086	55 ms
21	OpenX	14,601	56 ms
22	GumGum	23,926	58 ms
23	Nend	5,345	60 ms
24	The Trade Desk	12,628	63 ms
25	BlueCava	5,566	64 ms
26	Twitter Online Conversion Tracking	2,759	66 ms
27	MailMunch	1,560	66 ms
28	F@N Communications	1,660	72 ms
29	Affiliate Window	2,777	80 ms
30	Intercept Interactive	2,401	81 ms
31	Scorecard Research	2,552	82 ms
32	Drip	1,479	83 ms
33	Branch Metrics	3,396	84 ms
34	Media Math	3,122	84 ms
35	Gemius	19,944	89 ms
36	Between Digital	3,938	98 ms
37	Tynt	83,849	99 ms
38	DTSCOUT	20,795	100 ms
39	ExoClick	2,089	102 ms
40	OwnerIQ	2,149	107 ms
41	i-mobile	12,272	107 ms
42	IPONWEB	3,993	108 ms
43	Index Exchange	38,860	109 ms
44	Adform	14,807	112 ms
45	BlueKai	84,454	118 ms
46	Tail Target	2,132	120 ms
47	FreakOut	2,835	121 ms
48	Salesforce.com	2,605	130 ms
49	Unbounce	7,771	131 ms
50	PushCrew	1,725	138 ms
51	Amazon Ads	67,934	139 ms
52	LINE Corporation	13,207	140 ms
53	Yahoo!	6,535	145 ms
54	Bing Ads	32,273	148 ms
55	Adscale	1,432	149 ms
56	LinkedIn Ads	4,893	161 ms
57	Rubicon Project	131,432	166 ms
58	Smart AdServer	8,263	174 ms
59	STINGRAY	2,526	188 ms
60	TrafficStars	6,169	192 ms
61	AudienceSearch	23,576	194 ms
62	JuicyAds	2,770	210 ms
63	Outbrain	5,223	223 ms
64	Teads	3,888	223 ms
65	VigLink	37,492	240 ms
66	Criteo	114,128	244 ms
67	Supership	9,293	251 ms
68	Crowd Control	44,477	260 ms
69	Nativo	1,524	262 ms
70	fluct	5,201	263 ms
71	Skimbit	38,143	267 ms
72	Yandex Ads	23,603	286 ms
73	Geniee	7,516	313 ms
74	Adroll	24,690	327 ms
75	Bizible	1,656	339 ms
76	sovrn	4,246	342 ms
77	Yahoo! JAPAN Ads	13,494	379 ms
78	WordAds	39,511	388 ms
79	Mediavine	8,321	403 ms
80	Privy	16,998	428 ms
81	JustUno	2,258	489 ms
82	Cxense	5,082	494 ms
83	Taboola	32,046	496 ms
84	Pubmatic	139,231	534 ms
85	Media.net	49,448	544 ms
86	Klaviyo	67,488	587 ms
87	Refersion	3,004	608 ms
88	LoyaltyLion	3,441	678 ms
89	Attentive	6,245	690 ms
90	Permutive	1,686	716 ms
91	LongTail Ad Solutions	5,040	750 ms
92	Sortable	1,911	944 ms
93	Moat	7,308	1164 ms
94	Infolinks	4,012	1261 ms
95	DoubleVerify	1,411	1336 ms
96	MGID	12,030	1431 ms
97	Integral Ad Science	4,567	1797 ms
98	Sizmek	5,005	2013 ms
99	Google/Doubleclick Ads	972,081	2028 ms
100	Bridgewell DSP	12,562	3051 ms

Analytics

These scripts measure or track users and their actions. There's a wide range in impact here depending on what's being tracked.

Rank	Name	Usage	Average Impact
1	Sailthru	2,817	55 ms
2	StatCounter	36,804	73 ms
3	Alexa	2,327	76 ms
4	Mouseflow	2,023	76 ms
5	Brandmetrics	2,193	76 ms
6	Treasure Data	8,936	76 ms
7	Roxr Software	6,861	76 ms
8	Conversant	2,631	77 ms
9	WordPress Site Stats	18,696	82 ms
10	Crazy Egg	19,934	89 ms
11	LiveRamp IdentityLink	20,910	93 ms
12	IBM Acoustic Campaign	1,036	95 ms
13	Fastly Insights	6,659	98 ms
14	Quantcast	60,814	99 ms
15	Amplitude Mobile Analytics	7,960	109 ms
16	Google Analytics	4,308,304	113 ms
17	Mixpanel	12,256	117 ms
18	Stamped.io	6,289	117 ms
19	Snowplow	14,783	120 ms
20	CleverTap	1,265	127 ms
21	Searchanise	6,478	135 ms
22	Chartbeat	6,693	147 ms
23	Heap	6,385	153 ms
24	etracker	2,728	156 ms
25	Qualtrics	3,031	163 ms
26	CallRail	12,654	164 ms
27	Smart Insight Tracking	1,927	180 ms
28	Marchex	5,557	180 ms
29	Matomo	1,632	182 ms
30	Braze	1,212	192 ms
31	Trust Pilot	26,742	207 ms
32	Google Optimize	26,875	218 ms
33	Reviews.io	1,107	218 ms
34	Reviews.co.uk	1,938	228 ms
35	Parse.ly	2,994	259 ms
36	Baidu Analytics	21,089	269 ms
37	Marketo	1,369	289 ms
38	Net Reviews	3,905	292 ms
39	PageSense	2,438	307 ms
40	Pendo	2,347	310 ms
41	mPulse	21,908	311 ms
42	Evidon	4,224	313 ms
43	Usabilla	1,347	320 ms
44	TruConversion	1,069	338 ms
45	VWO	6,718	341 ms
46	BowNow	1,224	365 ms
47	Convert Insights	1,586	379 ms
48	Segment	15,140	426 ms
49	Hotjar	259,015	438 ms
50	Clerk.io ApS	1,623	472 ms
51	Bazaarvoice	2,523	509 ms
52	Nielsen NetRatings SiteCensus	18,498	514 ms
53	FullStory	8,318	526 ms
54	Kampyle	1,054	541 ms
55	Snapchat	28,791	554 ms
56	ContentSquare	2,134	559 ms
57	Nosto	1,484	594 ms
58	TrackJS	1,601	719 ms
59	Optimizely	27,437	746 ms
60	Feefo.com	1,929	756 ms
61	PowerReviews	1,313	825 ms
62	BounceX	1,646	905 ms
63	Gigya	2,303	929 ms
64	Salesforce	7,204	947 ms
65	Revolver Maps	1,681	999 ms
66	Lucky Orange	11,842	1010 ms
67	Yandex Metrica	372,651	1010 ms
68	SessionCam	1,249	1025 ms
69	Inspectlet	5,089	1111 ms
70	Dynatrace	1,017	1197 ms
71	KARTE	1,359	1250 ms
72	AB Tasty	3,772	1340 ms
73	Histats	18,722	1874 ms
74	Ezoic	2,122	2078 ms

Social

These scripts enable social features.

Rank	Name	Usage	Average Impact
1	AddToAny	42,529	80 ms
2	Pinterest	124,652	103 ms
3	Shareaholic	1,021	108 ms
4	reddit	1,166	147 ms
5	LinkedIn	14,592	221 ms
6	Facebook	2,084,243	255 ms
7	TikTok	66,563	308 ms
8	AddShoppers	1,547	313 ms
9	ShareThis	104,092	315 ms
10	Twitter	286,904	343 ms
11	Kakao	28,534	396 ms
12	Instagram	6,010	828 ms
13	AddThis	119,408	974 ms
14	SocialShopWave	3,403	1451 ms
15	VK	40,210	1473 ms
16	PIXNET	15,332	2110 ms
17	Tumblr	14,801	2418 ms
18	LiveJournal	4,814	2939 ms

Video

These scripts enable video player and streaming functionality.

Rank	Name	Usage	Average Impact
1	Twitch	1,019	56 ms
2	Vimeo	55,804	356 ms
3	Brightcove	12,697	1261 ms
4	Wistia	15,065	2276 ms
5	YouTube	559,091	3195 ms

Developer Utilities

These scripts are developer utilities (API clients, site monitoring, fraud detection, etc).

Rank	Name	Usage	Average Impact
1	Accessibe	4,829	73 ms
2	Siteimprove	5,272	80 ms
3	Seznam	14,432	82 ms
4	iovation	1,869	100 ms
5	Cloudflare	78,437	107 ms
6	New Relic	97,453	114 ms
7	iubenda	34,029	120 ms
8	Key CDN	3,497	125 ms
9	Klevu Search	1,402	137 ms
10	Highcharts	1,716	159 ms
11	Foxentry	1,063	160 ms
12	TrustArc	3,845	175 ms
13	Hexton	22,100	181 ms
14	LightWidget	7,864	198 ms
15	OneSignal	62,786	225 ms
16	Riskified	1,092	236 ms
17	Cookiebot	55,639	240 ms
18	GitHub	3,439	241 ms
19	Bold Commerce	16,235	263 ms
20	Swiftype	1,166	264 ms
21	Cookie-Script.com	5,083	266 ms
22	Trusted Shops	13,944	274 ms
23	Other Google APIs/SDKs	1,297,162	285 ms
24	Affirm	4,681	293 ms
25	Google reCAPTCHA	8,854	329 ms
26	GetSiteControl	3,069	391 ms
27	WisePops	2,851	404 ms
28	Fastly	24,865	425 ms
29	Amazon Pay	3,928	426 ms
30	Forter	1,563	470 ms
31	AppDynamics	2,029	470 ms
32	PayPal	28,366	489 ms
33	Mapbox	9,079	510 ms
34	GoDaddy	22,215	568 ms
35	Google Maps	657,418	576 ms
36	Bugsnag	6,014	594 ms
37	Sentry	21,964	613 ms
38	Luigi’s Box	1,270	638 ms
39	Stripe	46,463	738 ms
40	MaxCDN Enterprise	7,027	980 ms
41	Vidyard	1,331	1204 ms
42	Secomapp	4,078	1415 ms
43	Yandex APIs	18,529	2056 ms
44	Freshchat	5,647	2340 ms
45	Rambler	11,257	3045 ms
46	Esri ArcGIS	1,848	3958 ms
47	POWr	23,595	4094 ms

Hosting Platforms

These scripts are from web hosting platforms (WordPress, Wix, Squarespace, etc). Note that in this category, this can sometimes be the entirety of script on the page, and so the "impact" rank might be misleading. In the case of WordPress, this just indicates the libraries hosted and served by WordPress not all sites using self-hosted WordPress.

Rank	Name	Usage	Average Impact
1	Blogger	88,978	177 ms
2	Civic	2,905	224 ms
3	WordPress	175,204	537 ms
4	Ecwid	3,126	888 ms
5	Dealer	1,449	1033 ms
6	Shopify	224,160	1831 ms
7	Tilda	22,245	2052 ms
8	Squarespace	69,369	2083 ms
9	Weebly	21,559	2214 ms
10	Salesforce Commerce Cloud	3,278	2441 ms
11	Hatena Blog	21,310	2805 ms
12	Wix	139,882	3086 ms
13	WebsiteBuilder.com	1,408	4106 ms

Marketing

These scripts are from marketing tools that add popups/newsletters/etc.

Rank	Name	Usage	Average Impact
1	Madison Logic	1,111	69 ms
2	DemandBase	1,849	89 ms
3	Beeketing	2,738	142 ms
4	Albacross	2,025	149 ms
5	iZooto	1,724	152 ms
6	Pardot	1,516	160 ms
7	Sojern	1,060	231 ms
8	Listrak	1,207	277 ms
9	Judge.me	21,552	323 ms
10	Mailchimp	34,723	324 ms
11	Hubspot	75,834	397 ms
12	RD Station	15,819	407 ms
13	Yotpo	18,100	501 ms
14	OptinMonster	4,681	525 ms
15	Wishpond Technologies	1,066	566 ms
16	PureCars	2,680	1052 ms
17	Sumo	14,134	1251 ms
18	Bigcommerce	12,867	1808 ms
19	Drift	6,275	3348 ms
20	Tray Commerce	7,409	8661 ms

Customer Success

These scripts are from customer support/marketing providers that offer chat and contact solutions. These scripts are generally heavier in weight.

Rank	Name	Usage	Average Impact
1	SnapEngage	1,313	69 ms
2	Foursixty	1,777	158 ms
3	BoldChat	1,544	165 ms
4	Tidio Live Chat	24,408	218 ms
5	Pure Chat	4,593	287 ms
6	LiveTex	1,748	329 ms
7	LivePerson	3,974	423 ms
8	Comm100	1,146	644 ms
9	Intercom	18,411	672 ms
10	Smartsupp	19,185	729 ms
11	iPerceptions	3,842	729 ms
12	LiveChat	22,979	786 ms
13	Help Scout	2,980	806 ms
14	Tawk.to	79,685	865 ms
15	Jivochat	57,192	986 ms
16	ContactAtOnce	1,454	1005 ms
17	Olark	6,986	1137 ms
18	ZenDesk	69,695	1166 ms
19	Dynamic Yield	1,420	2263 ms

Content & Publishing

These scripts are from content providers or publishing-specific affiliate tracking.

Rank	Name	Usage	Average Impact
1	Accuweather	1,067	127 ms
2	CPEx	1,271	154 ms
3	SnapWidget	9,852	223 ms
4	OpenTable	3,672	263 ms
5	Booking.com	2,002	267 ms
6	Covert Pics	2,063	326 ms
7	Tencent	5,409	331 ms
8	Revcontent	1,027	450 ms
9	AMP	72,557	861 ms
10	Embedly	3,969	1200 ms
11	Hotmart	1,355	1298 ms
12	Spotify	4,933	1606 ms
13	SoundCloud	4,288	1999 ms
14	issuu	2,112	2285 ms
15	Dailymotion	3,301	6711 ms
16	Medium	5,866	15098 ms

CDNs

These are a mixture of publicly hosted open source libraries (e.g. jQuery) served over different public CDNs and private CDN usage. This category is unique in that the origin may have no responsibility for the performance of what's being served. Note that rank here does not imply one CDN is better than the other. It simply indicates that the scripts being served from that origin are lighter/heavier than the ones served by another.

Rank	Name	Usage	Average Impact
1	Google Fonts	72,889	0 ms
2	Bootstrap CDN	18,998	29 ms
3	FontAwesome CDN	133,621	154 ms
4	Adobe TypeKit	27,304	162 ms
5	Monotype	4,851	194 ms
6	Microsoft Hosted Libs	16,866	199 ms
7	jQuery CDN	363,260	305 ms
8	Azure Web Services	27,929	354 ms
9	JSDelivr CDN	169,287	383 ms
10	Cloudflare CDN	277,777	430 ms
11	Bootstrap Chinese network	1,096	465 ms
12	Akamai	10,579	468 ms
13	Google CDN	1,808,969	570 ms
14	Fort Awesome	1,095	575 ms
15	Unpkg	39,513	657 ms
16	Yandex CDN	95,892	1022 ms
17	CreateJS CDN	3,667	4309 ms

Tag Management

These scripts tend to load lots of other scripts and initiate many tasks.

Rank	Name	Usage	Average Impact
1	BrightTag / Signal	3,551	157 ms
2	Yahoo! Tag Manager	10,408	158 ms
3	Google Tag Manager	3,227,721	198 ms
4	TagCommander	1,238	296 ms
5	Adobe Tag Manager	50,511	553 ms
6	Ensighten	3,738	561 ms
7	Tealium	17,723	636 ms

Consent Management Provider

IAB Consent Management Providers are the 'Cookie Consent' popups used by many publishers. They're invoked for every page and sit on the critical path between a page loading and adverts being displayed.

Rank	Name	Usage	Average Impact
1	Consent Manager CMP	3,984	260 ms
2	Optanon	55,110	301 ms
3	Quantcast Choice	26,290	434 ms

Mixed / Other

These are miscellaneous scripts delivered via a shared origin with no precise category or attribution. Help us out by identifying more origins!

Rank	Name	Usage	Average Impact
1	ResponsiveVoice	2,753	67 ms
2	ReadSpeaker	2,591	101 ms
3	Skype	1,105	213 ms
4	Browsealoud	1,449	263 ms
5	Amazon Web Services	67,304	268 ms
6	Parking Crew	2,761	444 ms
7	Calendly	2,707	711 ms
8	Polyfill service	2,106	920 ms
9	Heroku	10,912	2638 ms
10	uLogin	1,834	2704 ms

Third Parties by Total Impact

This section highlights the entities responsible for the most script execution across the web. This helps inform which improvements would have the largest total impact.

Name	Popularity	Total Impact	Average Impact
Google/Doubleclick Ads	972,081	1,971,164 s	2028 ms
YouTube	559,091	1,786,348 s	3195 ms
Google CDN	1,808,969	1,030,557 s	570 ms
Google Tag Manager	3,227,721	638,263 s	198 ms
Facebook	2,084,243	532,046 s	255 ms
Google Analytics	4,308,304	488,799 s	113 ms
Wix	139,882	431,735 s	3086 ms
Shopify	224,160	410,465 s	1831 ms
Google Maps	657,418	378,448 s	576 ms
Yandex Metrica	372,651	376,413 s	1010 ms
Other Google APIs/SDKs	1,297,162	369,594 s	285 ms
Squarespace	69,369	144,486 s	2083 ms
Cloudflare CDN	277,777	119,413 s	430 ms
AddThis	119,408	116,294 s	974 ms
Hotjar	259,015	113,322 s	438 ms
jQuery CDN	363,260	110,909 s	305 ms
Twitter	286,904	98,505 s	343 ms
Yandex CDN	95,892	98,036 s	1022 ms
POWr	23,595	96,590 s	4094 ms
WordPress	175,204	94,036 s	537 ms
Medium	5,866	88,568 s	15098 ms
ZenDesk	69,695	81,244 s	1166 ms
Pubmatic	139,231	74,342 s	534 ms
Tawk.to	79,685	68,918 s	865 ms
JSDelivr CDN	169,287	64,856 s	383 ms
Tray Commerce	7,409	64,170 s	8661 ms
AMP	72,557	62,500 s	861 ms
Hatena Blog	21,310	59,785 s	2805 ms
VK	40,210	59,232 s	1473 ms
Jivochat	57,192	56,393 s	986 ms
Weebly	21,559	47,738 s	2214 ms
Tilda	22,245	45,641 s	2052 ms
Klaviyo	67,488	39,609 s	587 ms
Bridgewell DSP	12,562	38,321 s	3051 ms
Yandex APIs	18,529	38,092 s	2056 ms
Tumblr	14,801	35,789 s	2418 ms
Histats	18,722	35,079 s	1874 ms
Stripe	46,463	34,299 s	738 ms
Wistia	15,065	34,290 s	2276 ms
Rambler	11,257	34,274 s	3045 ms
ShareThis	104,092	32,806 s	315 ms
PIXNET	15,332	32,344 s	2110 ms
Hubspot	75,834	30,119 s	397 ms
Heroku	10,912	28,789 s	2638 ms
Adobe Tag Manager	50,511	27,929 s	553 ms
Criteo	114,128	27,856 s	244 ms
Media.net	49,448	26,917 s	544 ms
Unpkg	39,513	25,964 s	657 ms
Bigcommerce	12,867	23,264 s	1808 ms
Dailymotion	3,301	22,152 s	6711 ms
Rubicon Project	131,432	21,883 s	166 ms
Drift	6,275	21,011 s	3348 ms
FontAwesome CDN	133,621	20,596 s	154 ms
TikTok	66,563	20,512 s	308 ms
Optimizely	27,437	20,462 s	746 ms
Vimeo	55,804	19,893 s	356 ms
LiveChat	22,979	18,069 s	786 ms
Amazon Web Services	67,304	18,016 s	268 ms
Sumo	14,134	17,688 s	1251 ms
MGID	12,030	17,221 s	1431 ms
Optanon	55,110	16,603 s	301 ms
Brightcove	12,697	16,010 s	1261 ms
Snapchat	28,791	15,938 s	554 ms
Taboola	32,046	15,883 s	496 ms
CreateJS CDN	3,667	15,800 s	4309 ms
Blogger	88,978	15,787 s	177 ms
WordAds	39,511	15,324 s	388 ms
LiveJournal	4,814	14,151 s	2939 ms
OneSignal	62,786	14,127 s	225 ms
Smartsupp	19,185	13,992 s	729 ms
PayPal	28,366	13,870 s	489 ms
Sentry	21,964	13,456 s	613 ms
Cookiebot	55,639	13,368 s	240 ms
Freshchat	5,647	13,212 s	2340 ms
Pinterest	124,652	12,872 s	103 ms
GoDaddy	22,215	12,612 s	568 ms
Intercom	18,411	12,373 s	672 ms
Lucky Orange	11,842	11,955 s	1010 ms
Crowd Control	44,477	11,556 s	260 ms
Quantcast Choice	26,290	11,405 s	434 ms
Kakao	28,534	11,286 s	396 ms
Tealium	17,723	11,268 s	636 ms
Mailchimp	34,723	11,260 s	324 ms
New Relic	97,453	11,134 s	114 ms
Fastly	24,865	10,573 s	425 ms
Skimbit	38,143	10,179 s	267 ms
Sizmek	5,005	10,075 s	2013 ms
BlueKai	84,454	9,985 s	118 ms
Azure Web Services	27,929	9,884 s	354 ms
Nielsen NetRatings SiteCensus	18,498	9,505 s	514 ms
Amazon Ads	67,934	9,434 s	139 ms
Yotpo	18,100	9,068 s	501 ms
VigLink	37,492	9,016 s	240 ms
SoundCloud	4,288	8,574 s	1999 ms
Moat	7,308	8,506 s	1164 ms
Cloudflare	78,437	8,380 s	107 ms
Tynt	83,849	8,307 s	99 ms
Integral Ad Science	4,567	8,208 s	1797 ms
Adroll	24,690	8,086 s	327 ms
Salesforce Commerce Cloud	3,278	8,002 s	2441 ms
Olark	6,986	7,946 s	1137 ms
Spotify	4,933	7,923 s	1606 ms
Esri ArcGIS	1,848	7,315 s	3958 ms
Privy	16,998	7,278 s	428 ms
Judge.me	21,552	6,965 s	323 ms
MaxCDN Enterprise	7,027	6,886 s	980 ms
mPulse	21,908	6,823 s	311 ms
Salesforce	7,204	6,819 s	947 ms
Yandex Ads	23,603	6,740 s	286 ms
Segment	15,140	6,445 s	426 ms
RD Station	15,819	6,444 s	407 ms
Quantcast	60,814	6,005 s	99 ms
Google Optimize	26,875	5,857 s	218 ms
WebsiteBuilder.com	1,408	5,782 s	4106 ms
Secomapp	4,078	5,769 s	1415 ms
Baidu Analytics	21,089	5,681 s	269 ms
Inspectlet	5,089	5,653 s	1111 ms
Trust Pilot	26,742	5,543 s	207 ms
Tidio Live Chat	24,408	5,327 s	218 ms
Yahoo! JAPAN Ads	13,494	5,116 s	379 ms
Infolinks	4,012	5,061 s	1261 ms
AB Tasty	3,772	5,055 s	1340 ms
Instagram	6,010	4,975 s	828 ms
uLogin	1,834	4,959 s	2704 ms
Akamai	10,579	4,950 s	468 ms
SocialShopWave	3,403	4,939 s	1451 ms
issuu	2,112	4,827 s	2285 ms
Bing Ads	32,273	4,774 s	148 ms
Embedly	3,969	4,764 s	1200 ms
Mapbox	9,079	4,628 s	510 ms
AudienceSearch	23,576	4,583 s	194 ms
Adobe TypeKit	27,304	4,412 s	162 ms
Ezoic	2,122	4,409 s	2078 ms
FullStory	8,318	4,377 s	526 ms
Attentive	6,245	4,307 s	690 ms
Bold Commerce	16,235	4,266 s	263 ms
Index Exchange	38,860	4,253 s	109 ms
iubenda	34,029	4,077 s	120 ms
Hexton	22,100	3,997 s	181 ms
Trusted Shops	13,944	3,827 s	274 ms
LongTail Ad Solutions	5,040	3,782 s	750 ms
Bugsnag	6,014	3,572 s	594 ms
fam	967	3,429 s	3546 ms
AddToAny	42,529	3,392 s	80 ms
Mediavine	8,321	3,357 s	403 ms
Microsoft Hosted Libs	16,866	3,349 s	199 ms
LinkedIn	14,592	3,231 s	221 ms
Dynamic Yield	1,420	3,213 s	2263 ms
Google reCAPTCHA	8,854	2,912 s	329 ms
PureCars	2,680	2,820 s	1052 ms
iPerceptions	3,842	2,802 s	729 ms
Ecwid	3,126	2,776 s	888 ms
StatCounter	36,804	2,698 s	73 ms
Wicked Reports	747	2,657 s	3557 ms
LoopMe	483	2,629 s	5442 ms
Cxense	5,082	2,512 s	494 ms
OptinMonster	4,681	2,460 s	525 ms
Admixer for Publishers	1,204	2,422 s	2011 ms
Help Scout	2,980	2,401 s	806 ms
Geniee	7,516	2,353 s	313 ms
Supership	9,293	2,336 s	251 ms
LoyaltyLion	3,441	2,332 s	678 ms
VWO	6,718	2,288 s	341 ms
AppNexus	57,074	2,276 s	40 ms
SnapWidget	9,852	2,196 s	223 ms
Disqus	981	2,155 s	2197 ms
Gigya	2,303	2,139 s	929 ms
Ensighten	3,738	2,097 s	561 ms
DTSCOUT	20,795	2,090 s	100 ms
CallRail	12,654	2,076 s	164 ms
piano	1,375	2,013 s	1464 ms
LiveRamp IdentityLink	20,910	1,951 s	93 ms
Polyfill service	2,106	1,938 s	920 ms
Calendly	2,707	1,925 s	711 ms
Yieldify	444	1,892 s	4262 ms
DoubleVerify	1,411	1,885 s	1336 ms
LINE Corporation	13,207	1,853 s	140 ms
Refersion	3,004	1,828 s	608 ms
Sortable	1,911	1,805 s	944 ms
SearchSpring	608	1,795 s	2953 ms
Tencent	5,409	1,789 s	331 ms
Crazy Egg	19,934	1,782 s	89 ms
Gemius	19,944	1,781 s	89 ms
Snowplow	14,783	1,768 s	120 ms
Hotmart	1,355	1,758 s	1298 ms
KARTE	1,359	1,699 s	1250 ms
LivePerson	3,974	1,679 s	423 ms
Revolver Maps	1,681	1,679 s	999 ms
Amazon Pay	3,928	1,672 s	426 ms
Adform	14,807	1,660 s	112 ms
Yahoo! Tag Manager	10,408	1,645 s	158 ms
Vidyard	1,331	1,602 s	1204 ms
LightWidget	7,864	1,559 s	198 ms
Adyen	965	1,548 s	1604 ms
WordPress Site Stats	18,696	1,537 s	82 ms
Dealer	1,449	1,497 s	1033 ms
Okas Concepts	639	1,495 s	2339 ms
BounceX	1,646	1,490 s	905 ms
ContactAtOnce	1,454	1,462 s	1005 ms
Feefo.com	1,929	1,458 s	756 ms

Future Work

1. Introduce URL-level data for more fine-grained analysis, i.e. which libraries from Cloudflare/Google CDNs are most expensive.
2. Expand the scope, i.e. include more third parties and have greater entity/category coverage.

FAQs

I don't see entity X in the list. What's up with that?

This can be for one of several reasons:

1. The entity does not have references to their origin on at least 50 pages in the dataset.
2. The entity's origins have not yet been identified. See How can I contribute?

What is "Total Occurences"?

Total Occurrences is the number of pages on which the entity is included.

How is the "Average Impact" determined?

The HTTP Archive dataset includes Lighthouse reports for each URL on mobile. Lighthouse has an audit called "bootup-time" that summarizes the amount of time that each script spent on the main thread. The "Average Impact" for an entity is the total execution time of scripts whose domain matches one of the entity's domains divided by the total number of pages that included the entity.

Average Impact = Total Execution Time / Total Occurrences

How does Lighthouse determine the execution time of each script?

Lighthouse's bootup time audit attempts to attribute all toplevel main-thread tasks to a URL. A main thread task is attributed to the first script URL found in the stack. If you're interested in helping us improve this logic, see Contributing for details.

The data for entity X seems wrong. How can it be corrected?

Verify that the origins in data/entities.js are correct. Most issues will simply be the result of mislabelling of shared origins. If everything checks out, there is likely no further action and the data is valid. If you still believe there's errors, file an issue to discuss futher.

How can I contribute?

Only about 90% of the third party script execution has been assigned to an entity. We could use your help identifying the rest! See Contributing for details.

Contributing

Thanks

A huge thanks to @simonhearne and @soulgalore for their assistance in classifying additional domains!

Updating the Entities

The domain->entity mapping can be found in data/entities.js. Adding a new entity is as simple as adding a new array item with the following form.

{
    "name": "Facebook",
    "homepage": "https://www.facebook.com",
    "categories": ["social"],
    "domains": [
        "*.facebook.com",
        "*.fbcdn.net"
    ],
    "examples": [
        "www.facebook.com",
        "connect.facebook.net",
        "staticxx.facebook.com",
        "static.xx.fbcdn.net",
        "m.facebook.com"
    ]
}

Updating Attribution Logic

The logic for attribution to individual script URLs can be found in the Lighthouse repo. File an issue over there to discuss further.

Updating the Data

This is now automated! Run yarn start:update-ha-data with a gcp-credentials.json file in the root directory of this project (look at bin/automated-update.js for the steps involved).

Updating this README

This README is auto-generated from the templates lib/ and the computed data. In order to update the charts, you'll need to make sure you have cairo installed locally in addition to yarn install.

# Install `cairo` and dependencies for node-canvas
brew install pkg-config cairo pango libpng jpeg giflib
# Build the requirements in this repo
yarn build
# Regenerate the README
yarn start

Updating the website

The web code is located in www/ directory of this repository. Open a PR to make changes.