# Web technology adoption and company tech stacks since 2016

**See which web technologies are gaining or losing websites each month, and which ones large US listed companies put on their home pages.** Monthly counts for 3,565 technologies from the HTTP Archive crawl sit beside a yearly record of scripts found on the archived home pages of 228 US listed companies. Compare vendors inside a category, follow a product's share over time, or check when a company…

Web technology adoption and company tech stacks since 2016 is an open, machine-readable dataset published on Mostly Right as immutable Parquet versions, with a documented column schema, a JSON query API and a direct download. Its first rows are free to read and it is open to AI agents.

## Facts

- Slug: `web-technology-adoption-and-company-tech-stacks-since-2016`
- Canonical page: https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016
- Publisher: mostlyrightmd (https://mostlyright.md/publishers/mostlyrightmd)
- Published: 2026-11-13T14:15:06.696Z
- Tables: 5
- Formats: Apache Parquet (download), JSON (query and sample)
- Cost: the first 500 rows of each table are free to everyone; querying and downloading need a free account and count against a monthly free allowance unless the workspace is subscribed
- Metadata API: `GET https://mostlyright.md/api/v2/public/datasets/web-technology-adoption-and-company-tech-stacks-since-2016`
- Topics: web technologies, tech stack, http archive, analytics, cms, cdn, wayback machine, us stocks

## Table directory

Tables follow the publisher's curated order. Display labels do not change table identifiers.

Start here: category_market_share_monthly — table id: 96811e68-28e6-41a5-bc36-4566ed9f8169

- company_technology_timeline — table id: c5504122-70d7-4658-9d64-e811e1539890; published name: company_technology_timeline; https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016/tables?table=company-technology-timeline
- category_market_share_monthly — table id: 96811e68-28e6-41a5-bc36-4566ed9f8169; published name: category_market_share_monthly; https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016/tables?table=category-market-share-monthly
- company_website_detections — table id: 492c72a9-a73f-47ee-a473-d5e82694adb3; published name: company_website_detections; https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016/tables?table=company-website-detections
- technologies — table id: 80e027c9-62d8-4200-9d7e-82c409c6670a; published name: technologies; https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016/tables?table=technologies
- technology_adoption_monthly — table id: 67537d03-3588-45c2-90c1-1a33324590a8; published name: technology_adoption_monthly; https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016/tables?table=technology-adoption-monthly

## How to use it

1. Read a table's schema — no account needed.
2. Fetch its published sample rows — no account needed.
   The first 500 rows of every table, in stored order, are free to everyone, with or without an account. Without an account you get that sample and ranked row search on public tables (search_table). An empty search query pages through a table in stored order. There is no filter, sort or download without an account.
3. Log in at https://mostlyright.md/login, connect this dataset to a workspace on its page, and create an `mr_use_` key.
4. Query bounded JSON, or download the complete Parquet snapshot and read it locally.
   A free workspace may read 100,000 rows and run 1,000 queries a UTC month past the sample. The allowance is shared by everyone in the workspace, and a free workspace may have any number of members. Reads count against the workspace whose data or key they use. A subscribed workspace is never counted, for anyone working in it.

Agents can do all of this over MCP at `https://mostlyright.md/api/mcp` — searching, reading schemas and sampling rows work with no credential at all.

## Table: company_technology_timeline

- Table id: `c5504122-70d7-4658-9d64-e811e1539890`
- Slug: `company-technology-timeline`
- Immutable version: `ce56ed5c-0ef7-5c14-9332-14e40759c4d9`
- Schema: `GET https://mostlyright.md/api/v2/public/tables/c5504122-70d7-4658-9d64-e811e1539890/schema`
- Sample rows, no key: `GET https://mostlyright.md/api/v2/public/tables/c5504122-70d7-4658-9d64-e811e1539890/preview`
- Bounded JSON query: `POST https://mostlyright.md/api/v2/public/tables/c5504122-70d7-4658-9d64-e811e1539890/query` with `x-api-key: mr_use_…`
- Full Parquet snapshot: `GET https://mostlyright.md/api/v2/public/tables/c5504122-70d7-4658-9d64-e811e1539890/current` with `x-api-key: mr_use_…` (application/vnd.apache.parquet)

### Columns (23)

| Column | Type | Description |
| --- | --- | --- |
| `symbol` | string | Ticker in the US stocks dataset. |
| `company_name` | string | Company name. |
| `sector` | string | Sector. |
| `market_cap_usd` | integer | Market capitalisation in US dollars at build time. |
| `domain` | string | Company website domain. |
| `technology` | string | Detected technology. |
| `primary_category` | string | Category from the technologies table. Empty where the HTTP Archive does not track the technology. |
| `business_group` | string | Business group from the technologies table. |
| `is_ai_product` | boolean | The model's AI product label from the technologies table. |
| `vendor` | string | Vendor from the technologies table. |
| `vendor_ticker` | string | Vendor's US ticker from the technologies table. |
| `first_seen_date` | date | Date of the first yearly capture where the technology was detected. |
| `last_seen_date` | date | Date of the last yearly capture where it was detected. |
| `captures_with_technology` | integer | Captures where it was detected. |
| `captures_between_first_and_last` | integer | Captures of the domain from first_seen_date to last_seen_date. Above captures_with_technology means it went missing in between. |
| `domain_first_capture` | date | First capture of the domain with any detection. |
| `domain_last_capture` | date | Latest capture of the domain with any detection. |
| `domain_captures` | integer | Captures of the domain with any detection. |
| `status` | string | in use when detected in the domain's latest capture, else dropped. |
| `present_at_first_capture` | boolean | True when the technology was already there in the domain's first capture, so its adoption date is unknown. |
| `adopted_after` | date | The capture before first_seen_date. The technology was adopted between this date and first_seen_date. Empty when present at first capture. |
| `dropped_before` | date | The capture after last_seen_date. The technology was dropped between last_seen_date and this date. Empty while in use. |
| `latest_example_script` | string | A matching script address from the last capture where it was detected. |

## Table: category_market_share_monthly

- Table id: `96811e68-28e6-41a5-bc36-4566ed9f8169`
- Slug: `category-market-share-monthly`
- Immutable version: `95a942e8-d196-5d71-a177-3c8587fb12ff`
- Schema: `GET https://mostlyright.md/api/v2/public/tables/96811e68-28e6-41a5-bc36-4566ed9f8169/schema`
- Sample rows, no key: `GET https://mostlyright.md/api/v2/public/tables/96811e68-28e6-41a5-bc36-4566ed9f8169/preview`
- Bounded JSON query: `POST https://mostlyright.md/api/v2/public/tables/96811e68-28e6-41a5-bc36-4566ed9f8169/query` with `x-api-key: mr_use_…`
- Full Parquet snapshot: `GET https://mostlyright.md/api/v2/public/tables/96811e68-28e6-41a5-bc36-4566ed9f8169/current` with `x-api-key: mr_use_…` (application/vnd.apache.parquet)

### Columns (16)

| Column | Type | Description |
| --- | --- | --- |
| `category` | string | Source category. A technology listed under several categories has one row in each. |
| `technology` | string | Technology name. |
| `month` | date | First day of the crawl month. |
| `business_group` | string | Business group from the technologies table. |
| `vendor` | string | Vendor from the technologies table. |
| `vendor_ticker` | string | Vendor's US ticker from the technologies table. |
| `origins_mobile` | integer | Website origins with the technology in the mobile crawl, all ranks and geographies. |
| `origins_desktop` | integer | The same for the desktop crawl. |
| `category_detections_mobile` | integer | Sum of origins_mobile over every technology in the category that month. A site using two technologies of one category counts twice. |
| `category_detections_desktop` | integer | The same for the desktop crawl. |
| `share_of_category_mobile_pct` | decimal | origins_mobile as a percent of category_detections_mobile. |
| `share_of_category_desktop_pct` | decimal | The same for the desktop crawl. |
| `rank_in_category` | integer | Rank by origins_mobile within the category and month, 1 is largest. |
| `technologies_in_category` | integer | Technologies observed in the category that month. |
| `share_change_vs_previous_points` | decimal | Change of share_of_category_mobile_pct against the previous observed month, in percentage points. |
| `previous_month` | date | The previous month this technology was observed. |

## Table: company_website_detections

- Table id: `492c72a9-a73f-47ee-a473-d5e82694adb3`
- Slug: `company-website-detections`
- Immutable version: `fc59e887-6155-5fe5-a8b7-61f757f4fa64`
- Schema: `GET https://mostlyright.md/api/v2/public/tables/492c72a9-a73f-47ee-a473-d5e82694adb3/schema`
- Sample rows, no key: `GET https://mostlyright.md/api/v2/public/tables/492c72a9-a73f-47ee-a473-d5e82694adb3/preview`
- Bounded JSON query: `POST https://mostlyright.md/api/v2/public/tables/492c72a9-a73f-47ee-a473-d5e82694adb3/query` with `x-api-key: mr_use_…`
- Full Parquet snapshot: `GET https://mostlyright.md/api/v2/public/tables/492c72a9-a73f-47ee-a473-d5e82694adb3/current` with `x-api-key: mr_use_…` (application/vnd.apache.parquet)

### Columns (14)

| Column | Type | Description |
| --- | --- | --- |
| `symbol` | string | Ticker of the company in the US stocks dataset. Where several tickers share a website the largest by market capitalisation is kept. |
| `company_name` | string | Company name from the US stocks dataset. |
| `sector` | string | Sector from the US stocks dataset. |
| `market_cap_usd` | integer | Market capitalisation in US dollars at build time, from the US stocks dataset. |
| `domain` | string | The company's website domain. |
| `capture_date` | date | Date the Wayback Machine captured the home page. The first successful capture of the year, for even years 2016 to 2026. |
| `capture_year` | integer | Year of the capture. |
| `capture_timestamp` | string | Wayback Machine capture timestamp, YYYYMMDDhhmmss in UTC. |
| `archive_url` | string | Address of the archived page. |
| `technology` | string | Detected technology. Spelled as the HTTP Archive spells it where it tracks the technology, so it joins to technologies. |
| `matching_scripts` | integer | Distinct script addresses on the page that matched the rule. |
| `example_script` | string | One matching script address, lowercased, first 300 characters. |
| `script_tags` | integer | Script tags on the captured page. |
| `script_tags_with_source` | integer | Script tags that load an external file. |

## Table: technologies

- Table id: `80e027c9-62d8-4200-9d7e-82c409c6670a`
- Slug: `technologies`
- Immutable version: `6998dc81-2e35-5617-9352-426576d87780`
- Schema: `GET https://mostlyright.md/api/v2/public/tables/80e027c9-62d8-4200-9d7e-82c409c6670a/schema`
- Sample rows, no key: `GET https://mostlyright.md/api/v2/public/tables/80e027c9-62d8-4200-9d7e-82c409c6670a/preview`
- Bounded JSON query: `POST https://mostlyright.md/api/v2/public/tables/80e027c9-62d8-4200-9d7e-82c409c6670a/query` with `x-api-key: mr_use_…`
- Full Parquet snapshot: `GET https://mostlyright.md/api/v2/public/tables/80e027c9-62d8-4200-9d7e-82c409c6670a/current` with `x-api-key: mr_use_…` (application/vnd.apache.parquet)

### Columns (19)

| Column | Type | Description |
| --- | --- | --- |
| `technology` | string | Technology name as HTTP Archive (Wappalyzer detection) names it. Joins to technology_adoption_monthly and the company tables. |
| `categories` | string | The source's categories, comma separated. |
| `primary_category` | string | The first listed category. |
| `primary_category_description` | string | The source's description of the primary category. |
| `business_group` | string | One of twelve business groups. Set by a rule from primary_category where the rule maps it, else the model's label when its probability is at least 0.5, else Ot… |
| `business_group_source` | string | category_rule, model or unsettled. |
| `model_business_group` | string | The business group the classification model gemini-decision-1 picked from the description. A label with a probability, not a fact. |
| `model_business_group_probability` | decimal | Probability of model_business_group, 0 to 1. |
| `is_ai_product` | boolean | True when gemini-decision-1 gave at least 0.5 probability that the technology is itself an AI product. Empty where the technology has no description. |
| `ai_product_probability` | decimal | The model's probability that the technology is an AI product, 0 to 1. |
| `ai_keyword_match` | boolean | Rule: the name or description mentions AI, LLM, GPT, machine learning, chatbot or generative. |
| `description` | string | The source's description of the technology. |
| `icon_file` | string | Icon file name in the source. |
| `origins_mobile` | integer | Website origins with the technology in the latest mobile crawl, all ranks and geographies. |
| `origins_desktop` | integer | Website origins with the technology in the latest desktop crawl. |
| `vendor` | string | The company that sells or maintains the technology, from a hand-written list of product name prefixes. Empty where the list has no entry. |
| `vendor_ticker` | string | The vendor's US ticker, confirmed against the US stocks dataset. |
| `vendor_company_name` | string | The vendor's name in the US stocks dataset. |
| `vendor_market_cap_usd` | integer | The vendor's market capitalisation in US dollars from the US stocks dataset. |

## Table: technology_adoption_monthly

- Table id: `67537d03-3588-45c2-90c1-1a33324590a8`
- Slug: `technology-adoption-monthly`
- Immutable version: `1d1665b2-3472-50a1-b087-fa56ac0e8d3e`
- Schema: `GET https://mostlyright.md/api/v2/public/tables/67537d03-3588-45c2-90c1-1a33324590a8/schema`
- Sample rows, no key: `GET https://mostlyright.md/api/v2/public/tables/67537d03-3588-45c2-90c1-1a33324590a8/preview`
- Bounded JSON query: `POST https://mostlyright.md/api/v2/public/tables/67537d03-3588-45c2-90c1-1a33324590a8/query` with `x-api-key: mr_use_…`
- Full Parquet snapshot: `GET https://mostlyright.md/api/v2/public/tables/67537d03-3588-45c2-90c1-1a33324590a8/current` with `x-api-key: mr_use_…` (application/vnd.apache.parquet)

### Columns (19)

| Column | Type | Description |
| --- | --- | --- |
| `technology` | string | Technology name as HTTP Archive (Wappalyzer detection) names it. |
| `month` | date | First day of the crawl month. |
| `rank` | string | Popularity bucket of the sites counted, from the Chrome UX Report: ALL, Top 1k, Top 10k, Top 100k, Top 1M or Top 10M. |
| `geo` | string | Geography of the sites counted: ALL or United States of America. |
| `categories` | string | The technology's categories as the source lists them, comma separated. |
| `primary_category` | string | The first listed category. |
| `origins_mobile` | integer | Website origins with the technology in the mobile crawl. |
| `origins_desktop` | integer | Website origins with the technology in the desktop crawl. |
| `all_origins_mobile` | integer | All origins crawled on mobile in the same month, rank and geography. |
| `all_origins_desktop` | integer | All origins crawled on desktop in the same month, rank and geography. |
| `share_mobile_pct` | decimal | origins_mobile as a percent of all_origins_mobile. |
| `share_desktop_pct` | decimal | origins_desktop as a percent of all_origins_desktop. |
| `previous_month` | date | The previous month this technology was observed in the same rank and geography. |
| `mobile_change_vs_previous_pct` | decimal | Percent change of origins_mobile against previous_month. |
| `first_seen_month` | date | First month the technology appears in this rank and geography. |
| `last_seen_month` | date | Last month the technology appears in this rank and geography. |
| `months_observed` | integer | Months with a count in this rank and geography. |
| `lifecycle_event` | string | first_detected on the first month when that is after the series start, last_detected on the last month when that is before the latest crawl, else empty. |
| `is_latest_month` | boolean | True on rows of the latest crawl month. |

## Citing this dataset

Cite the dataset by name and canonical URL (https://mostlyright.md/datasets/web-technology-adoption-and-company-tech-stacks-since-2016), the table, and the immutable `version_id` the rows came from. A query response carries `table.version_id` and `table.content_digest`; a download carries a strong ETag and a `Content-Digest` header.
