Historical Web Data

More than 10 years of historical data, including 80TB+ of news, blogs, forums,
and reviews, structured to analyze trends, enrich Al models, and power research.

Access Archived Web Data For

Big Data Analytics

Advanced Filters

Easily sort historical data by topics, organizations, time frames, and more

Easy Integration

Instantly access the biggest repository of historical data feeds via API or by running a query yourself

Pay Per Use

Only pay for the posts you get

Unlock Big Web Data with Historical Data

9 M

Posts Indexed Daily

1 M

Websites

160

Languages

120

Countries

10 +

Years' Historical Data

Historical web intelligence

Turn Historical
Data into Insights

icon1-2

Access big historical data from news, blogs, discussions and review sites, dating back to 2008

icon2-2

Tap into archived web data from around the world, in multiple languages

Icon-6

Generate bigger insights with rich historical data, instantly accessible through our robust API

Scale Your Data Analytics with

Archived Web Data

LLM training & Machine Learning

LLM training & Machine Learning

Leverage Webz.io’s structured historical datasets to create smarter and powerful automated models

Media Monitoring

Media Monitoring

Get the fuller picture of a brand with big historical data repositories with data from across any region, in multiple languages

learn more Media Monitoring
Financial Analysis

Financial Analysis

Create advanced predictive analytics based on business trends and performance over time with our deep historical data

learn more Financial Analysis
Risk Intelligence

Risk Intelligence

Monitor critical risk signals from around the world related to supply chain risks, third-party risks, Know Your Customer (KYC) and corporate and travel security

learn more Risk Intelligence

LLM training & Machine Learning

LLM training & Machine Learning

LLM training & Machine Learning

Leverage Webz.io’s structured historical datasets to create smarter and powerful automated models

Media Monitoring

Media Monitoring

Media Monitoring

Get the fuller picture of a brand with big historical data repositories with data from across any region, in multiple languages

learn more Media Monitoring

Financial Analysis

Financial Analysis

Financial Analysis

Create advanced predictive analytics based on business trends and performance over time with our deep historical data

learn more Financial Analysis

Risk Intelligence

Risk Intelligence

Risk Intelligence

Monitor critical risk signals from around the world related to supply chain risks, third-party risks, Know Your Customer (KYC) and corporate and travel security

learn more Risk Intelligence

Better Analytics

With Big Historical Web Data

ENTITIES icon

Run queries based on people, locations, organizations and topics.

SENTIMENT icon

Understand the sentiment of an article with machine learning.

SOCIAL SIGNALS icon

Rank query results by social reach, broken down by engagement and platform.

CATEGORIES icon

Group similar articles easily, with auto-generated categories.

FULL TEXT icon

Get the whole text of every article, post, thread or review included in your results.

entities: {
  persons: [
    {
      name: "squid",
      sentiment: "positive"
    },
    {
      name: "kevin smith",
      sentiment: "none"
    }
  ],

  locations: [ ],

  organizations: [
    {
      name: "netflix",
      sentiment: "positive"
    }
  ]
}
name: "Android",
polarity: "strong positive",
polarities: {
  negative: [ ],
  strong_negative: [ ],
  positive: [
    2845
  ],
  strong_positive: [
    844
  ],
  neutral: [ ],
  no_sentiment: [
    1620,
    4686
  ]
},
frequency: 4,
relevance: 50
thread: {
  social: {
    gplus: {
      shares: 12
    },

    pinterest: {
      shares: 3
    },

    vk: {
      shares: 25
    },

    linkedin: {
      shares: 9
    },

    facebook: {
      likes: 611,
      comments: 101,
      shares: 26
    }
  }
}
categories: [
  {
    level: 3,
    name: "arts, culture and entertainment – television – soap opera",
    taxonomy: "IPTC",
    relative_relevance: 100,
    absolute_relevance: 0.72848845
  },

  {
    level: 1,
    name: "Home and Garden",
    taxonomy: "IAB",
    relative_relevance: 100,
    absolute_relevance: 1
  }
]
language: "english",
text: "Netflix loves to call their latest, buzziest show their most successful show of all time.
And Squid Game is no different. Earlier today, the company tweeted that 111 million people
watched the first season of the hit Korean thriller in its first 28 days of release, crushing
the company’s previous record-holder Bridgerton, which pulled in a paltry 82 million viewers.
To thank fans, that big, creepy doll from Squid Game announced in a video that all 111 million
VIPs made the show number one around the world. And according to Netflix, that’s what happened.
By their metrics, Squid Game reached the top of their charts in 90 countries since debuting in
September. Of course, it’s worth noting that what Netflix counts as a view is a little askew—
to steal a phrase from Kevin Smith. The company’s official “view” means a user watched at least
two minutes of any episode. This means that if someone sat around long enough for a video to
auto-play on the platform and then let it roll until it reached “Netflix presents,” they more
or less counted in the company’s 111 million. It’s also, you know, sketchy to just accept the
view counts from Netflix about Netflix without corroboration. So please, take these numbers
with a grain of salt."

ENTITIES icon

Run queries based on people, locations, organizations and topics.

entities: {
  persons: [
    {
      name: "squid",
      sentiment: "positive"
    },
    {
      name: "kevin smith",
      sentiment: "none"
    }
  ],

  locations: [ ],

  organizations: [
    {
      name: "netflix",
      sentiment: "positive"
    }
  ]
}

SENTIMENT icon

Understand the sentiment of an article with machine learning.

name: "Android",
polarity: "strong positive",
polarities: {
  negative: [ ],
  strong_negative: [ ],
  positive: [
    2845
  ],
  strong_positive: [
    844
  ],
  neutral: [ ],
  no_sentiment: [
    1620,
    4686
  ]
},
frequency: 4,
relevance: 50

SOCIAL SIGNALS icon

Rank query results by social reach, broken down by engagement and platform.

thread: {
  social: {
    gplus: {
      shares: 12
    },

    pinterest: {
      shares: 3
    },

    vk: {
      shares: 25
    },

    linkedin: {
      shares: 9
    },

    facebook: {
      likes: 611,
      comments: 101,
      shares: 26
    }
  }
}

CATEGORIES icon

Group similar articles easily, with auto-generated categories.

categories: [
  {
    level: 3,
    name: "arts, culture and entertainment – television – soap opera",
    taxonomy: "IPTC",
    relative_relevance: 100,
    absolute_relevance: 0.72848845
  },

  {
    level: 1,
    name: "Home and Garden",
    taxonomy: "IAB",
    relative_relevance: 100,
    absolute_relevance: 1
  }
]

FULL TEXT icon

Get the whole text of every article, post, thread or review included in your results.

language: "english",
text: "Netflix loves to call their latest, buzziest show their most successful show of all time.
And Squid Game is no different. Earlier today, the company tweeted that 111 million people
watched the first season of the hit Korean thriller in its first 28 days of release, crushing
the company’s previous record-holder Bridgerton, which pulled in a paltry 82 million viewers.
To thank fans, that big, creepy doll from Squid Game announced in a video that all 111 million
VIPs made the show number one around the world. And according to Netflix, that’s what happened.
By their metrics, Squid Game reached the top of their charts in 90 countries since debuting in
September. Of course, it’s worth noting that what Netflix counts as a view is a little askew—
to steal a phrase from Kevin Smith. The company’s official “view” means a user watched at least
two minutes of any episode. This means that if someone sat around long enough for a video to
auto-play on the platform and then let it roll until it reached “Netflix presents,” they more
or less counted in the company’s 111 million. It’s also, you know, sketchy to just accept the
view counts from Netflix about Netflix without corroboration. So please, take these numbers
with a grain of salt."

OUR CUSTOMERS SAY IT BEST

Trusted Data. Proven Impact.

Have a

Question?

How far back does your historical data go? arrow icon

Our historical data includes everything older than 30 days from News, Blogs, Forums and Reviews, going back to January 2008. The data is crawled from a range of different sources, languages and categories; ready-made for predictive analysis, risk modeling, NLP, machine learning and deep sentiment analysis.

How can I search historical data on Webz.io? arrow icon

It’s simple. First you put in your query, you can also use an old query you ran before. Then you select the time frame and then you let it run. Next, you can get the entire dataset for the time frame you selected.

Does Webz.io provide the full text from the pages you crawl? arrow icon

Yes, you can get the full text of every page going back to 2008.

How much does your service cost? arrow icon

Webz.io offers flexible pricing based on usage. Every account receives $5 in free API credit every month, with no credit card required.
After that, you can continue with a simple pay-as-you-go model or choose a subscription package for higher-volume usage. Pricing varies by API and usage level.

Can I request coverage for specific sites? arrow icon

Yes. Webz.io customers on eligible subscription plans can request coverage for specific websites directly through a simple UI or API.
The process is automated: submit the site, and Webz.io analyzes it and provides a report on its availability and coverage status.

Sample JSON Result from Archived COVID-19 Data Since 2021

{
  "organizations": [],
  "uuid": "4a89bee08f3f20164522f1325a6cab7645008154",
  "thread": {
    "social": {
      "gplus": {
        "shares": 0
      },
      "pinterest": {
        "shares": 0
      },
      "vk": {
        "shares": 0
      },
      "linkedin": {
        "shares": 0
      },
      "facebook": {
        "likes": 0,
        "shares": 10,
        "comments": 0
      },
      "stumbledupon": {
        "shares": 0
      }
    },
    "site_full": "edition.cnn.com",
    "main_image": "https://cdn.cnn.com/cnnnext/dam/assets/201111144544-north-dakota-coronavirus-super-tease.jpg",
    "site_section": "http://rss.cnn.com/rss/cnn_latest",
    "section_title": "CNN.com - RSS Channel",
    "url": "https://edition.cnn.com/2021/09/01/politics/north-dakota-covid-deaths/index.html",
    "country": "US",
    "domain_rank": 76,
    "title": "Another tragic statistic to come out of the pandemic",
    "performance_score": 0,
    "site": "cnn.com",
    "site_categories": [
      "media"
    ],
    "participants_count": 1,
    "title_full": "",
    "site_type": "news",
    "published": "2021-09-02T01:33:00.000+03:00",
    "replies_count": 0,
    "uuid": "4a89bee08f3f20164522f1325a6cab7645008154"
  },
  "author": "Analysis by Chris Cillizza",
  "url": "https://edition.cnn.com/2021/09/01/politics/north-dakota-covid-deaths/index.html",
  "ord_in_thread": 0,
  "title": "Another tragic statistic to come out of the pandemic",
  "locations": [],
  "entities": {
    "persons": [
      {
        "name": "Chris Cillizza",
        "sentiment": "none"
      },
      {
        "name": "Michig",
        "sentiment": "none"
      }
    ],
    "locations": [
      {
        "name": "America",
        "sentiment": "none"
      },
      {
        "name": "North Dakotans",
        "sentiment": "none"
      },
      {
        "name": "Florida",
        "sentiment": "none"
      },
      {
        "name": "North Dakota",
        "sentiment": "none"
      }
    ],
    "organizations": []
  },
  "num_chars": 1817,
  "highlightText": "",
  "language": "english",
  "persons": [],
  "text": "(CNN) The numbers are daunting.\nThere have been more than 39 million cases of Covid-19 in America since the start of the pandemic. The virus has killed more than 640,000 of our fellow citizens. The sheer magnitude of those numbers makes them hard for us to properly contextualize. The enormity of what we've lost is challenging to get our arms around. Which is why this headline stopped me in my tracks when I came across it today in the Fargo Forum: \" 1 in 500 North Dakotans has died of COVID-19 \" Read More Yes, you read that right. One in every 500 residents of North Dakota have died of Covid-19. Not been infected. Died. Here's the math: North Dakota has had 1,560-plus people die from Covid-19. And according to the 2020 census, its population is 779,094. So divide 779,094 by 1,560 and you get roughly 500. THE POINT -- NOW ON YOUTUBE!\nIn each episode of his weekly YouTube show, Chris Cillizza will delve a little deeper into the surreal world of politics. Click to subscribe!\nWhat's even more remarkable? North Dakota isn't the only state where that 1 in 500 figure is true. Florida, Michigan, Ohio and South Dakota have also lost roughly 1 in 500 of their residents to the coronavirus. New Jersey has lost 1 in every 346 residents to Covid-19 . Four of those six states -- all except Michigan and New Jersey -- are run by Republican governors. And in South Dakota and Florida, in particular, their governors have an eye on national office in 2024 and used their laissez-faire approach to Covid-19 as a resume booster. The Point : Take a minute today to consider what it means to lose 1 of every 500 people (or 1 of every 346) in your state to this awful disease. And to hope that terrifying numbers like these convince more people to get vaccinated. It's our only hope of avoiding even more death and loss. ",
  "external_links": [
    "https://www.inforum.com/newsmd/coronavirus/7173040-1-in-500-North-Dakotans-has-died-of-COVID-19",
    "https://www.youtube.com/user/CNN?sub_confirmation=1",
    "https://www.youtube.com/user/CNN",
    "https://inforum.com/newsmd/coronavirus/7173040-1-in-500-North-Dakotans-has-died-of-COVID-19",
    "https://youtube.com/user/CNN?sub_confirmation=1"
  ],
  "published": "2021-09-02T01:33:00.000+03:00",
  "crawled": "2021-09-02T01:39:57.008+03:00",
  "highlightTitle": ""
}
Footer Background Large
Footer Background Small

Turn History into Insight

More than 10 years of news, blogs, forums, and reviews
to power AI, research, and analytics.

icon

Ready to Explore Web Data at Scale?

Speak with a data expert to learn more about Webz.io’s solutions
Speak with a data expert to learn more about Webz.io’s solutions
Create your API account and get instant access to millions of web sources
Create your API account and get instant access to millions of web sources