DATA API
SOLUTIONS
KNOWLEDGE
HELP CENTER
COMPANY
|
LOGIN
OPEN WEB
Infuse applications with news data
Cover the entire blogosphere
Follow conversations around the web
Access structured customer feedback
Train machines with historical data
DARK WEB
Uncover threats across the dark web
Detect compromised PII across the web
DATASETS
Access the world's largest noise-free datasets
Browse through Webz.io's free dataset collection
TECHNOLOGIES
Go from raw data to pure power
Follow trends across millions of media sources
Constantly track suspicious web activity
Get a real-time feed of potential
risks
Sharpen predictions with historical datasets
Scan PII in real-time to catch breaches early
Stop cyber criminals with covert activity tracking

Online Forums APISet your Machine
Up For Discussion

Power your machine with the latest data from online discussion
forums and gain instant access to the world’s public conversations.

Online Forums APISet your Machine
Up For Discussion

Power your machine with the latest data from online discussion forums and gain instant access to the world’s public conversations.

Trusted By

Forums, Discussions
& Message Boards
Don’t Lose
a Thread

Webz.io keeps your machines posted with the latest topic on the discussion board. It continuously consumes millions of discussion posts from forums across the world. Finally, your machines can connect to our repository to stream structured data feeds at scale.

Crawls discussion forums from around the world, in multiple languages.
Feed your machines with every piece of historical forums data you need, powered by unparalleled latency and adaptive crawling.
Plug into our RESTful API with customized and filtered data feeds at scale.
Crawls discussion forums from around the world, in multiple languages.
Feed your machines with every piece of historical forums data you need, powered by unparalleled latency and adaptive crawling.
Plug into our RESTful API with customized and filtered data feeds at scale.

Right Across the Board

490K+
Daily Threads
7.6M+
Daily Posts
13
Years of
Historical Data
160
Languages
105
Countries
490K+
Daily Threads
7.6M+
Daily Posts
13
Years of
Historical Data
160
Languages
105
Countries

Keep Your MachineOn Topic

Advanced Filters
Easily sort forum data by relevance, crawl date, publication date, and domain rank.
Thread Discovery
Get the original post and all replies to capture the entire discussion thread.
Popularity Ranking
Determine the popularity of a thread or topic by the number of replies and the author’s rank.
Advanced Filters
Easily sort forum data by relevance, crawl date, publication date, and domain rank.
Thread Discovery
Get the original post and all replies to capture the entire discussion thread.
Popularity Ranking
Determine the popularity of a thread or topic by the number of replies and the author’s rank.

built for your machines.Made for What You Do.

Media Monitoring
Risk Intelligence
Financial Analysis
Market Research
Media Monitoring
Media Monitoring
Listen to the latest conversations in online forums, in the right context, across any region.
learn more
Media Monitoring
Media Monitoring
Media Monitoring
Listen to the latest conversations in online forums, in the right context, across any region.
learn more
Risk Intelligence
Financial Analysis
Market Research

SEEWhat Machines See

Explore the perfectly structured JSON format from the following query

See below filtered results in JSON format from the following query:
Query:

entities: {

persons: [ ] ,

locations: [ ] ,

organizations: [ ]

} ,

updated: "2021-10-21T21:09:52.024+03:00" ,

highlightThreadTitle: "" ,

uuid: "f3204047357d4b0436a74f64524cfc93b9473f26" ,

thread: {

social: {

gplus: {

shares: 0

} ,

pinterest: {

shares: 0

} ,

vk: {

shares: 0

} ,

linkedin: {

shares: 0

} ,

facebook: {

likes: 0 ,

comments: 0 ,

shares: 0

} ,

stumbledupon: {

shares: 0

}

} ,

reach: {

updated: "2020-10-15T14:52:00.000+03:00" ,

page_views: {

per_user: 1.5 ,

per_million: 7.63

} ,

per_million: 210

} ,

site_full: "forums.macrumors.com" ,

main_image: "https://images.macrumors.com/article-new/2019/10/macrumors-forums-social.jpg" ,

site_section: "http://forums.macrumors.com/forums/ios-15.233/" ,

section_title: "iOS 15 | MacRumors Forums" ,

url: "http://forums.macrumors.com/threads/ios-15-1-rc-bug-fixes-changes-and-improvements.2317549/page-11" ,

country: "US" ,

domain_rank: 3608 ,

title: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11" ,

performance_score: 0 ,

site: "macrumors.com" ,

site_categories: [

"mac_support" ,

"tech"

] ,

participants_count: 1 ,

title_full: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11 | MacRumors Forums" ,

spam_score: 0 ,

site_type: "discussions" ,

published: "2021-10-21T18:35:00.000+03:00" ,

replies_count: 8 ,

uuid: "f3204047357d4b0436a74f64524cfc93b9473f26"

} ,

author: "Anonymous" ,

url: "http://forums.macrumors.com/threads/ios-15-1-rc-bug-fixes-changes-and-improvements.2317549/page-11" ,

ord_in_thread: 0 ,

title: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11" ,

external_images: [ ] ,

highlightText: "" ,

language: "english" ,

text: "Samdh90 said: Do you know yet if the build is available on iphone as well? Sure sounds like a minor RC2 build to me. Click to expand... It's just iPadOS for the iPad mini 6." ,

external_links: [

"https://support.apple.com/iphone-x-display-module-replacement-program" ,

"https://www.support.apple.com/iphone-x-display-module-replacement-program"

] ,

published: "2021-10-21T18:35:00.000+03:00" ,

parent_url: NULL ,

crawled: "2021-10-21T21:09:52.024+03:00" ,

highlightTitle: "" ,

rating: NULL

For more information, check out our Developer Hub which contains helpful
Documentation, Video Tutorials, Use Cases and more
See below filtered results in JSON format from the following query:
Query:

entities: {

persons: [ ] ,

locations: [ ] ,

organizations: [ ]

} ,

updated: "2021-10-21T21:09:52.024+03:00" ,

highlightThreadTitle: "" ,

uuid: "f3204047357d4b0436a74f64524cfc93b9473f26" ,

thread: {

social: {

gplus: {

shares: 0

} ,

pinterest: {

shares: 0

} ,

vk: {

shares: 0

} ,

linkedin: {

shares: 0

} ,

facebook: {

likes: 0 ,

comments: 0 ,

shares: 0

} ,

stumbledupon: {

shares: 0

}

} ,

reach: {

updated: "2020-10-15T14:52:00.000+03:00" ,

page_views: {

per_user: 1.5 ,

per_million: 7.63

} ,

per_million: 210

} ,

site_full: "forums.macrumors.com" ,

main_image: "https://images.macrumors.com/article-new/2019/10/macrumors-forums-social.jpg" ,

site_section: "http://forums.macrumors.com/forums/ios-15.233/" ,

section_title: "iOS 15 | MacRumors Forums" ,

url: "http://forums.macrumors.com/threads/ios-15-1-rc-bug-fixes-changes-and-improvements.2317549/page-11" ,

country: "US" ,

domain_rank: 3608 ,

title: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11" ,

performance_score: 0 ,

site: "macrumors.com" ,

site_categories: [

"mac_support" ,

"tech"

] ,

participants_count: 1 ,

title_full: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11 | MacRumors Forums" ,

spam_score: 0 ,

site_type: "discussions" ,

published: "2021-10-21T18:35:00.000+03:00" ,

replies_count: 8 ,

uuid: "f3204047357d4b0436a74f64524cfc93b9473f26"

} ,

author: "Anonymous" ,

url: "http://forums.macrumors.com/threads/ios-15-1-rc-bug-fixes-changes-and-improvements.2317549/page-11" ,

ord_in_thread: 0 ,

title: "iOS 15.1 RC ― Bug Fixes, Changes, and Improvements | Page 11" ,

external_images: [ ] ,

highlightText: "" ,

language: "english" ,

text: "Samdh90 said: Do you know yet if the build is available on iphone as well? Sure sounds like a minor RC2 build to me. Click to expand... It's just iPadOS for the iPad mini 6." ,

external_links: [

"https://support.apple.com/iphone-x-display-module-replacement-program" ,

"https://www.support.apple.com/iphone-x-display-module-replacement-program"

] ,

published: "2021-10-21T18:35:00.000+03:00" ,

parent_url: NULL ,

crawled: "2021-10-21T21:09:52.024+03:00" ,

highlightTitle: "" ,

rating: NULL

For more information, check out our Developer Hub which contains helpful Documentation, Video Tutorials, Use Cases and more

Open your MachinesFor a Discussion

With Webz.io’s Discussion Forums API filters

Entities
Run queries based on people, locations and organizations.
Full Text
Get the whole text of each post included in your results.
Website Metadata
Site Rank, Country, Site Category.
Categories
Receive the most relevant discussions by using our category filtering, with specific topics, crawl and published date, comment count, author, domain rank and more.

name: "Amazon Prime Video" ,

polarity: "strong positive" ,

frequency: 1 ,

relevance: 12 ,

type: "Organization>ConsumerServicesCompany>MediaCompany" ,

fiction: false ,

geographics: [

{

continent: "America" ,

country: "United States" ,

city: NULL ,

district: NULL

} ,

]

Entities
Run queries based on people, locations and organizations.

name: "Amazon Prime Video" ,

polarity: "strong positive" ,

frequency: 1 ,

relevance: 12 ,

type: "Organization>ConsumerServicesCompany>MediaCompany" ,

fiction: false ,

geographics: [

{

continent: "America" ,

country: "United States" ,

city: NULL ,

district: NULL

} ,

]

Full Text
Get the whole text of each post included in your results.
Website Metadata
Site Rank, Country, Site Category.
Categories
Receive the most relevant discussions by using our category filtering, with specific topics, crawl and published date, comment count, author, domain rank and more.

See Webz.ioIn Action

Experience the True Power of
Machine-Defined Data

web data

HAVE AQuestion?

GET MORE HELP

Yes.

We crawl millions of sites, covering discussions, news, blogs and reviews every day. Our coverage keeps growing every day and we’re always ready to add new sources according to needs.

Webz.io supports 160+ languages across every geographic territory with online access.

Each thread we crawl is given a spam score, ranging between 0 to 1, which indicates the spam-level of the text. For example, you can filter out threads with spam scores higher than 0.5, by adding the term `spam_score:<=0.5` to the search query.

We offer global, historical data covering discussions, reviews, news and blogs going back to 2008. You can use our archive to run the same query or a new query to get the entire dataset for that time frame.

Yes, as long as the website allows our crawlers we can try parsing the data automatically, or if required, we offer a custom parser option at additional cost.

Of course. Just let us know and we'll disable logging for your subscription.

No, Facebook and Twitter are not publicly available data because they require login details. We do cover social signals, such as Facebook shares and comments.

We have different pricing plans, based on the type and volume of the data you require. To find out how you can get started, set up a call with our data consultant today.
Feed Your Machines
The Data They Need
Feed Your Machines The Data They Need