Why (and How) to Monitor RSS Feeds in 2018

Why (and How) to Monitor RSS Feeds in 2018

Rich Site Summary (RSS), as a web technology, has been around since the turn of the last century. But is it still relevant in 2018, is it going to stay around for […]

Meet the Online News Archive: Time for Some Historical Perspective

Meet the Online News Archive: Time for Some Historical Perspective

Whether you’re in the world of financial analysis and modeling, AI modeling or market research, historical news web data can really change the game. Learn how.

How Artificial Intelligence Can Bridge the Gap between Technology and Hype

How Artificial Intelligence Can Bridge the Gap between Technology and Hype

If you read business or tech publications, you’ve probably heard about the ‘explosion of data in the business world’. There has certainly been no lack of voices shouting about it from every […]

Structuring the Dark Web!

Structuring the Dark Web!

We’ve recently launched an exciting new addition to our dark web data feed (as featured on Betanews, ProgrammableWeb, and elsewhere): now, in addition to industry-leading breadth of coverage of the TOR network, […]

Financial success using AI and Time Travel

Wait let me explain. I can explain every part of this click-bait title, it will make sense I promise. So, A great philosopher named Homer Simpsons once said: “Trying is the first […]

What is the Omgili Bot, and why is it Crawling Your Website?

What is the Omgili Bot, and why is it Crawling Your Website?

Hi there. If you’re reading this, it’s probably because you’ve run into Omgilibot – perhaps in your web analytics or server logs (user agent: omgili/0.5 +https://omgili.com) – and turned to Google to […]

3 Predictions for Web Data in 2018

3 Predictions for Web Data in 2018

2017 was a turbulent year: With Donald Trump shaking up the American political system, cryptocurrencies causing riptides throughout financial markets, and advancements in artificial intelligence sparking both anticipation and anxiety in the […]

Was Black Friday Worth It? The Crawled eCommerce Data Answer

Was Black Friday Worth It? The Crawled eCommerce Data Answer

Now that we’ve had a chance to recover from the Black Friday and Cyber Monday crazes, which chalked up record sales this year, it’s time to ask the inevitable question: was Black […]

Richer Media Analysis with Broadcast News Transcripts

Richer Media Analysis with Broadcast News Transcripts

Learn how to use broadcast news transcript to enrich your media analysis.

3 Steps to Turn Webpages into Machine-Readable Data

3 Steps to Turn Webpages into Machine-Readable Data

The vast majority of us use the web every single day – for news, shopping, socializing and really any type of activity you can imagine. But when it comes to acquiring data […]