Survey Results: What Matters to Web Data Collection Buyers

Survey Results: What Matters to Web Data Collection Buyers

While structured web data presents exciting possibilities in many fields of endeavor – including finance, cyber-security, artificial intelligence and more – the market for data extraction platforms is still fairly young. Only…

How Alternative Data is Reshaping Finance

How Alternative Data is Reshaping Finance

According to a report recently featured on the Financial Times (PDF), hedge funds are expected to spend upwards of $600m on digital datasets this year, and up to $1bn by 2020. What’s…

Why (and How) to Monitor RSS Feeds in 2018

Why (and How) to Monitor RSS Feeds in 2018

Rich Site Summary (RSS), as a web technology, has been around since the turn of the last century. But is it still relevant in 2018, is it going to stay around for…

Meet the Online News Archive: Time for Some Historical Perspective

Meet the Online News Archive: Time for Some Historical Perspective

Whether you’re in the world of financial analysis and modeling, AI modeling or market research, historical news web data can really change the game. Learn how.

How Artificial Intelligence Can Bridge the Gap between Technology and Hype

How Artificial Intelligence Can Bridge the Gap between Technology and Hype

If you read business or tech publications, you’ve probably heard about the ‘explosion of data in the business world’. There has certainly been no lack of voices shouting about it from every…

Structuring the Dark Web!

Structuring the Dark Web!

We’ve recently launched an exciting new addition to our dark web data feed (as featured on Betanews, ProgrammableWeb, and elsewhere): now, in addition to industry-leading breadth of coverage of the TOR network,…

Financial success using AI and Time Travel

Wait let me explain. I can explain every part of this click-bait title, it will make sense I promise. So, A great philosopher named Homer Simpsons once said: “Trying is the first…

What is the Omgili Bot, and why is it Crawling Your Website?

What is the Omgili Bot, and why is it Crawling Your Website?

Hi there. If you’re reading this, it’s probably because you’ve run into Omgilibot – perhaps in your web analytics or server logs (user agent: omgili/0.5 +https://omgili.com) – and turned to Google to…

3 Predictions for Web Data in 2018

3 Predictions for Web Data in 2018

2017 was a turbulent year: With Donald Trump shaking up the American political system, cryptocurrencies causing riptides throughout financial markets, and advancements in artificial intelligence sparking both anticipation and anxiety in the…

Was Black Friday Worth It? The Crawled eCommerce Data Answer

Was Black Friday Worth It? The Crawled eCommerce Data Answer

Now that we’ve had a chance to recover from the Black Friday and Cyber Monday crazes, which chalked up record sales this year, it’s time to ask the inevitable question: was Black…