December 2017

What is the Omgili Bot, and why is it Crawling Your Website?

Posted on December 28, 2017 by

Hi there. If you’re reading this, it’s probably because you’ve run into Omgilibot – perhaps in your web analytics or server logs (user agent: omgili/0.5 + – and turned to Google to decide whether this crawler is a benevolent creature that should be permitted to do as it will, or something more nefarious that deserves

Continue reading

Posted in Uncategorized | Leave a comment

3 Predictions for Web Data in 2018

Posted on December 12, 2017 by

2017 was a turbulent year: With Donald Trump shaking up the American political system, cryptocurrencies causing riptides throughout financial markets, and advancements in artificial intelligence sparking both anticipation and anxiety in the scientific world, the passing year seems to have been dominated by a sense of uncertainty and a sea change waiting to happen at

Continue reading

Posted in Cybersecurity, Data Extraction | Leave a comment