4 Reasons You Should Use JSON Instead of CSV

Do you deal with large volumes of data? Does your data contain hierarchical information (e.g., multiple reviews for a single product)? Then you need to be using JSON as your go-to data format instead of CSV.

What is Web Crawling?

Introduction

Web crawling can be a very complicated and technical subject to understand. Every web page on the Internet is different from the next, which means every web crawler is different (at least in some way) from the next.

Building a Web Scraper

We briefly touched on how to build a web scraper in our last post on web crawling. In this post, I’ll go into more detail about how to do this. When I use the term “web scraper,” I’m referring to a very specific type of web crawler — one that looks at a specific website and extracts data…

How we’re building the future of web crawling

Our web crawling platform, 80legs, was built over 4 years ago. A lot has changed since 2008. For starters, “big data” wasn’t even a term then, let alone a cliche. Today, there are a wide variety of technologies available for handling true big data…

Meet the Datafiniti Crew During SXSW

If you’re in Austin during SXSW, we’d love to meet you! Here are a few ways you can meet the team behind the search engine for data:

SXSW Startup Crawl