Big Data can be harnessed for a lot less than you think -- just don't get anyone with expensive lawyers angry
If you've read anything about the phenomenon of Big Data, then you probably picture armies of servers chugging some form of the Hadoop ecosystem to crunch mountains of information streaming from internal corporate transactions, emails, instant messages, and Web logs or external social media interactions and public information.
Sounds expensive, right? Not necessarily. Thanks to cloud computing, freely available tools, and limitless free data, you can do major league Big Data analysis for a C-note.
At a GigaOm conference on Big Data last week, Pete Warden, who claims he lives on ramen noodles, described how he spent just $100 to scrape 500 million Web pages, including 220 million Facebook public profiles, using his own Web crawler and a 100-machine cluster running on Amazon EC2. He was able to analyze the information to match Twitter, LinkedIn, and Facebook accounts with the email accounts of users of his email tool.
To Continue Reading: Click Here
--------------------------------------------
Source: infoworld.com
By: Leon Erlanger
0 comments:
Post a Comment