Let's take an example of
a Online Retail Company to understand how they can leverage today's software
technologies to leverage Big Data
Challenge faces by
online retail company:
•The need to examine massive amounts of unstructured social
media and search data to find out what are the 'products that consumers are
talking about'
•The growing data volumes causing a major storage problem -
leading to data regret on a regular basis
• The need to strategize the ad buying strategy on sites like
Google, with the goal of competing for e-commerce sales
• The need to track products, sales, and customers (pet bytes of
data) to win pricing concessions from suppliers.
Solution
• Primary basis of solution is co-location of storage and
compute layer
• Solution proposes using 'Hadoop'
for efficient data transformation
• Solution proposes large proportion of analysis to be performed
by Hadoop, MapReduce
Result
* Over-night processing of data now completes
in minutes each day, enabling faster and improved search results
* Data volumes are reduced by as large margin
of more than 60%
* Faster analytics that quickly react to
changing customer sentiments & market conditions.
Technologies in the
solution
• Hadoop, MapReduce, Hive , Pig, Flume,
Pentaho, Java
No comments:
Post a Comment