SHORT PROJECTS FOR TRAINING

PROJECT I

Social media analysis on Hadoop Framework->

Description:
The project provides a brief overview on how Hadoop framework & processing can be
leveraged to perform analysis on social media data. The mode of data extraction and
analysis would vary depending upon different tools present with Hadoop, but the basic
idea of what can be done using the power of Hadoop will remain the same throughout.
This project will not be a full-fledged distribution to the students rather to provide them a
basic understanding of what they can do in Hadoop. The question of how to do it will
have to be to the discretion of the students after they learn the Hadoop framework.
Briefs:
1) Data extraction from social media portals like FaceBook, Twitter, Change, etc.
2) Pre-processing the extracted data to conform the Hadoop norms for storage.
3) Data storage and representation in Hadoop favored warehouses.
4) Data Representation (only if its not an overhead and time permits).
5) Performing short analytics on the stored data using different tools of Hadoop
ecosystem.
PROJECT- II

Weather data analysis using core MapReduce programming->

Description:
This projects purpose is only to provide a brief description of how to write a MapReduce
program in Hadoop for any problem. The students will be given a brief understanding of
how they can design their own mappers & reducers for any specific problem.
Briefs:
1) Cleansing, analysis & storage of the weather data set (freely distributed).
2) Short MapReduce program writing to understand the internal functioning of
Hadoop.
3) Display and analysis of data based on specific requirements.