Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Look up keyword
Like this
2Activity
0 of .
Results for:
No results containing your search query
P. 1
Spring Data Hadoop Reference

Spring Data Hadoop Reference

Ratings: (0)|Views: 239|Likes:
Published by Ângelo S Mendonça

More info:

Published by: Ângelo S Mendonça on Dec 14, 2012
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

03/14/2015

pdf

text

original

 
Spring Hadoop Reference Manual
Costin Leau
 
Spring Hadoop Reference Manual
by Costin Leau1.0.0.RC1
Copies of this document may be made for your own use and for distribution to others, provided that you do not charge any fee for such copiesand further provided that each copy contains this Copyright Notice, whether distributed in print or electronically.
 
Spring Hadoop1.0.0.RC1Spring HadoopReference Manualiii
Table of Contents
Preface ...................................................................................................................................... vI. Introduction ............................................................................................................................ 11. Requirements ................................................................................................................. 2II. Spring and Hadoop ................................................................................................................ 32. Hadoop Configuration, MapReduce, and Distributed Cache .............................................. 42.1. Using the Spring for Apache Hadoop Namespace .................................................. 42.2. Configuring Hadoop ............................................................................................ 52.3. Creating a Hadoop Job ........................................................................................ 8Creating a Hadoop Streaming Job ....................................................................... 92.4. Running a Hadoop Job ........................................................................................ 9Using the Hadoop Job tasklet ............................................................................ 102.5. Running a Hadoop Tool ..................................................................................... 10ReplacingHadoop shell invocations with
tool-runner
.................................. 11Using the Hadoop Tool tasklet .......................................................................... 122.6. Running aHadoop Jar ....................................................................................... 12Using the Hadoop Jar tasklet ............................................................................ 132.7. Configuring the Hadoop
DistributedCache
................................................. 132.8. Map Reduce Generic Options ............................................................................. 143. Working with the Hadoop File System .......................................................................... 153.1. Configuring thefile-system ................................................................................ 153.2. Scripting the Hadoop API .................................................................................. 16Using scripts .................................................................................................... 183.3. Scripting implicit variables ................................................................................. 18Running scripts ................................................................................................ 19Using the Scripting tasklet ................................................................................ 203.4. File System Shell (FsShell) ................................................................................ 20DistCp API ...................................................................................................... 224. Working withHBase .................................................................................................... 234.1. Data Access Object (DAO) Support .................................................................... 235. Hive integration ........................................................................................................... 255.1. Starting a Hive Server ....................................................................................... 255.2. Using the Hive Thrift Client .............................................................................. 255.3. Using the Hive JDBC Client .............................................................................. 265.4. Running a Hive script or query .......................................................................... 26Using theHive tasklet ...................................................................................... 275.5. Interacting with the Hive API ............................................................................. 276. Pig support .................................................................................................................. 296.1. Running a Pig script .......................................................................................... 29Using the Pig tasklet ........................................................................................ 306.2. Interactingwith the Pig API ............................................................................... 307. Cascading integration ................................................................................................... 327.1. Using the Cascading tasklet ............................................................................... 337.2.Using Scalding .................................................................................................. 33

Activity (2)

You've already reviewed this. Edit your review.
1 thousand reads
1 hundred reads

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->