Hadoop, The Definitive Guide (4 ed)

Prepare to unleash the full potential of your data. The fourth edition of this authoritative guide teaches you how to design, build, and maintain reliable, scalable, distributed systems with Apache Hadoop. Perfect for developers analyzing datasets of any size and administrators managing Hadoop clusters, this book equips you with the knowledge to harness Hadoop effectively.

Focusing exclusively on Hadoop 2, author Tom White introduces new chapters on YARN and related projects, including Parquet, Flume, Crunch, and Spark. You’ll gain insight into the latest Hadoop updates and explore real-world case studies demonstrating Hadoop’s role in healthcare analytics and genomics data processing.

What You Will Learn:

• Understand core Hadoop components: MapReduce, HDFS, and YARN
• Master MapReduce in detail, including how to develop applications using it
• Set up, configure, and maintain a Hadoop cluster running HDFS and MapReduce on YARN
• Work with modern data formats: Avro for data serialization and Parquet for complex nested data
• Ingest data efficiently using Flume for streaming and Sqoop for bulk transfers
• Explore high-level Hadoop tools, including Pig, Hive, Crunch, and Spark, for advanced data processing
• Learn about HBase, the distributed database, and ZooKeeper, the distributed configuration service

With this guide, you’ll gain the skills to handle large-scale data processing projects confidently, from setup to deployment, using the most current Hadoop ecosystem technologies.