About this course

Course type Premium
Course code HWAY
Duration 2 Days

This course is designed for developers who want to create custom YARN applications for Apache Hadoop. It will include: the YARN architecture, YARN development steps, writing a YARN client and ApplicationMaster, and launching Containers. The course uses Eclipse and Gradle connected remotely to a 7-node HDP cluster running in a virtual machine.

Target Audience:

Java software engineers who need to develop YARN applications on Hadoop by writing YARN clients and ApplicationMasters.

Prerequisites

Please note: Hortonworks courses are delivered using electronic courseware. for delegates attending remotely (Virtual classes or Attend from Anywhere) you must ensure that you have dual monitors or a single monitor plus tablet device. Dual monitors are required in order to allow you to view labs and lab instructions on separate screens.

Technical pre-requisites

  • Delegates should be experienced Java developers who have attended HDP Developer: Java OR HDP Developer: Pig and Hive OR are experienced with Hadoop and MapReduce development

Delegates will learn how to

Please note: This course is delivered by accredited Hortonworks instructors. The syllabus includes specific use cases and examples to help illustrate and reinforce the theory and the functionality of the technology being explored. Where possible, the instructor will provide further examples and answer questions relevant to an individual delegates specific application of the technology. However, due to the complexity of the technology and the breadth of application across industries, this may not always be possible in the classroom environment.

Outline

  • Describe the YARN architecture
  • Describe the YARN application lifecycle
  • Write a YARN client application
  • Run a YARN application on a Hadoop cluster
  • Monitor the status of a running YARN application
  • View the aggregated logs of a YARN application
  • Configure a ContainerLaunchContext
  • Use a LocalResource to share application files across a cluster
  • Write a YARN ApplicationMaster
  • Describe the differences between synchronous and asynchronous ApplicationMasters
  • Allocate Containers in a cluster
  • Launch Containers on NodeManagers
  • Write a custom Container to perform specific business logic
  • Explain the job schedulers of the ResourceManager
  • Define queues for the Capacity Scheduler

Hands-On Labs

  • Run a YARN Application
  • Setup a YARN Development Environment
  • Write a YARN Client
  • Submit an ApplicationMaster
  • Write an ApplicationMaster
  • Requesting Containers
  • Running Containers
  • Writing Custom Containers

Premium Course

2 Days

Duration
Delivery Method

Delivery method

Classroom

Face-to-face learning in the comfort of our quality nationwide centres, with free refreshments and Wi-Fi.

Find dates and prices

Online booking is currently not available for this course, to find out more please call us on 0345 074 7998 or email us at info@qa.com to discuss how we can help.

Trusted, awarded and accredited

Fully accredited to ensure we provide the highest possible standards in learning

All third party trademark rights acknowledged.