org.apache.samza.rest.proxy.task

Class SamzaTaskProxy

java.lang.Object

org.apache.samza.rest.proxy.task.SamzaTaskProxy

All Implemented Interfaces:

TaskProxy

public class SamzaTaskProxy
extends java.lang.Object
implements TaskProxy

TaskProxy interface implementation for samza jobs running in yarn execution environment. getTasks implementation reads the jobModel of the job specified by JobInstance from coordinator stream.

Constructor Summary

Constructors

Constructor and Description
SamzaTaskProxy(TaskResourceConfig taskResourceConfig, InstallationFinder installFinder)

Method Summary

Modifier and Type	Method and Description
java.util.List<Task>	getTasks(JobInstance jobInstance) Fetches the complete job model from the coordinator stream based upon the provided JobInstance param, transforms it to a list of Task and returns it.
protected org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer	initializeCoordinatorStreamConsumer(JobInstance jobInstance) Initialize CoordinatorStreamSystemConsumer based upon JobInstance parameter.
protected java.util.List<Task>	readTasksFromCoordinatorStream(org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer consumer) Builds list of Task from job model in coordinator stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SamzaTaskProxy

public SamzaTaskProxy(TaskResourceConfig taskResourceConfig,
                      InstallationFinder installFinder)

Method Detail

getTasks

public java.util.List<Task> getTasks(JobInstance jobInstance)
                              throws java.io.IOException,
                                     java.lang.InterruptedException

Fetches the complete job model from the coordinator stream based upon the provided JobInstance param, transforms it to a list of Task and returns it.

Specified by:

getTasks in interface TaskProxy

Parameters:

jobInstance - the job instance to get the tasks for.

Returns:

a list of all the Task tasks that belongs to the JobInstance. Each task will have a preferred host and stream partitions assigned to it by the samza job coordinator.

Throws:

java.io.IOException - if there was a problem executing the command to get the tasks.

java.lang.InterruptedException - if the thread was interrupted while waiting for the result.

initializeCoordinatorStreamConsumer

protected org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer initializeCoordinatorStreamConsumer(JobInstance jobInstance)

Initialize CoordinatorStreamSystemConsumer based upon JobInstance parameter.

Parameters:

jobInstance - the job instance to get CoordinatorStreamSystemConsumer for.

Returns:

built and initialized CoordinatorStreamSystemConsumer.

readTasksFromCoordinatorStream

protected java.util.List<Task> readTasksFromCoordinatorStream(org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer consumer)

Builds list of Task from job model in coordinator stream.

Parameters:

consumer - system consumer associated with a job's coordinator stream.

Returns:

list of Task constructed from job model in coordinator stream.