org.apache.lens.server.scheduler

Class SchedulerServiceImpl

java.lang.Object

org.apache.hive.service.AbstractService

org.apache.hive.service.CompositeService

org.apache.lens.server.BaseLensService

org.apache.lens.server.scheduler.SchedulerServiceImpl

All Implemented Interfaces:

Externalizable, Serializable, org.apache.hive.service.Service, HealthCheckable, LensService, SchedulerService

public class SchedulerServiceImpl
extends BaseLensService
implements SchedulerService

The Class QuerySchedulerService.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hive.service.CompositeService

org.apache.hive.service.CompositeService.CompositeServiceShutdownHook

Nested classes/interfaces inherited from interface org.apache.hive.service.Service

org.apache.hive.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field and Description
static String	NAME The constant name for scheduler service.

Constructor Summary

Constructors

Constructor and Description
SchedulerServiceImpl(org.apache.hive.service.cli.CLIService cliService) Instantiates a new scheduler service.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	deleteJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle) Delete a job.
void	expireJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle, Date expiryTime) End a job by specifying an expiry time.
Collection<SchedulerJobStats>	getAllJobStats(LensSessionHandle sessionHandle, String state, String user, String jobName, long startTime, long endTime)
HealthStatus	getHealthStatus() Returns the health status of the service.
SchedulerJobInstanceInfo	getInstanceDetails(LensSessionHandle sessionHandle, SchedulerJobInstanceHandle instanceHandle) Instance details for an instance.
XJob	getJobDefinition(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle) Returns the definition of a job.
SchedulerJobInfo	getJobDetails(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle) Returns the details of a job.
List<String>	getJobInstances(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle, Long numResults) Returns handles for last numResults instances for the job.
SchedulerJobStats	getJobStats(LensSessionHandle sessionHandle, SchedulerJobHandle handle, String state, long startTime, long endTime) Returns stats for a job.
boolean	killInstance(LensSessionHandle sessionHandle, SchedulerJobInstanceHandle instanceHandle) Kills a running job instance.
boolean	rerunInstance(LensSessionHandle sessionHandle, SchedulerJobInstanceHandle instanceHandle) Reruns a failed/killed/completed job instance.
boolean	resumeJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle, Date effectiveTime) Resume a job from a given time.
void	scheduleJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle) Schedule a job.
SchedulerJobHandle	submitAndScheduleJob(LensSessionHandle sessionHandle, XJob job) Submit a job and also schedule it.
SchedulerJobHandle	submitJob(LensSessionHandle sessionHandle, XJob job) Submit a job.
boolean	suspendJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle) Suspend a job.
boolean	updateJob(LensSessionHandle sessionHandle, SchedulerJobHandle jobHandle, XJob newJobDefinition) Update a job with new definition.

Methods inherited from class org.apache.lens.server.BaseLensService

acquire, acquire, addResource, closeSession, deleteResource, getCliService, getHiveSessionHandle, getLensConf, getLensConf, getNumberOfSessions, getServerDomain, getSession, getSessionManager, getValidPath, openSession, prepareStopping, readExternal, release, release, removePrefixBeforeURI, restoreSession, writeExternal

Methods inherited from class org.apache.hive.service.CompositeService

getServices, init, start, stop

Methods inherited from class org.apache.hive.service.AbstractService

getHiveConf, getName, getServiceState, getStartTime, register, unregister

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NAME

public static final String NAME

The constant name for scheduler service.

See Also:

Constant Field Values

Constructor Detail

SchedulerServiceImpl

public SchedulerServiceImpl(org.apache.hive.service.cli.CLIService cliService)

Instantiates a new scheduler service.

Parameters:

cliService - the cli service

Method Detail

getHealthStatus

public HealthStatus getHealthStatus()

Returns the health status of the service.

Specified by:

getHealthStatus in interface HealthCheckable

Specified by:

getHealthStatus in class BaseLensService

Returns:

submitJob

public SchedulerJobHandle submitJob(LensSessionHandle sessionHandle,
                           XJob job)
                             throws LensException

Submit a job.

Specified by:

submitJob in interface SchedulerService

Parameters:

sessionHandle - handle for this session.

job - job to be submitted.

Returns:

unique id for the submitted job.

Throws:

LensException - the lens exception

scheduleJob

public void scheduleJob(LensSessionHandle sessionHandle,
               SchedulerJobHandle jobHandle)
                 throws LensException

Schedule a job.

Specified by:

scheduleJob in interface SchedulerService

Parameters:

sessionHandle - handle for the current session.

jobHandle - handle for the job to be scheduled.

Throws:

LensException - the lens exception

submitAndScheduleJob

public SchedulerJobHandle submitAndScheduleJob(LensSessionHandle sessionHandle,
                                      XJob job)
                                        throws LensException

Description copied from interface: SchedulerService

Submit a job and also schedule it.

Specified by:

submitAndScheduleJob in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

job - job definition.

Returns:

unique id of the job which is submitted and scheduled.

Throws:

LensException - the lens exception

getJobDefinition

public XJob getJobDefinition(LensSessionHandle sessionHandle,
                    SchedulerJobHandle jobHandle)
                      throws LensException

Returns the definition of a job.

Specified by:

getJobDefinition in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

jobHandle - handle for the job

Returns:

job definition

Throws:

LensException - the lens exception

getJobDetails

public SchedulerJobInfo getJobDetails(LensSessionHandle sessionHandle,
                             SchedulerJobHandle jobHandle)
                               throws LensException

Returns the details of a job. Details may contain extra system information like id for the job.

Specified by:

getJobDetails in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

jobHandle - handle for the job

Returns:

job details for the job

Throws:

LensException - the lens exception

updateJob

public boolean updateJob(LensSessionHandle sessionHandle,
                SchedulerJobHandle jobHandle,
                XJob newJobDefinition)
                  throws LensException

Update a job with new definition. Updates will be applied only for newer instances. Running instances will be running with old definition

Specified by:

updateJob in interface SchedulerService

jobHandle - handle for the job which you want to update.

Returns:

true or false based on whether the update was successful or failed.

Throws:

LensException - the lens exception

expireJob

public void expireJob(LensSessionHandle sessionHandle,
             SchedulerJobHandle jobHandle,
             Date expiryTime)
               throws LensException

End a job by specifying an expiry time.

Specified by:

expireJob in interface SchedulerService

Parameters:

sessionHandle - handle for the current session.

jobHandle - handle for the job

expiryTime - time after which the job shouldn't execute.

Throws:

LensException - the lens exception

suspendJob

public boolean suspendJob(LensSessionHandle sessionHandle,
                 SchedulerJobHandle jobHandle)
                   throws LensException

Suspend a job. If the job is not in scheduled state, it will return true. Once a job is suspended, no further instances of that job will run. Any running instances of that job will continue normally.

Specified by:

suspendJob in interface SchedulerService

Parameters:

sessionHandle - handle for the current session.

jobHandle - handle for the job

Returns:

true if the job was suspended successfully, false otherwise.

Throws:

LensException - the lens exception

resumeJob

public boolean resumeJob(LensSessionHandle sessionHandle,
                SchedulerJobHandle jobHandle,
                Date effectiveTime)
                  throws LensException

Resume a job from a given time.

Specified by:

resumeJob in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

jobHandle - handle for the job

effectiveTime - time from which to resume the instances.

Returns:

true if the job was resumed successfully, false otherwise.

Throws:

LensException - the lens exception

deleteJob

public boolean deleteJob(LensSessionHandle sessionHandle,
                SchedulerJobHandle jobHandle)
                  throws LensException

Delete a job.

Specified by:

deleteJob in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

jobHandle - handle for the job

Returns:

true if the job was deleted successfully.

Throws:

LensException - the lens exception

getAllJobStats

public Collection<SchedulerJobStats> getAllJobStats(LensSessionHandle sessionHandle,
                                           String state,
                                           String user,
                                           String jobName,
                                           long startTime,
                                           long endTime)
                                             throws LensException

Specified by:

getAllJobStats in interface SchedulerService

Parameters:

sessionHandle - handle for the current session.

state - filter for status, if specified only jobs in that state will be returned, if null no entries will be removed from result

user - filter for user who submitted the job, if specified only jobs submitted by the given user will be returned, if not specified no entries will be removed from result on basis of userName

jobName - filter for jobName, if specified only the jobs with name same as given name will be considered , else no jobs will be filtered out on the basis of name.

startTime - if specified only instances with scheduleTime after this time will be considered.

endTime - if specified only instances with scheduleTime before this time will be considered.

Returns:

A collection of stats per job

Throws:

LensException

getJobStats

public SchedulerJobStats getJobStats(LensSessionHandle sessionHandle,
                            SchedulerJobHandle handle,
                            String state,
                            long startTime,
                            long endTime)
                              throws LensException

Returns stats for a job.

Specified by:

getJobStats in interface SchedulerService

Parameters:

sessionHandle - handle for session.

handle - handle for the job

state - filter for status, if specified only jobs in that state will be returned, if null no entries will be removed from result

startTime - if specified only instances with scheduleTime after this time will be considered.

endTime - if specified only instances with scheduleTime before this time will be considered.

Throws:

LensException - the lens exception

rerunInstance

public boolean rerunInstance(LensSessionHandle sessionHandle,
                    SchedulerJobInstanceHandle instanceHandle)
                      throws LensException

Reruns a failed/killed/completed job instance. If the instance is not in a terminal state, then this operation will be a no-op and will return false.

Specified by:

rerunInstance in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

instanceHandle - handle for the instance

Returns:

true if the instance was re run successfully, false otherwise.

Throws:

LensException - the lens exception

getJobInstances

public List<String> getJobInstances(LensSessionHandle sessionHandle,
                           SchedulerJobHandle jobHandle,
                           Long numResults)
                             throws LensException

Returns handles for last numResults instances for the job.

Specified by:

getJobInstances in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

jobHandle - handle for the job

numResults - - number of results to be returned, default 100.

Returns:

list of instance ids for the job

Throws:

LensException - the lens exception

killInstance

public boolean killInstance(LensSessionHandle sessionHandle,
                   SchedulerJobInstanceHandle instanceHandle)
                     throws LensException

Description copied from interface: SchedulerService

Kills a running job instance. If the job instance is already completed or not in running state, this will be a no-op and will return false.

Specified by:

killInstance in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

instanceHandle - handle for the instance

Returns:

true if the instance was killed successfully, false otherwise.

Throws:

LensException - the lens exception

getInstanceDetails

public SchedulerJobInstanceInfo getInstanceDetails(LensSessionHandle sessionHandle,
                                          SchedulerJobInstanceHandle instanceHandle)
                                            throws LensException

Instance details for an instance.

Specified by:

getInstanceDetails in interface SchedulerService

Parameters:

sessionHandle - handle for the session.

instanceHandle - handle for the instance.

Returns:

details for the instance.

Throws:

LensException - the lens exception