JobCleaningAgent

The Job Cleaning Agent controls removing jobs from the WMS in the end of their life cycle.

This agent will take care of removing user jobs, while production jobs should be removed through the TransformationCleaningAgent.
JobCleaningAgent options
JobCleaningAgent
{
  PollingTime = 3600

  #Maximum number of jobs to be processed in one cycle
  MaxJobsAtOnce = 500

  # Delete jobs individually, if True
  JobByJob = False

  #Seconds to wait between jobs if JobByJob is true
  ThrottlingPeriod = 0.0

  RemoveStatusDelay
  {
     # Number of days after which Done jobs are removed
     Done = 7
     # Number of days after which Killed jobs are removed
     Killed = 7
     # Number of days after which Failed jobs are removed
     Failed = 7
     # Number of days after which any jobs, irrespective of status is removed (-1 for disabling this feature)
     Any = -1
  }

  # Which production type jobs _not_ to remove, takes default from Operations/Transformations/DataProcessing
  ProductionTypes =
}
class DIRAC.WorkloadManagementSystem.Agent.JobCleaningAgent.JobCleaningAgent(*args, **kwargs)

Bases: DIRAC.Core.Base.AgentModule.AgentModule

The specific agents must provide the following methods:

  • initialize() for initial settings
  • beginExecution()
  • execute() - the main method called in the agent cycle
  • endExecution()
  • finalize() - the graceful exit of the method, this one is usually used for the agent restart
__init__(*args, **kwargs)

c’tor

am_Enabled()
am_checkStopAgentFile()
am_createStopAgentFile()
am_disableMonitoring()
am_getBasePath()
am_getControlDirectory()
am_getCyclesDone()
am_getMaxCycles()
am_getModuleParam(optionName)
am_getOption(optionName, defaultValue=None)
am_getPollingTime()
am_getShifterProxyLocation()
am_getStopAgentFile()
am_getWatchdogTime()
am_getWorkDirectory()
am_go()
am_initialize(*initArgs)
am_monitoringEnabled()
am_removeStopAgentFile()
am_secureCall(functor, args=(), name=False)
am_setModuleParam(optionName, value)
am_setOption(optionName, value)
am_stopExecution()
beginExecution()
deleteJobOversizedSandbox(jobIDList)

Delete the job oversized sandbox files from storage elements

endExecution()
execute()

Remove jobs in various status

finalize()
initialize()

Sets defaults

removeJobsByStatus(condDict, delay=False)

Remove deleted jobs