InputDataAgent

Update the transformation files of active transformations, given an InputDataQuery fetched from the Transformation Service.

Possibility to speedup the query time by only fetching files that were added since the last iteration. Use the CS option RefreshOnly (False by default) and set the DateKey (empty by default) to the meta data key set in the DIRAC FileCatalog.

The following options can be set for the InputDataAgent.

InputDataAgent options

InputDataAgent
{
  PollingTime = 120
  FullUpdatePeriod = 86400
  RefreshOnly = False
  # If True, query the FileCatalog as the owner of the transformation, needed for MultiVO*MetaData filecatalogs
  MultiVO = False
}

class DIRAC.TransformationSystem.Agent.InputDataAgent.InputDataAgent(*args, **kwargs)

Bases: AgentModule

__init__(*args, **kwargs): c’tor

am_Enabled()

am_checkStopAgentFile()

am_createStopAgentFile()

am_getControlDirectory()

am_getCyclesDone()

am_getMaxCycles()

am_getModuleParam(optionName)

am_getOption(optionName, defaultValue=None): Gets an option from the agent’s configuration section. The section will be a subsection of the /Systems section in the CS.

am_getPollingTime()

am_getShifterProxyLocation()

am_getStopAgentFile()

am_getWatchdogTime()

am_getWorkDirectory()

am_go()

am_initialize(*initArgs)

Common initialization for all the agents.

This is executed every time an agent (re)starts. This is called by the AgentReactor, should not be overridden.

am_removeStopAgentFile()

am_secureCall(functor, args=(), name=False)

am_setModuleParam(optionName, value)

am_setOption(optionName, value)

am_stopExecution()

beginExecution()

endExecution()

execute(): Main execution method

finalize()

initialize(): Make the necessary initializations