ConsistencyInspector

Main class for doing consistency checks, between files in: - File Catalog - TransformationSystem

Should be extended to include the Storage (in DIRAC)

class DIRAC.DataManagementSystem.Client.ConsistencyInspector.ConsistencyInspector(interactive=True, transClient=None, dm=None, fc=None, dic=None)

Bases: object

A class for handling some consistency checks

__init__(interactive=True, transClient=None, dm=None, fc=None, dic=None)

c’tor interactive: Data Manager (True) or DIRAC Agente (False) transClient: TransformationClient() if None, else transClient params dm: DataManager() if None, else dm params fc: FileCatalog() if None, else fc params One object for every production/directoriesList…

catalogDirectoryToSE(lfnDir)

This obtains the replica and metadata information from the catalog for the supplied directory and checks against the storage elements.

catalogFileToSE(lfns)

This obtains the replica and metadata information from the catalog and checks against the storage elements.

checkFC2SE()

check files vs SE information

checkPhysicalFiles(replicas, catalogMetadata, ses=None)

This method takes the supplied replica and metadata information obtained from the catalog and checks against the storage elements.

compareChecksum(lfns)

compare the checksum of the file in the FC and the checksum of the physical replicas. Returns a dictionary containing 3 sub-dictionaries: one with files with missing PFN, one with files with all replicas corrupted, and one with files with some replicas corrupted and at least one good replica

fileType

Getter

fileTypesExcluded

Getter

getReplicasPresence(lfns)

get the replicas using the standard FileCatalog.getReplicas()

getReplicasPresenceFromDirectoryScan(lfns)

Get replicas scanning the directories. Might be faster.

getStorageDirectoryContents(lfnDir, storageElement)

This takes the supplied lfn directories and recursively obtains the files in the supplied storage element

get_fileType()

Getter

get_fileTypesExcluded()

Getter

get_lfns()

Getter

get_prod()

Getter

lfns

Getter

prod

Getter

set_fileType(value)

Setter

set_fileTypesExcluded(value)

Setter

set_lfns(value)

Setter

set_prod(value)

Setter

storageDirectoryToCatalog(lfnDir, storageElement)

This obtains the file found on the storage element in the supplied directories and determines whether they exist in the catalog and checks their metadata elements