tracdap.rt.metadata.stoarge

Module Contents

Classes

CopyStatus

Status of an individual copy of a data storage item

IncarnationStatus

Status of an individual incarnation of a data storage item

StorageCopy

Define physical storage for an individual copy of a data item

StorageDefinition

Defines the physical storage for a file or dataset object

StorageIncarnation

Define physical storage for an individual incarnation of a data item

StorageItem

Define physical storage for an individual data item

class tracdap.rt.metadata.stoarge.CopyStatus(*args, **kwds)

Bases: enum.Enum

Status of an individual copy of a data storage item

COPY_AVAILABLE = 1

The copy of the data item is available in storage to access

COPY_EXPUNGED = 2

The copy of the data item has been expunged and is no longer available

COPY_STATUS_NOT_SET = 0
class tracdap.rt.metadata.stoarge.IncarnationStatus(*args, **kwds)

Bases: enum.Enum

Status of an individual incarnation of a data storage item

INCARNATION_AVAILABLE = 1

The incarnation of the data item has at least one copy available in storage

INCARNATION_EXPUNGED = 2

This incarnation of the data item is no longer available in storage, all copies have been expunged

INCARNATION_STATUS_NOT_SET = 0
class tracdap.rt.metadata.stoarge.StorageCopy

Define physical storage for an individual copy of a data item

copyStatus

copyStatus

Type:

CopyStatus

copyTimestamp

copyTimestamp

Type:

DatetimeValue

storageFormat

storageFormat

Type:

str

storageKey

storageKey

Type:

str

storageOptions

storageOptions

Type:

Dict[str, Value]

storagePath

storagePath

Type:

str

class tracdap.rt.metadata.stoarge.StorageDefinition

Defines the physical storage for a file or dataset object

Each storage item corresponds to one logical data item, such as a version of a file or a snapshot of a data partition. Storage for each item is broken down into incarnations (data that has been expunged and recomputed) and copies (physical file-level copies for resilience, locality etc).

See also

DataDefinition, FileDefinition

dataItems

dataItems

Type:

Dict[str, StorageItem]

storageOptions

storageOptions

Type:

Dict[str, Value]

class tracdap.rt.metadata.stoarge.StorageIncarnation

Define physical storage for an individual incarnation of a data item

copies

copies

Type:

List[StorageCopy]

incarnationIndex

incarnationIndex

Type:

int

incarnationStatus

incarnationStatus

Type:

IncarnationStatus

incarnationTimestamp

incarnationTimestamp

Type:

DatetimeValue

class tracdap.rt.metadata.stoarge.StorageItem

Define physical storage for an individual data item

incarnations

incarnations

Type:

List[StorageIncarnation]