GeneratorConfiguration |
object or string |
✖ |
|
Retrieves data from a configured S3 bucket. DataSources: Not used. SessionData: Not used. |
GeneratorConfiguration.DataArrangeOrder |
one of [AsciiAsc / AsciiDesc / FirstNumericalAsc / FirstNumericalDesc / Unordered] |
✔ |
|
In which order to arrange the loaded data. Arranges data based of the key identifier of the item. Options: [ AsciiAsc - orders by the ascii value ascending / AsciiDesc - orders by the ascii value descending / FirstNumericalAsc - orders by the first found numerical value in the string ascending /FirstNumericalDesc - orders by the first found numerical value in the string descending /'Unordered' - does not order the data ] |
GeneratorConfiguration.Count |
integer or string or null |
✖ |
|
The number of items to generate out of the given data sources (If count is bigger than available number of items an exception will be thrown), if no value is given generates the number of items in the given data sources |
GeneratorConfiguration.DataUuidRegexExpression |
string |
✖ |
.* |
A regex expression to use for filtering data from the external source by their UUID, only items that match the regex will be taken |
GeneratorConfiguration.LoadMetadataFirst |
string or true/false |
✖ |
True |
Wheather to load lightweight S3 metadata first and then load objects sequentially (true) or load all objects parallelly (false) |
GeneratorConfiguration.StorageMetaData |
one of [FullPath / RelativePath / ItemName / None] |
✖ |
|
The way to store the name of the generated data as key in StorageMetaData. Options:[ FullPath - stores the full path of the item as the key / RelativePath - stores the relative path related to the prefix / ItemName - stores only the name of the item as the key / None - does not store the name of the item |
GeneratorConfiguration.S3 |
object or string |
✔ |
|
S3 configurations |
GeneratorConfiguration.S3.AccessKey |
string |
✔ |
|
S3 account access key |
GeneratorConfiguration.S3.SecretKey |
string |
✔ |
|
S3 account secret access key |
GeneratorConfiguration.S3.ServiceURL |
string |
✔ |
|
S3 service url |
GeneratorConfiguration.S3.StorageBucket |
string |
✔ |
|
Name of S3 bucket |
GeneratorConfiguration.S3.Delimiter |
string |
✖ |
|
Delimiter of the objects to extract from s3 bucket, this determines what objects will be retrieved from the bucket, objects that have at least one occurence of the delimiter in their relative path after the Prefix will not be retrieved from the bucket. |
GeneratorConfiguration.S3.ForcePathStyle |
string or true/false |
✖ |
True |
When true, requests will always use path style addressing |
GeneratorConfiguration.S3.Prefix |
string |
✖ |
|
The prefix of the objects, in the s3 bucket to take |
GeneratorConfiguration.S3.SkipEmptyObjects |
string or true/false |
✖ |
True |
Whether to skip the loading of empty s3 objects or not, if true skips them if false doesnt skip them |