Duplicate
Last updated
Was this helpful?
English
Last updated
Was this helpful?
Duplicate can be especially useful in the following situations:
When data does not contain personally identifiable information (PII) or sensitive elements, duplicating it allows for efficient replication without modification.
Open your Workspace.
On the Job Configuration tab, select the column icon on the top left of the column where you want to duplicate.
Under Column settings > Generation Method, select Duplicate to copy the column from the source table to the destination table as-is.
Set the relevant duplicate parameters.
Select Confirm.
Enable the Shuffle button to shuffle the generated values, while maintaining the overall frequency of values. For example, if you have 4 High, 3 Medium and 5 Low values in the source database, the same counts of values will exist in the destination database, except they are shuffled appear in a different order.
Note that the shuffle functionality works batch-wise in batches, so each batch generation according to the Generation Batch Size batch is shuffled independently. according to the set Generation Batch Size (the default value is 100k).
Note that NULL values are also considered a distinct value, and will be shuffled like any other value.
When enabled, select the correct Locale, as based on the data in your text column, to ensure Syntho uses the appropriate language models to identify and obfuscate PII in your text column.
After enabling this options and setting the right locale, any identified PII entities are obfuscated and then copied to the destination table.
Syntho automatically replaces any infrequent categorical values in a column with a user-defined value, ensuring that sensitive data does not appear in the synthetic output.
Rare category protection threshold: Column values that appear with a frequency at or below this threshold are automatically replaced to prevent data leakage.
Rare category replacement value: Values meeting the frequency threshold are substituted with this user-specified replacement value.
By default, the rare category protection threshold is set to 10, meaning any value that appears 10 times or fewer will be replaced. The default replacement value is an asterisk (*), so all values at or below the threshold are replaced with (*).
Duplicate
Categorical, Continuous, Discrete, Datetime, Bytes, Bool, UUID, JSON, XML, Geo, Sets, Unknown
Caution: Using the same underlying modelling techniques as the , the Detect and obfuscate PII feature can take very long to run.
Enable the toggle Detect and obfuscate PII to use Syntho's to detect and obfuscate PII entities in columns containing free text information.
To ensure accurate ordering, please see .
