Amazon Simple Storage Service (S3)

Source and Destination Databases

Destination only

This connector can only be used as a destination for writing your generated data.

• Supported File Types: Parquet
• Supported Partitioning: Horizontal partitioning based on the batch size. Each batch is written to a separate file.

Before you begin

Before you begin, gather this connection information:

• Get the connection details to connect with your S3 bucket

Output format

Syntho's S3 output connector writes all generated data to Parquet files as follows:

• Each generated table will be written to a Parquet file in the following format: {schema-name}-{table_name}_part_{part_number}.parquet
• The number of rows in a single Parquet file (part) is defined by the batch size. All Parquet parts of a single table are stored in their own directory.
• Each folder name will use the following format:

  {schema_name}.{table_name}

Connect and set up the workspace

Launch Syntho and select Connect to a database, or under Create workspace > Destination Database, select S3. For a complete list of data connections, select More under From database. Then do the following:

1. Enter the bucket name.
2. Enter the region name.
3. Enter the port number.
4. Enter the AWS access key id.
5. Enter the AWS secret access key.
6. Enter the prefix. If Syntho can't make the connection, verify that your credentials are correct. If you still can't connect, your computer is having trouble locating the server. Contact your network administrator or database administrator.

Limitations & considerations

Contact your Syntho contact person to discuss possible limitations regarding this connector.