Amazon S3

Amazon S3 as a Data Source

You will need permission to update your bucket's Access Policy and Event notification settings.

Amazon Web Services (AWS) makes sharing data through their simple storage service (S3) buckets easy. You will be setting up DataBee to read from your S3 Bucket.

Step 1: Configure Data Source

Enter data in the fields below.

• Data Source Name: a user-friendly name for the data source.

• Owner Name: enter a point of contact for the data source.

• Owner E-mail: email address for the contact.

• S3 Bucket Name: name of the bucket to ingest data from.

• AWS Region: AWS region of the bucket.

• Delete objects in the S3 bucket after read:  if this field is checked, then the file will be deleted after ingesting the data.

• Compression: indicates what type of decompression (if any) should be applied to the objects before reading.

  

• Content Type: indicates how to parse the uncompressed content.

  

• KMS Encryption Key: provide an optional KMS encryption key if the S3 bucket is encrypted.

  

Step 2: Apply IAM and KMS policy

• Click on the copy icon at the top right side, to save the IAM and KMS policy that you want to apply to your AWS S3 bucket.

• Apply the recommended bucket policy to your source bucket, as described in the AWS documentation link provided at the bottom of the page.

Step 3: Setup S3 Notification

• Configure your source bucket to emit object-create notifications to the Databee SQS queue, as described in the AWS Documentation link provided at the bottom of the page.