AWS S3

Amazon Simple Storage Service (Amazon S3) is an AWS object storage service used to store and retrieve data at scale. For more information on Amazon S3, see the official AWS documentation here.

Integration Method: API

Tables: Cloud Resource Inventory Info (5023)

This integration supports the following events.

This integration supports the following versions.

Note:

AWS S3 is a continuously updated service. As for this document preparation, the latest release was in March 27, 2019. More information can be found here.

Prerequisites

• To Configure AWS S3, refer here.

• Refer to this common procedure on how to create an IAM user, configure the AWS Access Key and AWS Secret Key, attach an IAM policy with required permissions.

• The user should have access to the DataBee console.

Configuration Overview

1. Generate an AWS Access Key & Secret Key with the required IAM policies

2. Add the AWS S3 in the DataBee console with the below parameters.

   DataBee Parameter	AWS S3 Parameter
   Access Key	AWS Access Key
   Secret Key	AWS Secret Key
   AWS Region	AWS Region
   Service Name	s3

AWS S3 Configuration

1. Start by creating a IAM user with the API credentials. This common step is documented at AWS Data Sources: Users, Credentials and Permissions.

2. Once the IAM user has been created, Refer this document Getting started with Amazon S3 for further steps.

3. Ensure AWS Access Key is attached to an IAM policy with following Actions allowed on the S3 resource. The minimum permissions required would be AmazonS3ReadOnlyAccess. Refer here more info on the policy. 

DataBee Configuration

1. Login to the DataBee UI, navigate to Data > Data Feeds and click the Add New Data Feed button.
    

2. Search for the AWS S3 and click it as shown below.
    

3. Click on the API Ingest option for collection method.
    

4. Enter feed contact information and scroll down.
    

5. In the configuration page, confirm the following:

   • API Base URL: This is the base URL that DataBee will interact with.

   • Authorization Method: AWS Signature

   • Access Key: Paste the AWS Client Access Key

   • Secret Key: Paste the AWS Client Secret Key

   • AWS Region: Type the AWS region

   • Session Token: Can be left empty

   • Service Name: s3

   • Event Types: Preselected for all the event types that integration pulls.
      

6. Click on Test Connection to verify credentials are valid and connection is successful.
    

7. Click Submit.

Note:

If the test connection fails, the Submit button will remain disabled. Onboarding cannot proceed until the issue is resolved and the test connection is successful.

Troubleshooting Tips

• Ensure the Access Key, Secret Key, Region are pasted correctly. Since you cannot view the Secret Key after the 1^st time, re-create the AWS Access Key & AWS Secret Key, paste it on a text editor to ensure no spaces or unexpected characters are included and reconfigure the DataBee feed

• Ensure the AWS S3 scopes/permissions are correct.