Amazon S3

This guide contains the required information to set up S3 Sink in Vanus Connect.

Introduction

Amazon S3 (Simple Storage Service) is a highly scalable and durable object storage service provided by Amazon Web Services (AWS). It is designed to store and retrieve any amount of data from anywhere on the internet, making it ideal for a wide range of use cases such as backup and restore, disaster recovery, data archiving, content delivery, and big data analytics.

With Amazon S3 Sink in Vanus Connect, you can easily forward data or events to your S3 bucket automatically. The S3 Sink connector lets you save the events you need to any bucket of your choosing.

Prerequisites

Before forwarding events to an S3 bucket, you must have:

• A Vanus Cloud account.
• An Amazon Web Services account.

Getting Started

Step 1: Create an AWS User

1. Log in to the AWS Management Console using your root account credentials.

2. Navigate to the IAM service by searching for IAM① and clicking the IAM② service.

3. Click on the Users tab③ in the left navigation menu, and then click the Create user④ button.

4. Write your User name⑤ and click Next⑥.

5. Select Attach policies directly⑦, and click on Create policy⑧.

6. Search for s3⑨ and select s3⑩.

7. Search⑪ and select the required Actions.

• PutObject⑫
• GetObject
• GetObjectVersion
• DeleteObject
• DeleteObjectVersion

8. Select Any⑬ and click Next⑭ to proceed to the next page.

9. Specify a Policy name⑮.

10. Click Create policy⑯.

11. Return to your previous TAB.

12. Refresh⑰ the policy list, search⑱ for your custom policy, select your created policy⑲, and click Next⑳.

13. Review and click Create user㉑.

---

Step 2: Get your Access key and Secret access key

1. Now click on the User① you just created.

2. Under Security credentials②, scroll down the page to Access Keys, and Click Create access key③.

3. Select Command line interface (CLI)④, tick the confirmation box⑤ and click Next⑥.

4. Click Create access key⑦.

5. Download your Access key and Secret access key by clicking the Download .csv file⑧ button, and then click Done⑨.

---

Step 3: Amazon S3 Connection Settings

To set up S3 Sink in Vanus Connect:

1. Enter your Access Key① and Secret access Key② in Vanus Connect from the previous steps.

2. Now let's go back to Amazon Web Services under the Amazon S3 service.

3. At this point, you can either create a new bucket or select an existing bucket.

4. Create a new bucket by clicking the Create bucket③ button.

5. Specify a Bucket name④ and select your desired AWS Region⑤.

6. Click on Create bucket⑥ to finish creating your bucket.

7. After selecting or creating a bucket, remember to take note of your bucket name⑦ and the AWS Region⑧.

8. In Vanus Connect, choose your Region⑨ and enter your Bucket⑩ name, select the upload interval time⑪ (HOURLY or DAILY).

---

Step 4: Personalize Event Structure

note

This is a general instruction on how to personalize your event structure. You can structure your events to suit your specific requirements and create connections for different scenarios.

1. Click on Display sample events① for reference and click on Add More② to add events.

2. Input key③ and search for the corresponding value④ for the event you want.

3. You can fill in as many key-value pairs⑤ as you wish to receive.

4. Click Submit⑥ to finish the configuration process.

---

Required Data Format

The event data must be in JSON format with the following way:

{
  "data": {
    "myData": "simulation event data"
  }
}