Amazon S3

This guide contains information to set up a S3 Source in Vanus Connect.

Introduction

S3 is Amazon's cloud storage service that offers scalable and durable storage for various data types. It provides easy management and retrieval of data from anywhere with high availability and low latency.

Vanus Connect provides the Amazon S3 Source connector, which retrieves S3 events from a designated bucket and converts them into CloudEvents. With this connector, users can also set up an SQS queue to receive S3 event notifications. If a queue isn't specified, the connector will create one automatically.

Prerequisites

Before obtaining S3 events, you must have:

• An Amazon Web Services account.
• A Vanus Cloud Account.

Getting Started

Step 1: Create a new AWS user

1. Log in to the AWS Management Console using your root account credentials.

2. Navigate to the IAM service by searching for IAM① and click the IAM② service.

3. Click on the Users③ tab in the left navigation menu, and then click the Create user④ button.

4. Write your User name⑤ and click Next⑥.

5. Select Attach policies directly⑦, and click on Create policy⑧.

6. Click on Choose a service⑨ to open the dropdown menu.

7. Search⑩ for s3 and click on it⑪.

8. Search for the following policy: PutBucketNotification⑫, and tick the box⑬ to select it.

9. Click Add more permissions⑭.

10. Now search for SQS⑮ and click on it⑯.

11. Search⑰ for the following policies.

• ListQueues
• GetQueueUrl
• ReceiveMessage
• GetQueueAttributes
• CreateQueue
• SetQueueAttributes
• DeleteMessage

12. Press Next⑱ and proceed to the next page.

13. Name⑲ your policy.

14. Click Create policy⑳.

15. Return back to your previous TAB㉑.

16. Refresh㉒ the policy list, search㉓ for your custom policy, check the box㉔ next to it to add it to your account, and then click on Next㉕.

17. Review and press Create user㉖.

---

Step 2: Create an Access key and Secret access Key

1. Now click on the user① you just created.

2. Under Security credentials② scroll down the page to Access Keys, and Click Create access key③.

3. Select Command Line Interface (CLI)④, tick the Confirmation box⑤ and click Next⑥.

4. Click Create access key⑦.

5. Download your Access key and Secret access key by clicking the Download .csv file⑧ button, and then click Done⑨.

---

Step 3: Amazon S3 Connection Settings

1. Write a Name① for your connection in Vanus Connect.

2. Enter your Access Key② and Secret access Key③ in Vanus Connect.

3. Navigate to the Amazon S3 service.

note

At this point, you can either Create a new bucket or select an existing bucket.

4. Create a new bucket by clicking the Create bucket④ button.

5. Specify a Bucket name⑤ and select your desired AWS Region⑥.

6. Click on Create bucket⑦ to finish creating your bucket.

7. Once selected or created, click on the bucket name⑧.

8. Go to your bucket Properties⑨ and copy the ARN⑩.

9. Paste your Bucket ARN⑪ into vanus connect, Specify the kind of Events⑫ you want to receive from the list.

note

Under SQS config⑬, you can choose to create a new SQS by selecting region, or if you already have an SQS, provide the ARN.

10. Set your desired SQS Region⑭ and click Next⑮ to continue the configuration.

---

Learn more about Vanus and Vanus Connect in our documentation.