Our new webautomation.io Amazon AWS S3 integration now allows you to file transfer your webautomation.io scraped data into your S3 bucket automatically
Amazon S3 or Amazon Simple Storage Service is a service offered by Amazon Web Services that provides object storage through a web service interface. It is most popular because you can use Amazon S3 to store and retrieve any amount of data at any time, from anywhere.
Please follow step by step guide below to learn how to use this integration
Pre-requisites
- An AWS account, signed into
- A webautomation.io account with at least 1 extractor set up
Step 1: Create an AWS S3 Bucket
- Search for S3, from list of services
Step2: Create AWS IAM Access
- Search for IAM from list of services
- Click on Users , then "add users
- Select programmatic access
- Set permissions boundary ( recommended to only allow access to S3)
- Once the user is created you will be presented the Access key ID and Secret key. You can download for full details.. Copy these are you will need to enter into webautomation.io
-
Step 3: Link to your webautomation.io account/extractor
- Click on the Amazon S3 integration option from your webautomation.io in-app https://webautomation.io/service/s3/list/
- Select the extractor which you would like to link to the S3 account and then enter the mandatory S3 details
- Once entered click the update S3 account. Next time you run this extractor the data will be automatically transfered over
Step 4: Run it
Run the extractor linked to the S3 account and once the session is completed the data will be transfered over to your S3 bucket