Curl command to copy a .sh file from AWS S3 location - amazon-web-services

Question

What is curl command(in a .config file) to copy a .sh file from AWS S3 bucket.
To copy fluent installer file from a S3 location and install in the EC2 instance
i Need to replace below command to
curl -L https://toolbelt.treasuredata.com/sh/install-amazon1-td-agent3.sh
copy from S3 location

Answer 1

I am assuming you mean a .config file that would be deployed with something like Elastic Beanstalk.
Firstly, I would highly recommend that you turn off the bucket's public availability if it is sensitive data.
Secondly, for this process, you should create a new IAM Policy (or a new Role), with access to the specific file in the Bucket you want to copy. Again, I am assuming Elastic Beanstalk for this answer.
Elastic Beanstalk environments spin up with a default Role named:"aws-elasticbeanstalk-ec2-role".
Here is an example Policy that you can create, and then attach to the Role:
{
"Version": "2012-10-17",
"Statement": [
{
"Action": ["s3:GetObject"],
"Effect": "Allow",
"Resource": [
"arn:aws:s3:::your-bucket-name/your-file.txt"
]
}
]
}
The .config file contents should then be as follows:
Resources:
AWSEBAutoScalingGroup:
Metadata:
AWS::CloudFormation::Authentication:
S3Auth:
type: "s3"
buckets: ["your-bucket-name"]
roleName: "aws-elasticbeanstalk-ec2-role"
files:
"/path/to/your-file.txt" :
mode: "000644"
owner: root
group: root
authentication: "S3Auth"
source: https://s3.REGION.amazonaws.com/your-bucket-name/your-file.txt
Replace:
REGION with your Bucket's region,
your-bucket-name with the Bucket's name,
your-file.txt with your file's name.
What this does
.config files are run before initialisation, and therefore allow you to do things before your code is run.
The code here creates a new file on the instance that it's deployed to, and copies the contents from the target in the S3 Bucket.
This file therefore exists before your own code is run, and you can safely use it at runtime.