How can I transfer data (Ec2, EBS volumes, RDS) from an AISPL account to AWS US account. Can I share a AMI or EBS snapshot between AISPL and AWS US account?
Related
I found that an S3 bucket can send it's own access logs to another SE bucket.
This is possible for Classic/Application/Network Load Balancers as well.
Are there any other AWS services that can use SE bucket as a log sink?
Yes, through Amazon CloudWatch Logs, which can take logs from a bunch of AWS services and then export the data to S3.
At the moment, the list is:
Amazon API Gateway
Amazon Aurora MySQL
Amazon Chime
AWS CloudHSM
AWS CloudTrail (which in turn can watch lots of services)
AWS CodeBuild
Amazon Cognito
Amazon Connect
AWS DataSync
AWS Elastic Beanstalk
Amazon Elastic Container Service
Amazon Elastic Kubernetes Service
Amazon ElastiCache for Redis
AWS Fargate
AWS Glue
AWS IoT
AWS Lambda
Amazon Macie
Amazon Managed Streaming for Apache Kafka
Amazon MQ
AWS Network Firewall
AWS OpsWorks
Amazon Relational Database Service
AWS Robomaker
Amazon Route 53
Amazon SageMaker
Amazon Simple Notification Service
AWS Step Functions
AWS Storage Gateway
Amazon VPC
CloudWatch can also take metrics from ~70 AWS services, or logs and metrics from your own EC2 instances and applications.
I think Workspaces uses EBS, but the volume itself is not listed under Volumes unlike EC2 instances. Are workspaces volumes managed by AWS itself?
I want to transfer data from an EC2 machine in one account to an S3 bucket on another account. Here, both the services are in the same region. Is the transfer of data happening over the internet as both are on different accounts?
There is no charge for Data Transfer between Amazon EC2 and Amazon S3 in the same region. This includes situations where information is being transferred between AWS Accounts.
From Amazon S3 Simple Storage Service Pricing - Amazon Web Services:
You pay for all bandwidth into and out of Amazon S3, except for ... Data transferred out to an Amazon Elastic Compute Cloud (Amazon EC2) instance, when the instance is in the same AWS Region as the S3 bucket (including to a different account in the same AWS region).
I know the wording is confusing, but basically traffic between EC2 and S3 in the same region is not charged.
Yes, the data transfer is happening over the internet if ec2 and s3 are in different regions ( irrespectivie of same account or different account ) .
But for ec2 and s3 in same region you can use VPC Endpoint specific to S3 to route the data internal to AWS .
For more clarity, use tcpdump to capture the packets specific to s3 or take a tcpdump on port 53 ( dns ) you should get an s3 endpoint URL for s3 which ec2 is using to access s3.like this :
12:05:40.479211 IP ip-10-80-0-2.eu-central-1.compute.internal.domain > ip-172-18-0-12.eu-central-1.compute.internal.34545: 21349 2/0/0 CNAME s3-r-w.eu-central-1.amazonaws.com., A 52.219.72.229 (124)
12:05:40.479213 IP ip-10-80-0-2.eu-central-1.compute.internal.domain > ip-172-18-0-12.eu-central-1.compute.internal.34545: 21349 2/0/0 CNAME s3-r-w.eu-central-1.amazonaws.com., A 52.219.72
You can know if it's resolving to Public IP or Private IP
I have a Multi-AZ ECS cluster with EC2 instances and an Aurora RDS cluster with cross-az read replicas. I use the cluster URL for selecting data in RDS.
Does the cluster automatically forward my request to the RDS in the same AZ, if it is possible? If not, how can I prevent unnecessary data transfer between availability zones? (I want to use RDS in different AZ, if and only if the RDS in the same AZ is out of service)
According to AWS documentation:
"Data transferred between Amazon RDS and Amazon EC2 Instances in the same Availability Zone is free."
"Amazon RDS DB Instances inside VPC: For data transferred between an Amazon EC2 instance and Amazon RDS DB Instance in different Availability Zones of the same Region, Amazon EC2 Regional Data Transfer charges apply on both sides of transfer."
Currently I am going through the Storage for Amazon RDS documentation.
This document mentions that - Most of Amazon RDS uses Amazon Elastic Block Store (Amazon EBS) volumes for database and log storage;
It also mentions that - Depending on the amount of storage requested, Amazon RDS automatically stripes across multiple Amazon EBS volumes to enhance IOPS performance.
So my question is: How EBS volumes are allocated to RDS instance?
Whether these are the EBS volumes that are created automatically and attached to RDS instance during it's launch? (EBS volumes on which user don't have control??)
Or these are the EBS volumes which are attached to EC2 instance/instances within the same VPC in which I would like to launch my RDS instance?
Thx!
You have no visibility into the EBS volumes used by your RDS instances. RDS is a managed service. You won't be able to see the EC2 instances or the EBS volumes or the S3 buckets used by your RDS databases.