Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I would like to connect a Hive/Preso query engine within AWS to Amazon QuickSight (SPICE) to query the data. Usually I would use JDBC (https://prestodb.io/docs/current/installation/jdbc.html) for this.
Is this already possible? Or is there another way to do set up this connection?
not possible currently with QuickSight. See: https://quicksight.aws/
From the link:
"Choose your data source
You can upload CSV or Excel files; ingest data from AWS data sources such as Amazon Redshift, Amazon RDS, Amazon Aurora, Amazon Athena, and Amazon S3; connect to databases like SQL Server, MySQL, and PostgreSQL, in the cloud or on-premises; or connect to SaaS applications like Salesforce. Future releases will let you ingest data from Amazon EMR, Amazon DynamoDB, and Amazon Kinesis as well as other cloud applications."
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 2 years ago.
Improve this question
Can somebody please recommend some sources on how best to approach refactoring a legacy AWS infrastructure? That is, how to reduce downtime, optimally migrate data stores (such as DynamoDB or S3), etc. Thanks in advance!
There are a number of approaches you can take to do this.
AWS have a lot of great resources on "migration", as an initial thought take a look at the 6 Strategies for Migrating Applications to the Cloud. Whilst you're already in the AWS Cloud it is a great time to evaluate whether you have anything you can replace or is no longer needed.
There are a number of services that assist with migration, for migrating data stores take a look at the below 2 services which might help to migrate most of your data needs:
Database Migration Service
Data Pipeline
Other services such as S3 you would need to migrate to another S3 bucket, as buckets are uniquely named. If you want to keep the name you will need to delete the origin bucket first. If it is being served publicly try using a CloudFront distribution and then switching the origin to the new S3 bucket afterwards.
For architecting your new infrastructure take a look at the AWS Well-Architected Framework.
There are a number of migration whitepapers that AWS has also produced, some are specific to particular technologies and some are more general.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 2 years ago.
Improve this question
I'll be working on a project to improve the security of a client's aws infrastructure soon. While I know the basics (cleared solutions architect associate) I'm not great at all things aws security.
It would be great if you kind folks directed me to some good resources that I can refer to that would help create a sound plan to evaluate the client's cloud security and improve their security posture on aws.
Something like a checklist for different services. Like for example enabling log validation on your cloud trail logs for instance.
Any help is highly appreciated.
Much thanks.
Some places to visit:
Cloud Security – Amazon Web Services (AWS)
AWS Whitepapers & Guides
Amazon Web Services: Overview of Security Processes
Whitepaper | AWS Security Blog
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 3 years ago.
Improve this question
I am doing some research where I need to find the corresponding tool for archiving. So, what will be the equivalent of amazon glacier in the Azure environment
The Azure equivalent service to AWS S3 is Azure Storage. S3 defines several storage classes, Glacier is one of them.
Azure Storage has the concepts of different access tiers. I think the Archive tier is the closest match to S3 Glacier. Another option would be the cool tier. Which one to choose depends on the frequency the data is accessed.
Equivalent service is the Azure Storage. You can always explore from the site.
AWS to Azure services comparison
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
When we realize the data lake with GCP Cloud storage, and data processing with Cloud services such as Dataproc, Dataflow, how can we generated data lineage report in GCP?
Google Cloud Platform doesn't have serverless data lineage offering.
Instead, you may want to install Apache Atlas on Google Cloud Dataproc and use it for data lineage.
Google Cloud Data Fusion supports lineage in the Enterprise edition. You can use DF to build and orchestrate pipelines and use Dataproc and Dataflow as the capacity for running them. Introduction to CDF lineage can be found in the documentation here: https://cloud.google.com/data-fusion/docs/tutorials/lineage
If you otherwise do not use CDF capabilities, it is a bit overkill for just lineage. Lineage capability in Google Cloud Data Catalog would be optimal at least in many of my use-cases. Unfortunately currently CDC does not support lineage. I hope it is on the product roadmap and it would support lineage in the future.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
Ive been delving into the world of AWS and, with very little server management experience under my belt, I'm quickly getting lost!
I'm looking at creating a system that uses Route 53, Elastic Load Balancing, EC2, RDS, S3 (possibly with CloudFront as well) so I can host a user generated content website that also streams video.
So Ive been looking at the following books:
Host Your Web Site On The Cloud: Amazon Web Services Made Easy
Programming Amazon Web Services: S3, EC2, SQS, FPS, and SimpleDB
Programming Amazon EC2: Run Applications on Amazon's Infrastructure with EC2, S3, SQS, SimpleDB, and Other Services
If I had to go for one of these what would you recommend?
Most importantly are there any resources you can recommend for a newbie like myself to quickly learn and understand the nuances to AWS?
TIA
Although all of those resources are good, the best way to dive into using AWS is in my experience CloudFormation. With CloudFormation you are able to script most if not all of your AWS resources in a single json script. By writing your cloudformation scripts and looking through the documentation and sample scripts, you will start to get aquatinted with how all of the AWS toolsets work.
Most importantly are there any resources you can reconmend for a
newbie like myself to quickly learn and understand the nuances to AWS?
As mentioned above, CloudFormation
However to make sure I answer your question:
If I had to go for one of these what would you recommend?
I have read all 3 resources listed and I found Programming EC2 to be the most useful in understanding the AWS toolset