Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
I would like to edit (add a column to) a CSV file stored in S3. I managed to do this by downloading the file, editing it with bash command and re-uploading it to S3.
But is there a better way to do this?
Is there a better way to do this ?
No. S3 is an object storage solution, not a file system. To modify objects, you download them, modify locally and re-upload.
Having said that, you can use third party tools, such as s3fs-fuse which can provide "file-like" interface for you to S3, but the underlying S3 object modification does not change.
If you do it often, you can modify S3 object from EC2 instances instead of downloading them to your local workstation outside of AWS.
Related
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 1 year ago.
Improve this question
I am using HDFS to store the data files. Want to know is there a way to use Azure storage to be used in the place of HDFS? If so how.
I am using Spark and Python.
Post an answer to end this question. As #Joel Cochran comments, you can use Azure Data Lake Gen2 which is fully HDFS compatible. You can refer to https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction to start it.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 2 years ago.
Improve this question
I am building a game using Unity and I want to track how well an individual does over a period of time. So I want to save their time, level, high score, etc. I am writing the scores to either a .txt file or .json file at the end of the game. The game will be deployed to Android OS (maybe IOs). I want the file to be sent off before the game returns to the home menu.
I wanted to know what is the better option for collecting the game data. Amazon RDS or S3 Bucket?
If it's a Text File use S3, it is great.
If you have JSON values, Use DynamoDb.
AWS Dynamodb
If your JSON object is less than 4KB, DynamoDB is significantly faster than S3 for individual operations.Refer to this Link.
But yes, No RDS if you have only JSON. NoSQL is great. [Dynamodb]
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 2 years ago.
Improve this question
I have one EC2 p3.large instance where I have installed several libraries, I want to make an exact replica of this instance as a backup. I need that this clone includes all the installed libraries, in that sense, something similar to a what a docker container does.
I have tried just to clone the instance as shown here:
https://docs.bitnami.com/aws/faq/administration/clone-server/
But this does not kept the installed libraries and files from the original instance to the new one.
You can make an AMI of the current instance and use it for back up anytime.
Related docs here
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 4 years ago.
Improve this question
.tgz compressed file uploaded to GCS.
Can I file decompress from the GCS?
No, not in general.
You could upload it as a .tar file with http content-encoding gzip (stored on metadata as well), and then the compression can be removed on the fly, depending on the client request. Though note that this has implications for range requests, among other things (full documentation here). Either way, GCS can't unpack the tar archive.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I want to create an application that needs to store xml and jpg files. Do you know any service on the internet that allows me to store files(jpg most important) and retrieve the files from the service when I need them?
I'm looking for something like flickr but with the option of manipulating files trough webservices.
You could maybe use Amazon S3: http://aws.amazon.com/s3/
You can use their API to manipulate your files from different environments:
Ruby on rails: http://aws.amazon.com/articles/8621639827664165
.Net http://aws.amazon.com/articles/3051
Etc.