Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 4 years ago.
Improve this question
.tgz compressed file uploaded to GCS.
Can I file decompress from the GCS?
No, not in general.
You could upload it as a .tar file with http content-encoding gzip (stored on metadata as well), and then the compression can be removed on the fly, depending on the client request. Though note that this has implications for range requests, among other things (full documentation here). Either way, GCS can't unpack the tar archive.
Related
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 1 year ago.
Improve this question
I am using HDFS to store the data files. Want to know is there a way to use Azure storage to be used in the place of HDFS? If so how.
I am using Spark and Python.
Post an answer to end this question. As #Joel Cochran comments, you can use Azure Data Lake Gen2 which is fully HDFS compatible. You can refer to https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction to start it.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
I would like to edit (add a column to) a CSV file stored in S3. I managed to do this by downloading the file, editing it with bash command and re-uploading it to S3.
But is there a better way to do this?
Is there a better way to do this ?
No. S3 is an object storage solution, not a file system. To modify objects, you download them, modify locally and re-upload.
Having said that, you can use third party tools, such as s3fs-fuse which can provide "file-like" interface for you to S3, but the underlying S3 object modification does not change.
If you do it often, you can modify S3 object from EC2 instances instead of downloading them to your local workstation outside of AWS.
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 5 years ago.
Improve this question
IFC files can be quite large (10Mb++). ZIP of IFC is reducing the file’s size 10x+. Such reduction in size improves dramatically performance of upload / download operations from / to BIM360 / A360 projects. BIM360 Docs allows to upload ZIP of related files. However, when I manually trying to upload ZIP of a single IFC file (also tried with single DWG in ZIP), the upload process fails with “Extract failed” message. Is extract of single files from ZIP compressed archive supported by BIM360 Docs?
Tried with a DWF compressed as a .ZIP. It DOESN'T work for files on BIM 360 Docs (uploaded via API and translated via POST job), but it does work for Buckets (2-legged).
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 8 years ago.
Improve this question
I need to refirect on another object on S3 when noSuchKeyError (object not found).
How can I do this?
Thanks
You have provided very little information so I don't know if this advise is useful or not. However, if you configure your S3 bucket for website hosting, it is possible to define custom error pages that map to particular HTTP error codes, as explained here.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I want to create an application that needs to store xml and jpg files. Do you know any service on the internet that allows me to store files(jpg most important) and retrieve the files from the service when I need them?
I'm looking for something like flickr but with the option of manipulating files trough webservices.
You could maybe use Amazon S3: http://aws.amazon.com/s3/
You can use their API to manipulate your files from different environments:
Ruby on rails: http://aws.amazon.com/articles/8621639827664165
.Net http://aws.amazon.com/articles/3051
Etc.