Is it possible to copy a file from Sharepoint to s3? Preferably coding it from the AWS side.
I've searched but not seeing much out there. There's a similar title but this doesn't answer the question:
upload files from sharepoint online to aws s3 bucket
It is possible for sure. SharePoint online has a rest API I use a python package called office365, it implements a SharePoint client to handle most of the daily operations you will need.
The repo is: https://github.com/O365/python-o365
Some tips about I have struggled for the first time:
The ClientContext object requires the base site URL for the SharePoint library you want to authenticate, library doc:
https://mysharepoint.mydomain.com/sites/mysite/shareddocuments/
The URL you must pass to the Client context will be: https://mysharepoint.mydomain.com/sites/mysite
The method UserCredential requires your user in the following format: user#mydomain
Related
It seems like the way to go is a class Upload in package #aws-sdk/lib-storage. It's a class that used to be called ManagedUpload and which supports multipart uploads. However when trying to import #aws-sdk/lib-storage, I get the error below, so apparently the package only works on Node, not the browser.
For the browser, what is the best alternative for someone who wants to implement multipart uploads to S3?
I wish to use the aws sdk cpp async api's for s3 in my application. However I am not able to find documentation for the same. I have been through https://github.com/awsdocs/aws-doc-sdk-examples/tree/master/cpp/example_code/s3 but there are no examples which include async api's.
For example I am trying to use the PutObjectAsync api. According the api reference guide given here https://sdk.amazonaws.com/cpp/api/LATEST/class_aws_1_1_s3_1_1_s3_client.html#aee8d39c350c5bb66a8d1edcc18df2b78 you need to form the PutObjectRequest, PutObjectResponseReceivedHandler and AsyncCallerContext.
Here I didn't understood how to form the PutObjectResponseReceivedHandler and AsyncCallerContext. Can someone please guide me through it.
The AWS Code Sample Catalog on GitHub now includes a C++ example that demonstrates how to upload a file to Amazon S3 asynchronously.
The source code can be viewed at https://github.com/awsdocs/aws-doc-sdk-examples/blob/master/cpp/example_code/s3/put_object_async.cpp
On my php server I have a list of urls that point to large files (not locally stored). These files can be hundreds of Mb so I'm looking for the best way to add them to GCS without first saving them to my server. Is this possible or will I have to save each one then upload it to GCS?
Edit
I forgot to mention the list of urls that I have is managed programatically and changes often so any solution needs to be able to be implemented without manual interaction.
If your urls are publicly reachable, you may be interested in the Transfer Service provided by Google Cloud Storage. You can provide a TSV file with a list of urls from where your files will be uploaded to the bucket of your choice. You can have a look at the service doc here for further details.
I want to know if it is possible to download a portion of a public AWS data set and how to do it.
Specifically, I want to download a part from Common Crawl Corpus to do local tests.
It looks like you can. If you point your browser to the public URL provided by Amazon, you can see links for the whole sets and also for subsets.
You can download it using your browser or any S3 client tools or libraries.
I have sharepoint document library which contains infopath files, however I want to write a c# console program to read a field of infopath file, from a client machine, via sharepoint web service.
how do i do that? I am not allowed to deploy any code to sharepoint server.
Couple steps involved.
1. Get the infopath file from the Sharepoint server using webservices. You most likely will use GetListItems to find the name/URL of the file and then you can use a webclient class to stream the file.
2. Once you have the file locally (in memory) you can read any infopath using the standard XMLReader class methods.
Shouldn't be terribly complicated but does involve a few different technologies (web services, web client, XML).
One other option would be to promote the field from the form into the SharePoint library (providing it is not a field in a repeating section or a rich text field) and then use the lists web service (http://mysite/_vti_bin/lists.asmx) to find your record and read the promited fields value from the returned results in web services.
Here is a link that will hopefully help you wish the lists.asmx web service (if you need it): http://msdn.microsoft.com/en-us/library/lists.lists.getlistitems(v=office.12).aspx
Hope this helps