Conan failing to upload package when --all is specified - c++

I have a Jenkins/Conan build that has been working for a year. All of a sudden, it is failing to upload the binary package when "conan upload" is executed. However, it still uploads the recipe.
New output:
NetworkKernel/1.0.0#XXX/testing: Package 'cc8b57af37a13f1b22ee796d76b2fcf820a31cb8' created
conan upload NetworkKernel/1.0.0#XXX/testing -r=XXX--all --force --confirm --retry 20 --retry-wait 30
Uploading NetworkKernel/1.0.0#XXX/testing to remote 'XXX'
Uploading conanmanifest.txt
Uploading conanfile.py
Uploading conan_sources.tgz
Uploaded conan recipe 'NetworkKernel/1.0.0#XXX/testing' to 'XXX': https://example.com/artifactory/api/conan/XXX-CONAN
Old output:
Uploading NetworkKernel/1.1.0#XXX/testing to remote 'XXX'
Compressing recipe sources...
Uploading conanmanifest.txt
Uploading conanfile.py
Uploading conan_sources.tgz
Uploaded conan recipe 'NetworkKernel/1.1.0#XXX/testing' to 'xxx': https://example.com/artifactory/api/conan/XXX-CONAN
Uploading package 1/1: cc8b57af37a13f1b22ee796d76b2fcf820a31cb8
Compressing package...
Requesting upload permissions...
Requesting upload permissions...Done!
Uploading conanmanifest.txt
Uploading conaninfo.txt
Uploading conan_package.tgz
Windows OS
Artifactory version: 5.9.7
Conan version: 1.0.0
As you can see, it is only uploading the recipe even thought --all is specified (and the package is successfully created). I think someone messed with the build machine, but I can't figure out what has changed. Thanks for your help

Related

Build on Vercel with Prisma is not working recently (how to include schema.prisma file?)

I developed SvelteKit app with Prisma and am trying to deploy it on Vercel.
In package.json, configuration below should be set so that schema.prisma file located in root path is available when app is deployed.
"postbuild": "cp prisma/schema.prisma .vercel_build_output/functions/node/render/ && cp node_modules/#prisma/engines/*query* .vercel_build_output/functions/node/render/",
Problem is an error occurred during the build on Vercel, but that wasn't occurred before (~ May 2022).
I guess cause of the error is related to recent update of SvelteKit and found that directory of .vercel_build_output that is generated during the build is changed to the new .vercel recently. However, the new path structure for index.js (i.e. .vercel/output/functions/render.func/home/s/test/discord-bot-frontend/.svelte-kit/output/server/index.js) is so different from the previous (i.e. .vercel_build_output/functions/node/render/) that I cannot find right path for it.
Would you please let me know right setting for package.json?
Error message:
> discord-bot-frontend#0.0.1 postbuild
> cp prisma/schema.prisma .vercel_build_output/functions/node/render/ && cp node_modules/#prisma/engines/*query* .vercel_build_output/functions/node/render/
cp: cannot create regular file ‘.vercel_build_output/functions/node/render/’: No such file or directory
Error: Command "npm run vercel-build" exited with 1
I found that there is no need to modify .vercel_build_output now. In other words, the post build is not needed anymore.
It is probably because latest Vercel handles this point.

Deployment Failed with Error: Package deployment using ZIP Deploy failed

I am trying to deploy a django project in azure from GitHub repository but I am getting error during the deployment. I am getting this error:
Failed to deploy web package to App Service.
2022-01-02T15:32:52.2053869Z ##[error]Deployment Failed with Error: Package deployment using ZIP Deploy failed. Refer logs for more details.
How can I resolve it?
2022-01-02T15:07:42.4101966Z with:
2022-01-02T15:07:42.4102399Z app-name: stockprojection
2022-01-02T15:07:42.4102889Z slot-name: Production
2022-01-02T15:07:42.4115035Z publish-profile: ***
2022-01-02T15:07:42.4115476Z package: .
2022-01-02T15:07:42.4116058Z ##[endgroup]
2022-01-02T15:07:43.9633760Z Package deployment using ZIP Deploy initiated.
2022-01-02T15:32:51.1581899Z Updating submodules.
2022-01-02T15:32:51.1583435Z Preparing deployment for commit id 'f47d703f2a'.
2022-01-02T15:32:51.1584587Z Repository path is /tmp/zipdeploy/extracted
2022-01-02T15:32:51.1585520Z Running oryx build...
2022-01-02T15:32:52.1954843Z Command: oryx build /tmp/zipdeploy/extracted -o /home/site/wwwroot --platform python --platform-version 3.9 -i /tmp/8d9ce01a48e2911 --compress-destination-dir -p virtualenv_name=antenv --log-file /tmp/build-debug.log
2022-01-02T15:32:52.1957351Z Operation performed by Microsoft Oryx, https://github.com/Microsoft/Oryx
2022-01-02T15:32:52.1958337Z You can report issues at https://github.com/Microsoft/Oryx/issues
2022-01-02T15:32:52.1992563Z
2022-01-02T15:32:52.1993572Z Oryx Version: 0.2.20210826.1, Commit: f8651349d0c78259bb199593b526450568c2f94a, ReleaseTagName: 20210826.1
2022-01-02T15:32:52.1994721Z
2022-01-02T15:32:52.1995241Z Build Operation ID: |da22zDrMO/Q=.cac2beba_
2022-01-02T15:32:52.1996043Z Repository Commit : f47d703f2a594452a83ae4301b5d6ce8
2022-01-02T15:32:52.1996497Z
2022-01-02T15:32:52.1997051Z Detecting platforms...
2022-01-02T15:32:52.1997609Z Detected following platforms:
2022-01-02T15:32:52.1998100Z python: 3.9.7
2022-01-02T15:32:52.1999279Z Version '3.9.7' of platform 'python' is not installed. Generating script to install it...
2022-01-02T15:32:52.1999807Z
2022-01-02T15:32:52.2000549Z Using intermediate directory '/tmp/8d9ce01a48e2911'.
2022-01-02T15:32:52.2001012Z
2022-01-02T15:32:52.2001533Z Copying files to the intermediate directory...
2022-01-02T15:32:52.2002087Z Done in 0 sec(s).
2022-01-02T15:32:52.2002345Z
2022-01-02T15:32:52.2002782Z Source directory : /tmp/8d9ce01a48e2911
2022-01-02T15:32:52.2003367Z Destination directory: /home/site/wwwroot
2022-01-02T15:32:52.2003726Z
2022-01-02T15:32:52.2003938Z
2022-01-02T15:32:52.2004699Z Downloading and extracting 'python' version '3.9.7' to '/tmp/oryx/platforms/python/3.9.7'...
2022-01-02T15:32:52.2005361Z Downloaded in 1 sec(s).
2022-01-02T15:32:52.2005817Z Verifying checksum...
2022-01-02T15:32:52.2006290Z Extracting contents...
2022-01-02T15:32:52.2006715Z Done in 24 sec(s).
2022-01-02T15:32:52.2006959Z
2022-01-02T15:32:52.2007462Z Python Version: /tmp/oryx/platforms/python/3.9.7/bin/python3.9
2022-01-02T15:32:52.2008171Z Creating directory for command manifest file if it doesnot exist
2022-01-02T15:32:52.2008806Z Removing existing manifest file
2022-01-02T15:32:52.2009356Z Python Virtual Environment: antenv
2022-01-02T15:32:52.2009917Z Creating virtual environment...
2022-01-02T15:32:52.2010491Z Activating virtual environment...
2022-01-02T15:32:52.2011006Z Running pip install...
2022-01-02T15:32:52.2011541Z [15:08:42+0000] Collecting beautifulsoup4==4.10.0
2022-01-02T15:32:52.2012658Z [15:08:42+0000] Downloading beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
2022-01-02T15:32:52.2013461Z [15:08:43+0000] Collecting Django==3.2.7
2022-01-02T15:32:52.2014278Z [15:08:43+0000] Downloading Django-3.2.7-py3-none-any.whl (7.9 MB)
2022-01-02T15:32:52.2015027Z [15:08:45+0000] Collecting djangorestframework==3.13.0
2022-01-02T15:32:52.2016199Z [15:08:45+0000] Downloading djangorestframework-3.13.0-py3-none-any.whl (958 kB)
2022-01-02T15:32:52.2018261Z [15:08:46+0000] Collecting matplotlib==3.4.2
2022-01-02T15:32:52.2019288Z [15:08:48+0000] Downloading matplotlib-3.4.2-cp39-cp39-manylinux1_x86_64.whl (10.3 MB)
2022-01-02T15:32:52.2020051Z [15:08:49+0000] Collecting nltk==3.6.2
2022-01-02T15:32:52.2020817Z [15:08:49+0000] Downloading nltk-3.6.2-py3-none-any.whl (1.5 MB)
2022-01-02T15:32:52.2021432Z [15:08:50+0000] Collecting nsepy==0.8
2022-01-02T15:32:52.2022116Z [15:08:50+0000] Downloading nsepy-0.8.tar.gz (33 kB)
2022-01-02T15:32:52.2022924Z [15:08:53+0000] Collecting numpy==1.19.5
2022-01-02T15:32:52.2023827Z [15:08:54+0000] Downloading numpy-1.19.5-cp39-cp39-manylinux2010_x86_64.whl (14.9 MB)
2022-01-02T15:32:52.2024538Z [15:08:57+0000] Collecting pandas==1.3.1
2022-01-02T15:32:52.2025512Z [15:08:57+0000] Downloading pandas-1.3.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
2022-01-02T15:32:52.2026293Z [15:08:59+0000] Collecting requests==2.26.0
2022-01-02T15:32:52.2027195Z [15:08:59+0000] Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)
2022-01-02T15:32:52.2027944Z [15:09:01+0000] Collecting scikit_learn==1.0.1
2022-01-02T15:32:52.2028928Z [15:09:01+0000] Downloading scikit_learn-1.0.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (24.7 MB)
2022-01-02T15:32:52.2029713Z [15:09:07+0000] Collecting tensorflow==2.5.0
2022-01-02T15:32:52.2032336Z WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out. (read timeout=15)")': /packages/dc/0e/72070fe6d5774bfc6b73e857f1747ba99b95cb808c46b709ab7c9ec757eb/tensorflow-2.5.0-cp39-cp39-manylinux2010_x86_64.whl
2022-01-02T15:32:52.2034884Z [15:09:23+0000] Downloading tensorflow-2.5.0-cp39-cp39-manylinux2010_x86_64.whl (454.4 MB)
2022-01-02T15:32:52.2035989Z An unknown error has occurred. Check the diagnostic log for details.
2022-01-02T15:32:52.2040696Z ##[error]Failed to deploy web package to App Service.
2022-01-02T15:32:52.2053869Z ##[error]Deployment Failed with Error: Package deployment using ZIP Deploy failed. Refer logs for more details.
2022-01-02T15:32:52.2056058Z App Service Application URL: http://stockprojection.azurewebsites.net```

how to run a one-off task on cloudfoundry to upload data before starting Python app

Hi this is my first experience trying to deploy a Python app on cloud using CF. I am having issues deploying my app; I sincerely appreciate if anyone can help me or point me to the right direction to solve the issue.
The main problem is the app that I am trying to deploy is large size due to a lot of python dependencies. The size of my app directory is 200 Kb. The first error I observed was: Staging fails due to "Failed to upload payload for droplet" . I think the reason is when all Python dependencies are downloaded from requirements.txt file and finally the droplet is created its size is too large for upload. The droplet size=982. 3 Mb.
The first solution I tried was vendoring app where I created a vendor directory containing all python dependencies but the size of vendor directory was greater that 1Gb, which causes the upload size exceed 1Gb limit and leads to failure in uploading app files.
The second solution I am working on is to upload all installed Python libraries on an object store (in my case S3 bucket which is bounded to my app) and then download the dependencies folder called Pypackages to the app's root directory: /home/vcap/app, so I want to have /home/vcap/app/Pypackages exist before my app starts on the cloud. But I couldn't do it successfully yet. I have included a python script in my app directory which downloads files from S3 bucket successfully. (I have put the correct absolute path for download in downloadS3.py script ie, /home/vcap/app/Pypackages) I want to run this script using "python downloadS3.py" as a one-off task. First I tried the solution here : Can I have multiple commands run in a manifest.yml file?
and although I can see the status of the task is SUCCEED via '$cf tasks my-app-name' , /home/vcap/app/Pypackages does not exist.
I also tried to run one-off task as the steps below:
1-
$ cf push -c 'python downloadS3.py && sleep infinity' -i 1 --no-route
2-
$ cf push -c 'null'
I have printed the contents of /home/vcap/app on my app, ie when app is started and I enter the url in my browser (I don't know what is the right way to see the contents of root directory). Anyway, the problem is Pypackages are not downloaded to the correct root directory. I am not sure if I am running the one-off task in a wrong way or if there is a better solution to make my app work.
I appreciate any helps! (edited)
Diego Cells stage apps and upload droplet to blobstore via cloud controller, the max file can be uploaded is configurable at Ops Manager > TAS for VMs > Application Developer Control > Maximum File Upload Size (MB), default is 1024MB. Seems this is causing restriction, if you can get it increased with your admin help...
Tasks run in their own containers so possibly not an option. I think Python buildpack collects and install the packages before creating the droplet, so don't think copying packages directly to /app directory will be of much help.
If you have data files then you can use .profile file and do some scripting to copy them from S3 or server/NFS location into the /app directory. Something like
wget http://s3.location.com/data_files
cp data_files /home/vcap/app/
But if all these are packages and increasing the size is not feasible then you may need to look to break the app..

Fastlane deliver .ipa file to TestFlight from Expo build URL

I'm following this article to auto-deploy .ipa file after building with Expo: https://blog.expo.io/automating-standalone-expo-app-builds-and-deployments-with-fastlane-exp-and-exptool-9b2f5ad0a2cd
It's work, but I have to download .ipa file from Expo then upload it to TestFlight. This takes a long time for waiting while Expo already builds .ipa file and we just need to upload it to TestFlight.
Current script to deploy is:
// Download .ipa file from Expo build
curl -o app.ipa "$(expo url:ipa --non-interactive)"
// Upload this to TestFlight
fastlane deliver --verbose --ipa "app.ipa" --skip_screenshots --skip_metadata
I tried to replaced app.ipa by Expo build url (something like: https://exp-shell-app-assets.s3.us-west-1.amazonaws.com/ios/myusername/app-bfaf-ca19c79a9c0f-archive.ipa)
fastlane deliver --verbose --ipa "https://expo-url.ipa" --skip_screenshots --skip_metadata
It throws an error because fastlane deliver always add current directory before URL, the error is:
Error setting value 'https://exp-shell-app-assets.s3.us-west-1.amazonaws.com/ios/myusername/app-bfaf-ca19c79a9c0f-archive.ipa' for option 'ipa'
[!] Could not find ipa file at path '/Users/root/project/https://expo-url.ipa'
I tried fastlane pilot upload and got the same issue.
Thanks!
fastlane upload file in your pc , not file link...
if you want build standalone expo ... I recommend to turtle-cli see tutorial here ...
turtle-cli make server localhost to build source output file in /Users/xxx/expo-apps/ .. then you can copy file and using fastlane to upload file to App Store and Google play.

Uploaded a zip file of static website contents to S3 but website shows Error 404

I successfully deployed a package to S3 via Octopus but I get an error 404 instead of a website.
According to this article, the zip file should at least have the index.html.
The zip folder that was uploaded already contains the files created by the npm run build command.
Kindly advise. Thanks a lot!