GCP Load balancing Quota 'BACKEND_SERVICES' exceeded. Limit: 9.0 globally - google-cloud-platform

Background 1
In my account, the limited of Compute Engine API Backend services is increased to 75.
Background 2
I only have 9 Back-end service in Load balancing
Question
When I try to create a new Load Balancer, I receive below message:
Quota 'BACKEND_SERVICES' exceeded. Limit: 9.0 globally.
Suppose I should have enough quota for creating new backend service.....
Except removing other backend service, any suggestion for fixing this issue?
Thank you in advance!

Sometimes when a quota increase is approved, the deployment of that quota increase does not happen. I have experienced this several times.
My recommendation is to request a higher quota increase and explain the details about the previous quota increase being approved but not being deployed.

As John mentioned, it’s recommended to request a higher quota for backend services, also I share with you the backend services quotas that includes all backend services (INTERNAL, INTERNAL_MANAGED, INTERNAL_SELF_MANAGED, and EXTERNAL) in your project.

Related

API going into 502 Gateway timeout on AWS EKS when high load

I've currently deployed a REST api onto a EKS cluster with ExternalDNS, HPA, VPA, Cluster Autoscaler etc.. and I am facing a big issue regarding load.
I did a few load tests by swarming the api with requests, the problem is that:
the api seems extremely slow to respond (i have the same api deployed on another platform and performs significantly better
After a few requests, they all start to return 502 timeout.
I know for a fact it is not a problem of CPU or memory usage since the pods have 1vCPU and 1 Gb of memory and they don't use not even 20% of it.
In grafana i see the kube-proxy receiving those requests and some get the needed response, but the others fail.
What could the problem be? Any help/advice is much appreciated

Creating new GCP serverless vpc access connection, Error: Insufficient CPU quota in region

I'm trying to create GCP serverless vpc access connection for my cloud functions.
The error message is at below
So i checked quota of my project. and my quota is at below
At first, I didn't have any VM instances so there was no cpu usage.
After, I create new VM instance, 8 quotas of CPUs are created. Still, it makes same error.
Do i need to use other type of cpu for VPC connection?
please share you knowledge. thank you.
The error is quite specific and the root cause is the Quota of CPU. There are two possible reasons for this issue and two possible solutions.
First possible issue is the connectors being created using the gcloud command exceeded the CPU quota of your project. The second is there may be existing CPU resource hidden on your project that needs to be removed.
First solution is to change the Gcloud command you are using with lower --max-instances as additional parameter to lower the number of instance being created.
Second possible solution is QIR (Quota Increase Request), Requesting a quota increase is free of charge. It will only cost more if you uses more resource from your request. For detailed instructions on how to increase quota from the Google Cloud Console, see Requesting a higher quota limit.
You can learn more about CPU Quota's here.

GCP cannot create Managed Notebook on Vertex AI

Using a GCP account that started as free, but does have billing enabled, I can't create a managed notebook and get the following popup error:
Quota exceeded for quota metric 'Create Runtime API requests' and limit 'Create Runtime API requests per minute' of service 'notebooks.googleapis.com' for consumer 'project_number:....'
Navigating to Quotas --> Notebook API --> Create Runtime API requests per minute
Edit Quota: Create Runtime API requests per minute
Current limit: 0
Enter a new quota limit between 0 and 0.
0 doesn't work..
Is there something that I can do, or should have done already to increase this quota?
TIA for any help.
Managed notebooks is still pre-GA and is currently unavailable to the projects with insufficient service usage history.
You can wait for the GA of the service or use a project with more service usage.

Not able to increase Quota for Compute Engine API in GCP

I have been trying to increase Quota for Google Cloud Platform(GCP) Compute Engine API for a Location and it is not allowing me to Edit or Even select the location.
I have tried the same thing before few months back and it was properly working then. I just created a new project and tried the same thing.
I do have the Owner Permission assigned to me.
After concluding that you are in Free Tier, that is part of constraints.
Your free trial credit applies to all Google Cloud resources, with the following exceptions:
You can't have more than 8 cores (or virtual CPUs) running at the same time.
You can't add GPUs to your VM instances.
You can't request a quota increase. For an overview of Compute Engine quotas, see Resource quotas.
You can't create VM instances that are based on Windows Server images.
You must upgrade your account to perform any of the actions in the preceding list.
Upgrading to a paid account:
https://cloud.google.com/free/docs/gcp-free-tier#how-to-upgrade
Free Tier conditions:
https://cloud.google.com/free/docs/gcp-free-tier
Update: To be able to increase Quotas or Submit Quota Increase, you need to:
For New Project need to wait for 48hrs
You need to have Billing Enabled (Enable it by going into top-left gift icon and following along to Enable Billing in GCP)

Autoscaling: Unable to reach resize target for the worker pool in zone us-central1-f

I am running a pipeline using the Apache Beam model in Google Cloud Dataflow but I am unable to scale it up from 8 workers, even though the maximum number of workers is 32.
When I try to run the same pipeline setting the number of workers to 32, it gives me the following warnings:
Autoscaling: Startup of the worker pool in zone us-central1-f reached 30 workers, but the goal was 32 workers. The service will retry. QUOTA_EXCEEDED: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 4096.0
Autoscaling: Unable to reach resize target in zone us-central1-f. QUOTA_EXCEEDED: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 4096.0
But still doesn't pass 8 workers. Is there any particular reasons why a pipeline won't use more than 8 workers?
The problem was quota limits. Google Dataflow uses behind the scenes VMs of Google Compute Engine and their quotas apply. The specific limitation of 8 was being caused by the In use external IP adresses quota limitation. Others quotas were also violated when I tried to scale to 32, like the Disk space. So if anyone is having the same problem I suggest going to IAM Admin > Quotas on the console while the pipeline is running to check which quotas your pipeline may violate.
Also, the logs are different if you run using a deployed template or use the Eclipse plugin to run in debug mode. The later will give much more details than the first.
Visit https://console.cloud.google.com/iam-admin/quotas
Use the filter menu that says Quota type
You can tell by the color of the Current Usage column that API limit has reached limit.
Click Edit Quotas for the API that has exceeded usage and request for new limit. This will take from few hours to day.
Dataflow will use whatever number of workers you can get. In your case, it will reach 30 workers and will use them. It will however retry constantly to reach 32, as quota could be given back by other workflows.