Google kubernetes engine node-pool problem - google-cloud-platform

When i try to create a node-pool using n2 and e2 machines in google kubernetes engine it shows this error
Creation of node-pool with N1 machine type
Create node pool "pool-1" in Kubernetes Engine cluster
11 minutes ago
Insufficient regional quota to satisfy request: resource "N2_CPUS": request requires '2.0' and is short '2.0'. project has a quota of '0.0' with '0.0' available. View and manage quotas at
Create node pool "pool-5" in Kubernetes Engine cluster
9 minutes ago
Deploy error: Not all instances running in IGM after 14.847846874s. Expect 1. Current errors: [ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS]: Instance 'gxxxxxxxpool-5-5365e95a-xw5r' creation failed: The zone 'projects/xxxx/zones/us-central1-a' does not have enough resources available to fulfill the request. '(resource type:compute)'.
Creation of node-pool with E2 machine type
but my quotas are not exceeded.It is possible to create node-pool with N1 type machines.Can anyone help to resolve this issue.

Stackoverflow cannot help you solve this problem.
The problem is that Google Cloud does not have enough resources available to allocate to you.
You have several options:
Wait. Resources will eventually become available. This could be minutes or days.
Select a different zone or region. Resource usage and availability will vary from zone to zone and region to region.
Select a different instance type. Availability varies between instance types.

Related

Cannot start GCE VM instance "The zone does not have enough resources"

I am trying to restart an instance that has been shut down for about a week, however it will not start, I get the error message:
Starting VM instance 'gc-custom-europe-west2-xxxxxxxxxxxxxxxxxxxx' failed. Error: The zone 'projects/XXX/zones/europe-west2-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.
There are no incidents reported that I can see, could anyone advise please?
You can control status of Google Cloud at Google Cloud Status Dashboard, but this isn't an issue, let me provide you some explanations:
When you stop an instance it releases some resources like vCPU and memory.
When you start an instance (or change it) it requests resources like vCPU and memory back and if there's not enough resources available in the zone you'll get an error message:
Error: Starting VM instance "INSTANCE_NAME" failed. Error: The zone 'projects/XXXX/zones/ZONE' does not have enough resources available to fulfill the request. Try a different zone, or try again later.
more information available in the documentation:
If you receive a resource error (such as ZONE_RESOURCE_POOL_EXHAUSTED
or ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS) when requesting new
resources, it means that the zone cannot currently accommodate your
request. This error is due to Compute Engine resource obtainability,
and is not due to your Compute Engine quota.
Resource availability are depending from users requests and therefore are dynamic.
There are a few ways to solve such issue without moving it to another zone:
Move your VM instance to another zone.
Wait for a while and try to start your VM instance again.
Reserve resources for your VM by following documentation to avoid such issue in future (extra payment required):
Create reservations for Virtual Machine (VM) instances in a specific
zone, using custom or predefined machine types, with or without
additional GPUs or local SSDs, to ensure resources are available for
your workloads when you need them. After you create a reservation, you
begin paying for the reserved resources immediately, and they remain
available for your project to use indefinitely, until the reservation
is deleted.
To protect data on your VM you can create a snapshot before making any changes.
You could try changing the instance form zone, let me provide you with the instructions for you to do so:
1.Go to Google Cloud Platform >>> Compute Engine
2.Go to Snapshots >>> create a snapshot >>> Select your Compute Engine instance
3.Once snapshot is completed click on snapshot.
4.Under "snapshot details". There, on the top, just click create instance. Here you are basically creating an instance with a copy of your disk.
5.Select your new zone setup previous setting, create new name.
6.Click create, at this point your image should now be running in the new zone

GCP ZONE_RESOURCE_POOL_EXHAUSTED

I am getting ZONE_RESOURCE_POOL_EXHAUSTED error for all three asia-south1 region from last 24 hours. It is new gcp account created 4-5 days, and yesterday created project and am trying to launch new instance in asia-south1, but every time I am getting this error for all three zones.
I tried with my another organisation which I am using from last 1 years and able to launch instance in asia-south1. Not sure why this is happening for only new project.
The zone 'projects/<PROJECT_ID>/zones/asia-south1-b' does not have enough resources available to fulfill the request. Try a different zone, or try again later.
If you see 'ZONE_RESOURCE_POOL_EXHAUSTED' error meaning you are encountered with the temporary resource stock-out issue at that particular zone. This error is due to Compute Engine resource obtainability, and is not due to your Compute Engine quota.
When you start an instance (or change it) it requests resources like vCPU and memory and if there's not enough resources available in the zone you'll get an error message:
Error: The zone 'projects/thetourking/zones/asia-south1-b' does not have enough resources available to fulfill the request. Try a different zone, or try again later.
You can read more detailed information about that errors in this documentation.
There are various recommended workarounds:
Move your instances to another zone following this instructions.
Wait for a while and try to start your VM instance again because those issues are to be expected transiently.
Reserve zonal resources for your instances to avoid the same issue in the future. Keep in mind that reserving zonal resources requires an extra payment.

gke-resource-quotas applied on clusters with 10+ nodes

The GKE documentation about resource quotas says that those hard limits are only applied for clusters with 10 or fewer nodes.
Even though we have more than 10 nodes, this quota has been created and cannot be deleted
Is this a bug on GKE side or intentional and the documentation is invalid?
I had experienced a really strange error today using GKE. Our hosted gitlab-runner stopped running new jobs, and the message was:
pods "xxxx" is forbidden: exceeded quota: gke-resource-quotas, requested: pods=1, used: pods=1500, limited: pods=1500
So the quota resource is non-editable (as documentation says). The problem, however, that there was just 5 pods running, not 1500. So it can be a kubernetes bug, the way it calculated nodes count, not sure.
After upgrading control plane and nodes, the error didn't go away and I didn't know how to reset the counter of nodes.
What did work for me was to simply delete this resource quota. Was surprised that it was even allowed to /shrug.
kubectl delete resourcequota gke-resource-quotas -n gitlab-runner
After that, same resource quota was recreated, and the pods were able to run again.
The "gke-resource-quotas" protects the control plane from being accidentally overloaded by the applications deployed in the cluster that creates excessive amount of kubernetes resources. GKE automatically installs an open source kubernetes ResourceQuota object called ‘gke-resource-quotas’ in each namespace of the cluster. You can get more information about the object by using this command [kubectl get resourcequota gke-resource-quotas -o yaml -n kube-system].
Currently, GKE resource quotas include four kubernetes resources, the number of pods, services, jobs, and ingresses. Their limits are calculated based on the cluster size and other factors. GKE resource quotas are immutable, no change can be made to them either through API or kubectl. The resource name “gke-resource-quotas” is reserved, if you create a ResourceQuota with the same name, it will be overwritten.

AWS EC2 limit error while updating EC2 instance of Elastic Beanstalk

While updating EC2 instance of Elastic Beanstalk the following error message appeared. But for my other account the following error, not observed:
Updating Auto Scaling group named: awseb-e-tiknsbmh4d-stack-AWSEBAutoScalingGroup-R3UXFI8KMCSN failed Reason: You have requested more instances (1) than your current instance limit of 0 allows for the specified instance type
Is it account base specific? And what is the best way to fix it?
Yes, there are limits which are account-specific.
You can check your EC2 quotas using the AWS Quota Service. [1]
You can view the EC2 quotas which apply for the account you are currently signed in by visiting the following URL: https://eu-central-1.console.aws.amazon.com/servicequotas/home?region=REGION#!/services/ec2/quotas by replacing REGION with your region identifier, e.g. us-east-1.
If the quota is marked as adjustable, you can request an increase via this service.
References
[1] https://docs.aws.amazon.com/servicequotas/latest/userguide/intro.html
This message is related to Amazon EC2. Even though the instance was launched by Elastic Beanstalk, the limit is related to the number of concurrent Amazon E2 instances permitted.
There are two types of limits:
Total number of concurrent instances (default: 20)
Number of concurrent instances per instance type (default varies)
You can view these limits in the Limits section of the Amazon EC2 management console. You can also request an increase in the limits.
The limits are "per account, per region".

ec2 error starting instances insufficient capacity

We have created AWS EC2 instance on Asia it Pacific(Mumbai) Zone on Shared Hardware rental type.We are trying to start an instance after shut it down we are getting popup ec2 error starting instances insufficient capacity message on screen.On white papers it is mention like this,Try to launch new ec2 instance but as we have in basic plan it is now allowing to create new instance on another zone.
How to resolve this issue.
According to the documentation, getting an InsufficientInstanceCapacity error when launching or restarting an instance means that Amazon does not have enough capacity to serve your request. There are a few options:
Waiting for a while and trying again
Launching an instance without specifying an availability zone
Changing the instance type
You can read more here.
Below are a few options available
Wait for that instance type to become available.
Launch a different instance type.
Launch an instance in a different availability zone and migrate back at a later time, if necessary. This provides a temporary solution until you can replace it at a later time with one in the desired availability zone. However, you will be charged cross-zone data transfer costs.
Launch an instance in the -Any- availability zone
Purchase a reserved instance (for that instance type) in the desired availability zone. This will also prevent you from receiving this error in the future.
This is usually caused by
AWS not having enough available On-Demand capacity to complete your request.
For troubleshooting steps, see [1].
If the preceding troubleshooting steps don't resolve the problem, then you can move the instance to another VPC or to another subnet and Availability Zone[2].
Tip :
To avoid insufficient capacity errors on critical machines, consider using
On-Demand Capacity Reservations[3].
To use an On-Demand Capacity Reservation, do the following :
1. Create the Capacity Reservation[4] in an Availability Zone.
2. Launch critical instances into your Capacity Reservation[5].
Reference :
[1] https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/troubleshooting-launch.html#troubleshooting-launch-capacity
[2] https://aws.amazon.com/premiumsupport/knowledge-center/move-ec2-instance/
[3] https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-capacity-reservations.html
[4] https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/capacity-reservations-using.html#capacity-reservations-create
[5] https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/capacity-reservations-using.html#capacity-reservations-launch
If you are new to AWS, there's usually a limit for how many instances can you launch or start even if you are currently running none. Try to request for a limit increase for the instance you want to launch in the support center and the insufficient capacity error will disappear