How to increase COMMITTED_CPUS quota? - google-cloud-platform

I tried to purchase additional committed use discount in GCP but I got this error.
Quota 'COMMITTED_CPUS' exceeded. Limit: 75.0 in region asia-southeast1.
Previously, I already purchase some CPU and memory successfully. I tried to search in Quota page but I can't find anything with COMMITTED_CPUS or 75 limits. Digging to commitments metric only purchase quota not cpu quota.
I also try this command but still can't find it.
gcloud compute project-info describe --project "project_name"
I can't purchase it both in console and using this command.
gcloud compute commitments create asia-southeast-1y-3 --plan 12-month --region asia-southeast1 --resources=MEMORY=106GB,VCPU=36

I've confront this issue before. I can provide you some SOP for solving this:
File a new case to increase your COMMITMENTS quota in the same region you’re seeing the problem in order to address the problem in an automated way. Each COMMITMENTS increase also increases COMMITTED_CPUS to the current quota of CPUS in the region.
To be very specific, if you need an increase for COMMITTED_CPUS, the only way is to request an increase for COMMITMENTS. To request quota for Commitments, follow these instructions:
Go to the Quota Increase page in the Google Cloud Platform Console
Expand the Quota type dropdown menu and select All quotas.
Expand the Metric dropdown menu.
Click on None to hide all quotas and then type Commitments in the search box to search for Commitments quota.
Select Commitments from the list.
Select the checkbox next to Commitments for the desired region and click the Edit Quotas button.
If prompted, fill in your first and last name, and phone number. Click Next.
Fill out the request form and click Next.
Click Submit Request to submit your request.
Once your request is received, it takes about 2 business days. Hope this helps!

Related

How to view all the services running on AWS?

How would I be able to view all the services running on aws. I have been charged some $$$, so what to close the services that are running. Most of the $ are being charged for KMS(Key Management System). When I go inside the KMS from aws console there's nothing.
Please Help!!!!
Give this a try:-
Go to my Billing dashboard.
Under left pane -> Billing -> go to Bills.
Here you can find bills according to month with charges based on different services.
If you click on a specific service(drop down), you can find, under which region the service has been launched and its charges
Depending on the access level you have in the project, there are 2 options
Option 1 (Mentioned in the previous comments)
Go to my Billing dashboard
Under left pane -> Billing -> go to Bills.
This option work only if you have access to the billing information
Option 2 - Use the VPC Dashboard
Search for VPC
In the VPC Dashboard you can see "Resources by Region"
Notes: This will give you information about the selected region in the top right corner, however, each resource contains The see all regions dropdown that gives an indication of where that resource is used.
Often the Cost Explorer is one of the best tools to identify where the money is being spent without much delays -- if you check on your bill, it will take the entire cycle to find out.
On the top of your chart on CE, you can change the grouping and usually Usage Type makes it easier to understand the exact usage of that service.
Also, keep in mind if you don't see the expected service on AWS Console, double-check if you are looking at the correct region (top right of your screen).
Another option to see all resources being used is to go to the "AWS Resource Groups"-->"Tag Editor".
Select "All Regions" and "All Supported Resource Types" (or any specific resource you are interested in. Click "Search resources". (hopefully) Done!
Firstly, go to Billing Dashboard. It open as "AWS Billing Dashboard" (notice ../billing/home in the url).
If you want to view all different aws-services you have been consuming, along with their bills. From the left-pan menu, navigate to => Cost Explorer -> Launch Cost Explorer.Here you can find bills according to your months, regions, service-type, usage-type, etc. with charges based on different services.
If you want to view your cumulative bill (regarding all usage of aws services), from the left-pane menu go to Bills.
Firstly, you can check aws bills to see for what you have been charted for - https://aws.amazon.com/premiumsupport/knowledge-center/view-aws-payments/; Also, aws has a tool called trusted advisor that will be able to help you to optimize your pricing. Lastly, there is a tool called cost explorer - https://aws.amazon.com/aws-cost-management/aws-cost-explorer/, but personally I haven't tried it yet.
Top right corner user menu > billing dashboard (from drop-down)> bills (left sidebar menu)
This is exactly what I found in my case and find that two unnecessary ec2 instance is running in unwanted region that I'm paying extra.
And a little thought. AWS is only telling me what I'm charged for. That amount is already transferred to AWS. Instead if it would have shown me a nicer dashboard that says all the services currently running. Then I could find out which one I don't need anymore and prevent that unwanted loss of money.

Not able to increase Quota for Compute Engine API in GCP

I have been trying to increase Quota for Google Cloud Platform(GCP) Compute Engine API for a Location and it is not allowing me to Edit or Even select the location.
I have tried the same thing before few months back and it was properly working then. I just created a new project and tried the same thing.
I do have the Owner Permission assigned to me.
After concluding that you are in Free Tier, that is part of constraints.
Your free trial credit applies to all Google Cloud resources, with the following exceptions:
You can't have more than 8 cores (or virtual CPUs) running at the same time.
You can't add GPUs to your VM instances.
You can't request a quota increase. For an overview of Compute Engine quotas, see Resource quotas.
You can't create VM instances that are based on Windows Server images.
You must upgrade your account to perform any of the actions in the preceding list.
Upgrading to a paid account:
https://cloud.google.com/free/docs/gcp-free-tier#how-to-upgrade
Free Tier conditions:
https://cloud.google.com/free/docs/gcp-free-tier
Update: To be able to increase Quotas or Submit Quota Increase, you need to:
For New Project need to wait for 48hrs
You need to have Billing Enabled (Enable it by going into top-left gift icon and following along to Enable Billing in GCP)

ERROR: (gcloud.compute.instances.create) Could not fetch resource: - Quota 'GPUS_ALL_REGIONS' exceeded. Limit: 0.0 globally

I would like to try PEGASUS to summarize article.
https://github.com/google-research/pegasus
I followed this instruction.
https://github.com/google-research/pegasus/tree/f76b63c2886748f7f5c6c9fb547456d8c6002562#setup
I checked the region which I can use NVIDIA Tesla V100 and I decided to use us-central1-a
https://cloud.google.com/compute/docs/gpus
I used this command.
gcloud compute instances create pegasustest --zone=us-central1-a
--machine-type=n1-highmem-8 --accelerator type=nvidia-tesla-v100,count=1
--boot-disk-size=500GB --image-project=ml-images --image-family=tf-1-15
--maintenance-policy TERMINATE --restart-on-failure
I got this error message.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
- The zone 'projects/covid19agent/zones/us-central1-a' does not have enough
resources available to fulfill the request.
Try a different zone, or try again later.
I took 3 hours and tried again, but I got the same result.
So, I changed the region from us-central1-a to asia-east1-c.
I used this command.
gcloud compute instances create pegasustest --zone=asia-east1-c
--machine-type=n1-highmem-8 --accelerator type=nvidia-tesla-v100,count=1
--boot-disk-size=500GB --image-project=ml-images --image-family=tf-1-15
--maintenance-policy TERMINATE --restart-on-failure
Then I got this error message.
WARNING: Some requests generated warnings:
- Disk size: '500 GB' is larger than image size: '10 GB'.
You might need to resize the root repartition manually
if the operating system does not support automatic resizing.
See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd
for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
- Quota 'GPUS_ALL_REGIONS' exceeded. Limit: 0.0 globally.
Is it impossible for me to try PEGASUS? And, does it cost too much to try PEGASUS?
Let's start with the first issue. Have a look again at the error message:
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
- The zone 'projects/covid19agent/zones/us-central1-a' does not have enough resources available to fulfill the request. Try a different
zone, or try again later.
When you start an instance it requests resources like vCPU, memory, GPU and if there's not enough resources available in the zone you'll get such message, more information available in the documentation:
If you receive a resource error (such as ZONE_RESOURCE_POOL_EXHAUSTED
or ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS) when requesting new
resources, it means that the zone cannot currently accommodate your
request. This error is due to Compute Engine resource obtainability,
and is not due to your Compute Engine quota.
Resource availability are depending from users requests and therefore are dynamic.
There are a few ways to solve this issue:
Wait for a while and try to start your VM instance again (as you tried, but fruitless this time).
Move your instance to another zone (as you did).
Reserve resources for your VM by following documentation to avoid such issue in future:
Create reservations for Virtual Machine (VM) instances in a specific
zone, using custom or predefined machine types, with or without
additional GPUs or local SSDs, to ensure resources are available for
your workloads when you need them. After you create a reservation, you
begin paying for the reserved resources immediately, and they remain
available for your project to use indefinitely, until the reservation
is deleted.
Now, let's have a look at the second issue. Have a look again at this error message:
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
- Quota 'GPUS_ALL_REGIONS' exceeded. Limit: 0.0 globally.
More information about quotas you can find in the documentation.
To solve this issue you should follow steps below:
Ensure that billing is enabled for your project.
Request an increase in quota:
Go to the Quotas page.
In the Quotas page, select the quotas you want to change.
Click the Edit Quotas button on the top of the page.
Check the box of the service you want to edit.
Fill out your name, email, and phone number, and click Next.
Enter your request to increase your quota, and click Next.
Submit your request.
A request to decrease quota is rejected by default. If you must reduce your quota, reply to the support email with an explanation of
your requirements. A support representative from the Compute Engine
team will respond to your request within 24 to 48 hours.
You're not able to request an increase in quota if you use 12-month, $300 free trial because of the limitations:
Your free trial credit applies to all Google Cloud resources, with the
following exceptions:
You can't have more than 8 cores (or virtual CPUs) running at the same time.
You can't add GPUs to your VM instances.
You can't request a quota increase. For an overview of Compute Engine quotas, see Resource quotas.
You can't create VM instances that are based on Windows Server images.
You must upgrade your account to perform any of the actions in
the preceding list.
You can estimate cost of usage with Google Cloud Pricing Calculator.

Not able to create a commitment

When trying to create a commitment
gcloud beta compute commitments create commitment-hyper-gpus-2 --region=europe-west1 --resources=vcpu=16,memory=104 --resources-accelerator=type=nvidia-tesla-p100,count=1 --plan 12-month --reservation=hyper-gpus-p100-2 --reservation-zone=europe-west1-d --machine-type=n1-highmem-16 --accelerator=type=nvidia-tesla-p100,count=1 --vm-count=1
Its giving me the below error.
ERROR: (gcloud.beta.compute.commitments.create) Some requests did not succeed:
- Quota 'COMMITTED_NVIDIA_P100_GPUS' exceeded. Limit: 0.0 in region europe-west1
But, there is no quota with name COMMITTED_NVIDIA_P100_GPUS
You will need to request a quote increase for all GPUs (global).
Make sure that you have setup billing and a payment method
Go to the Google Cloud Console Quotas page: https://console.cloud.google.com/iam-admin/quotas
Under "Metric" select GPUs (all regions). This will limit the number of services displayed.
Select (don't click on) Compute Engine APIs.
Click on "EDIT QUOTAS".
Fill out the form.
Wait to either be contacted or approved or declined.

Google Compute committed use discount

I am trying to purchase Google Compute committed use discount for one year and for that I have requested and increased the quota for CPU's and Commitments for the required regions as described in https://cloud.google.com/compute/docs/instances/signing-up-committed-use-discounts#purchasecommitment . All the changes are already in place but still I am not able to purchase the commitments. If I check committed CPU's for us-east1 region from quota's it is greater than 24.
Am I missing anything?
enter image description here
Disclaimer: I'm working for Google Cloud Support
I've checked your quota increase request,I've noticed that the committed cpu quota were granted before than the CPU quota request.
This means that your commitments is based on your previous cpu quota (24).Since the commitments will not be update by its self with the new cpu quota (greater than 24) you should then file a new commitments request in order to use your new cpu quotas.