Unable to add HTTPArchive dataset to BigQuery project - google-cloud-platform

I'd like to explore the HTTPArchive data that is publicly available in BigQuery. To access the data, I'm following along with these instructions:
https://github.com/HTTPArchive/httparchive.org/blob/main/docs/gettingstarted_bigquery.md
Unfortunately, when I get to step 7, I get an error message as follows:
You seem to be missing permissions on the billing project. The billing project can be changed using the project picker at the top of the page. If the project is correct then please talk to your administrator. Original error message: The caller does not have permission
In my googling to resolve the issue, I found this SO question/answer: missing permission on "billingAccounts/XXXXXXXXXXXXXXXXXXXXXXXX": billing.resourceAssociations.create Terraform (GCP)
Unfortunately, adding all the various billing roles to the principal associated with the account does not resolve the issue. I've added all the mentioned billing roles but I'm still running into the same problem.
I can't tell for sure (I just don't have the expertise atm) but it seems the project isn't correctly linked to the billing resource but I could be wrong.
I do get this message when I click on "Change billing account" (within the "Actions" menu) under the "Account management page".
This seems like it could be the issue but it might also just mean that I don't have a second Billing account to change to.
Any and all help greatly appreciated.

You have to unlink first your project from your current Cloud Billing Account to link to your new or desired billing account. To do so, you have to make sure that you have predefined roles for permissions both on your project and billing account. You can follow the steps based on this documentation.
Another option is to create a new Cloud Billing Account. If you are under an organization, you must have this permission - billing.accounts.create. You can follow these instructions on creating your new billing account. If you are the one who manages your Google Cloud resources, you won't need to add any permissions to create a new billing account.
Kindly comment below if this can help you proceed on setting up your HTTPArchive to BigQuery so we can still find another solution to your blocker.

Related

Google Cloud: Why am I not an organization administrator?

I am attempting to expand my usage of Google Cloud and running into issues. When I go to IAM & Admin -> IAM and select my organization, I get an error: "You do not have sufficient permissions to view this page". A bit lower: "You are missing the following required permissions: resourcemanager.organizations.getIamPolicy".
I'm confused by this because if I select a project IN the organization I see I have the "Organization Administrator" role which has that exact permission assigned. I also have "Owner" role.
I also cannot upgrade from Basic support to any paid support due to this issue, so I literally cannot get any help from anyone at Google.
I created this org! Do I need to delete everything and start over? (ugh)
Based on what #JohnHanley's shared on the comments:
Organization Admin must be applied (bound) at the organization level. If you created the organization, then you have a Workspace or Identity account. Use that account to login. The problem should be easy to solve once you are using the correct account to authenticate.
In addittion to that;
To administer a particular project or product on GCP, you must ask your organization or the team managing your Google Workspace Admin to increase your role and authorization to a higher hierarchy.

Projects under No Organization that cannot be accessed

In the cloud-resource-manager page, there are 2 projects listed under No organization, one of them curiously has the id you-can-see-this-project, the other looks like an automatically generated project with the prefix My Project xxx.
The issue is that there seems to be no way to access these 2 projects even though I can see them under my account. The IAM page shows that I do not have the permission resourcemanager.projects.getIamPolicy and every other page or action notes some missing permission.
Is there a way to shutdown/delete these projects or a way to remove myself from these projects?
Edit:
Seems like the 2 projects that are showing up in my account are the same with other people that have the same issue.
They are
Update (20221114): Checked recently and both the rogue projects are gone with no action on our part. Probably it was finally cleaned-up?
Root cause
Your Google Cloud Account is subscribed to "google-appengine#googlegroups.com".
Solution
Unsubscribing from this group will remove these projects. See Google Groups Help for reference.
I got this feedback directly from the Google Cloud Support team and confirmed it working on with my account. I did not consciously subscribe to that group, maybe this happens or happened automatically in the past. Also why these ghost projects are added remains a mystery to me, no idea what they should be used for. Here's hoping that Google will fix this in the future...
You will need to identify the Projects' members that have the Owner role; I think that there is not a specific IAM permission that permits Project deletion but that some identities must have the Owner role.
I suspect (!) you can't orphan Projects by removing the last Owner, so there must be at least one.
If you're unable to determine Ownership, Google Cloud Support can determine the Owners for you though I suspect Support won't be able to disclose this information to you but will need to contact the Owners directly about this.
Once you have created your Google Workspace or Cloud Identity account and associated it with a domain, your organization resource will be automatically created for you. The resource will be provisioned at different times depending on your account status:
If you are new to Google Cloud and have not created a project yet,
the organization resource will be created for you when you log in to
the Google Cloud console and accept the terms and conditions.
If you are an existing Google Cloud user, the organization resource
will be created for you when you create a new project or billing
account. Any projects you created previously will be listed under "No
organization", and this is normal. The organization resource will
appear and the new project you created will be linked to it
automatically. You will need to move any projects you created under
"No organization" into your new organization resource. For
instructions on how to move your projects, see Migrating projects
into an organization.
Users can only view and list projects they have access to via IAM roles. The Organization Administrator can view and list all projects in the organization.
The No organization option in the Organization drop-down lists the following projects:
Projects that do not belong to the Organization yet.
Projects for which the user has access to, but are under an
Organization to which the user does not have access.
Refer to this documentation for more information on creating and managing organizations.

Cloud Scheduler Page Access Issue - Shared project

The manager holds the account that provides billing to the said project, now I cannot go to Cloud Scheduler page due to my account not having a billing setup, therefore my workaround is to manually input the link directly to the page like this
https://console.cloud.google.com/cloudscheduler?project={PROJECT_ID}
but now it no longer work and throwing error page. Supposedly I am able to access "Cloud Scheduler" page regardless if the account I use does not have a billing setup since the billing was already made by other account on this shared the project right? Is anyone having the same issue as of this date? Any solution?
It seems the billing card that being used is no longer valid or having some issue.

How do I upload my own custom zip of a deployment?

I'm trying to use an existing setup/deployment, however it has a failure and hence I thought I'd try fix it by creating my own "deployment".
I can't figure out how to do this though.
I just get a page of "There are no solutions yet. Contact your admin for status on the catalogue."
I followed the instructions here: https://cloud.google.com/private-catalog/docs/create-catalog
However at step 3 - there is no "manage solutions" button...
I HAVE added the "catalogue admin" + "catalogue manager" roles to my user.
Why am I not getting this button?
There are three prerequisites to use Private Catalogues:
You must have a Google Cloud organization and access to the organization.
You must have the administrator role for your Google Cloud organization.
You must have the Catalog admin role for Private Catalog.
Perhaps you are only missing the first one:
Organizations are only available for GSuite and Cloud Identity customers: https://cloud.google.com/resource-manager/docs/creating-managing-organization
Edit: here is a better quickstart guide for using Private Catalogues:

GSuite/Cloud Platform - Fixing or Resetting Permissions

I had created a Google Cloud Platform project and an associated service account for accessing the Directory API in the Admin SDK. After some experimentation I decided to remove that project and the service account and start from scratch. Around that same time I also changed the primary domain on our GSuite account.
I believe this combination has screwed up my permissions in the Google Cloud Platform. I'm the only SuperAdmin on our GSuite account, and yet it seems I'm unable to do many things (examples below). Any way to completely reset permissions or the Cloud Platform account entirely? There are no projects to lose at this point.
Examples:
When I try to create a new project, when choosing "location", the only option (the name of the organization, still using the old primary domain) tells me "You do not have permission to create projects in this location"
If I go to IAM & Admin > Settings and try to rename the organization, it says "You do not have the permission to rename this resource.
Required permission(s): All of resourcemanager.organizations.get and resourcemanager.organizations.update"
If I go to IAM & Admin > Roles a banner at the top says "You do not have sufficient permissions to view this page"
I contacted GSuite support, but since the problem itself was on the Cloud Platform side they couldn't really do much for me.
I'm still not sure what caused the permissions to get mangled, but creating another GSuite admin and using that one to repair permissions took care of it.