I need fetch the records using ROW_NUMBER(). Is there any possibility to achieve this using Google Cloud Datastore?
Cloud Datastore is a NoSQL database. On the other hand, ROW_NUMBER is a standard SQL numbering function which is supported by Google’s BigQuery service that supports querying using ANSI SQL.
Related
I'm trying to migrate data from AWS dynamodb to google cloud datastore, but there is no prior information available on this problem. I could find few links for migrating from datastore to dynamodb or migrating from dynamodb to cloud spanner.
I've tried to explore import/export option through csv file, but only import/export to firestore is available on google documentation.
For a bulk import, you are probably best to start with the Dataflow template for Firestore in Datastore mode at https://cloud.google.com/dataflow/docs/guides/templates/provided-batch#cloud-storage-text-to-firestore . You can provide a transform function to transform your data, or update the template to match your needs.
Does Google Cloud SQL support column-level encryption?
I know that it is possible for BigQuery tables but not sure about Cloud SQL!
link
It's not a out of the bow feature on Cloud SQL, you need to do it manually when you read and write the data. You can use Cloud KMS for hat.
With BigQuery, keep in mind that you need to keep the key in BigQuery also and only the IAM permission allow to access or not to the keyset.
Eventually, all the data are encrypted at rest, but I'm sure that your use case is for a specific column, not for the whole database.
I heard Athena is data analytics service from AWS which provides the same features like big query. Can we use Athena as alternative product for bigquery?
Athena is often used as a SQL layer for structured data in S3 such as formatted logs rather than a production DB like BigQuery which brings built-in multi-region support, etc. The AWS equivalent would still be a dedicated DB, either Postgres for SQL or Dynamo for NoSQL.
How to make a offline website in Google Cloud SQL using progressive web app.How to synchronize Google Cloud SQL database to offline database. Can I use Google Cloud SQL in progressive web app for offline database?
Cloud SQL does not have any capability like this built in. There are some generic MySQL sync tools, but this wouldn't be able to enforce per-user security etc.
Probably the best bet is to use a database designed for this use-case, such as Firestore, which has built-in offline sync for web apps.
Answering your question, Google Cloud SQL doesn’ t allow an offline database. I recommend to take a look to Cloud Firestore which supports offline data persistence and would be up to you if this may fit your use case.
I need to use Elixir/Phoenix and Google Serverless DBs for a realtime Forex App.
So how to connect from Phoenix/Elixir to Google Cloud Spanner or Google Cloud Bigtable? Any link for Doc or tutorial would be appreciated.
This question was first asked on ElixirForum. and the answer suggested was Elixir on GCP, however, I have gone through all the materials on that link and found nothing.
Disclosure: I am a product manager for Google Cloud Bigtable.
There's an Elixir client for Cloud Spanner you can take a look at.
There isn't a Google-written and maintained Elixir client for Cloud Bigtable yet, but there's Elixir support for a number of other products in the same repo as well.
However, there's a third-party Elixir client for Cloud Bigtable you can explore; please direct any questions to their GitHub repo.
That said, if you're looking for a true serverless database backend for your app, consider using Google Cloud Firestore, which has also has Elixir support. Cloud Spanner and Cloud Bigtable require provisioning dedicated resources so there will be a minimum charge regardless of usage, while Cloud Firestore provides a pay-as-you-go model that will make it easy to scale from a small app to a large application.
Take a look at the pricing guides for each of these databases for more information:
Cloud Spanner pricing
Cloud Bigtable pricing
Cloud Firestore pricing