right now i am using microsoft sql server for my database in my dev app. in future if i want to migrate my database in google spanner what guidelines should i follow from right now so then migration should be easy in feature. also does google provide any migration tools like Microsoft® Data Migration Assistant.
SYNOPSIS
gcloud spanner instances create INSTANCE --config=CONFIG
--description=DESCRIPTION --nodes=NODES [--async] [GLOBAL-FLAG ...]
does spanner has any local emulator so i can install it in my local machine and test it before
gcloud spanner instances create --help
Cloud spanner is Google's horizontally scalable relational database. It is quite expensive(running it in minimal configuration with 3 nodes would cost you at least 100$ daily). Unless you really need the horizontal scalability you should use Cloud SQL.
Cloud SQL is a managed MySQL or PostgreSQL service by Google. You can migrate your data to Cloud SQL easily as this is a common use case. How you do it depends on your choice. For example check this question for exporting it to MySql. You can check this link to convert to PostgreSQL.
Check the Google's decision tree if you are unfamiliar with the details of Google's storage options:
Related
i have created a database in Redshift cluster now i want see the database and its tables manually instead of querying it.
Where can i see those database
create database example1;
With Redshift, there is no way to look at the data in any way except by issuing queries and commands against it. This is fairly common for most DBMS products.
AWS "recommend" the free tool Sqlworkbench/J
https://docs.aws.amazon.com/redshift/latest/mgmt/connecting-using-workbench.html
In addition you can issue commands against Redshift using the AWS management console
https://docs.aws.amazon.com/redshift/latest/mgmt/query-editor.html
My personal favorite (as a professional developer) is to use the Jetbrains DataGrip product.
with Google cloud platform, cloud SQL you get a lot of options to setup the infrastructure. Does this mean cloud SQL is infrastructure as a service ?
No, the infrastucture of Cloud SQL is managed by Google and by it's engineers, so, Cloud SQL is PAAS (Plaform As A Service).
Cloud SQL is a docker container built on top of a GCE instance, and Google monitor everything for you, and fix the Cloud SQL instance automatically if something goes wrong (Sometimes Google software engineers have to perform some actions to fix some issues if the instance is stuck). So, the only thing that you have to take care of is to store and query your data.
Also, Cloud SQL offers a lot of interesting features, such as, failover replicas, read replicas, user and database adminitration, etc.
So, in Cloud SQL, Google doesn't just sell the infrastucture to create databases, but also the application itself and the monitoring tools too.
Title says it all I want to export the table schemas for a Google Cloud Sql database? I see how to export the data, but I want the schema.
When using Google Cloud SQL - MySQL flavor ... the underlying intent is that it simply "is" a MySQL instance. The value that Google provides is that it is a managed instance. This means that the toil of management, backup, availability and a whole host of other operational characteristics are removed.
If we agree with this notion, then all usage of the Cloud SQL instance behaves as though it were a self-hosted MySQL instance and hence all the tools and procedures that one would use with your own MySQL instance are applicable.
For example, here is a link to the MySQL documentation on getting information about databases and tables:
https://dev.mysql.com/doc/refman/8.0/en/getting-information.html
This is equally applicable to Google Cloud SQL as a local instance. This story pervades into all the other aspects and literature. If you search for recipes to work with MySQL on premises, the same story should be applicable to Cloud SQL.
You can use [mysqldump][1] to save the info without the data:
mysqldump -u root -h <IP_ADDRESS> -p --no-data dbname > schema.sql
I'm studying how to use GCP, especially focus on the Big Data and analytic functions, I'm not quite sure about their functionality. I did some mapping to understand these components. Could you help to check out my understanding?
Cloud Pub/Sub: Apache Kafka
Cloud Dataproc: Apache Hadoop, Spark
GCS: HDFS compatible
Cloud Dataflow: Apache Beam, Flink
Datastore: MongoDB
BigQuery: Teradata
BigTable: HBase
Memorystore: Redis
Cloud SQL: MySQL, PostgreSQL
Cloud Composer: Informatica
Cloud Data Studio: Tableau
Cloud Datalab: Jupyter notebook
I'm not totally sure what you want to know, your understanding of the GCP products is not far off, but if you are studiying GCP and want to understand them better, you can take a look at the Google Cloud developer's cheat sheet. It has a brief explanation of all the products inside GCP.
Link to the GitHub of the cheat sheet
We are currently using AWS RDS as our databases. In tables, we defined some insert or update triggers on tables. I would like to know if Bigquery also support triggers?
thanks
BigQuery is a data warehouse product, similar to AWS Redshift and AWS Athena and there is no trigger support.
If you used AWS RDS so far, you need to check Google CloudSQL.
Google Cloud SQL is an easy-to-use service that delivers fully managed
SQL databases in the cloud. Google Cloud SQL provides either MySQL or
PostgreSQL databases.
If you have a heavy load, then check out Google Cloud Spanner it's even better for full scalable relational db.
Cloud Spanner is the only enterprise-grade, globally-distributed, and
strongly consistent database service built for the cloud specifically
to combine the benefits of relational database structure with
non-relational horizontal scale.
Big Query doesn't have the feature as stated by the colleague above.
However it has an event api based on it's audit logs. You can inspect it and trigger events with cloud functions as per:
https://cloud.google.com/blog/topics/developers-practitioners/how-trigger-cloud-run-actions-bigquery-events
Regards