Please what is the best or recommended way how to visualize data from the DynamoDB table ? We need to create some simple dashboard with graphs connected to data table on the AWS account.
We prefer to use one of the services from AWS to keep everything in one place. I read about the QuickSight but it would be great to know some experience.
You can use quicksight to visualize your table by using the Athena-DynamoDB connector. This will allow you to use DynamoDB as a table source in Athena which can then act as a source for Quicksight.
https://docs.aws.amazon.com/athena/latest/ug/connectors-dynamodb.html
Related
I created a sort of data warehouse so you can make SQL queries in documentDB. I did so using Athena and a documentDBConnector.
(https://docs.aws.amazon.com/athena/latest/ug/athena-prebuilt-data-connectors-docdb.html)
However, I’d also like to set very deep and specific permission for a user who makes these queries in Athena and be able to specify table / column level permissions and I’m trying to see if I can do so using Lake Formation provided that I’m also using that documentDBConnector.
It doesn't seem like I can specify that docDB connector as a data source in lake formation.
If this is not possible, does anyone know of any other ideas that would let me specify more detailed permissions for making Athena Queries?
I am trying to build AWS QuickSight reports using AWS Athena that builds the specific views for said reports. however, I seem to only be able to select a single table in creating the Glue job despite being able to select all tables i need for the crawler of the entire DB from Dynamo.
What is the simplest route to get a complete extract of all tables that is queryable in Athena.
I dont want to connect the reports direct to dynamoDB as it s a production database and want to create some separation to avoid any performance degradation by a poor query etc.
Hi I have an influxDb installed on aws ec2 instance, wanted to show its data on aws quicksight. As I don't see influx dB in predefined data source list of aws quicksight. Will it be possible to create data source for influxDb and show its data on quick sight view. How i can defined my custom datasource for influxdb.
As I know influxDb compatibility is good with Grafana, so not sure whether I will be abel get data on quicksight view. Please let me know if you are aware, how can I achieve it.
Thanks.
Currently, AWS Quicksight doesn't support showing the metrics from InfluxDB.
To visualize your metric in AWS Quicksight, simply do following steps:
Collect data from InfluxDB and store in S3, GlueCatalog, Athena or relational database.
Show your data in Quicksight from stored data.
Let's see official documentation for more detailed information
https://docs.aws.amazon.com/quicksight/latest/user/welcome.html
Not yet a supported database worth using the send feedback setting in Quicksight to see if it is in the roadmap.
I have live data on DocumentDB
Provisioning data on Aurora (Postgres)
I would like to have both datasets on Quicksight for BI
The DocumentDB data uses internal IDs
The SQL holds the mapping to meaningful names
Is there a way to achieve such a thing?
I have a Glue job that extracts the data from the DocumentDB and outputs it as a JSON in S3
Regarding Aurora - Quicksight natively integrates
Thanks
I have managed to achieve this after adding another data source to the same data set.
AWS then enables you to do a join between the data sources.
I would like to create via Terraform an Athena database including tables and views. I have already searched a lot and found some posts, e.g. here: Create AWS Athena view programmatically
I know that I can use Terraform provisioners to execute AWS CLI commands to create these resources, for example like this: AWS Athena Create table view with SQL
But I don't want to do that. I want to create everything (as far as possible) with Terraform so that I don't have to worry about lifecycle etc.
As far as I understand, an Athena database can be a Glue database, depending on the source you choose. If I choose the AWSDataCatalog (Glue) as data source in Athena, it should not matter if I create an Athena database or a Glue database with Terraform, correct?
In Glue I can also create tables, but no views. Do the Glue tables automatically correspond to Athena tables? How can I create Athena views? I would like to create everything with SQL DDL, just like you can do it in the AWS Web Console. How does this work via Terraform? If this functionality is not available, what is the best way to go? I am grateful for every tip and help!
Athena uses the Glue Data Catalog to store metadata about databases, tables, and views. All Athena tables are Glue tables. However, not all Glue tables work with Athena – you can create tables in Glue that won't be visible in Athena, and you can create tables that will be visible but won't work (for example cause runtime errors when you query them).
Athena uses Glue Data Catalog for views, but the format is very specific to Athena, unlike regular tables which can be made interoperable with for example Spark.
In an answer to the question you link to I explain in detail the anatomy of an Athena view. I have created views with CloudFormation with that information so it can be done with Terraform too. Unless you write code you will have to jump through all the hoops and repeat most of the information as Presto metadata, unfortunately.