Pinpoint session duration - amazon-web-services

Is there any way to demonstrate users session duration on Amazon Pinpoint dashboard?
All Pinpoint events have a startTimestamp tag which shows the time for that event, but I could not find session length in the dashboard.

Unfortunately this is currently not yet supported. You can get this data by exporting the metrics to a RedShift cluster and querying the analytics data using SQL (Or exporting to S3 and processing it with EMR).

Related

How to do delta load (incremental) in aws and full data refresh in dashboard?

I have multiple ERPs ingesting data in S3, I have AWS glue for spark processing.
I found out, I need to have delta type files for spark processing and best way to run this ETL on EMR or Databricks.
Should I go for Databricks for incremental load and full load refresh of dashboard?
or EMR can also manage full data refresh along with update matched and insert new data features. if yes please share some info.
What I am confused about is that, if I have only new/ updated/ deleted data to process then how dashboard will show me all previous data.

Can I query Logs Explorer directly from a cloud function?

For a monitoring project I'm using Logs Router to send log data to BigQuery Table so I can then query the BigQuery table from cloud functions. Would it be possible to directly query Log Explorer from Cloud Functions? (i.e not having to replicate my logs to BigQuery?)
Thanks
Yes, of course you can. You even have client libraries for that. However, keep in mind that, by default, your logs are kept only 30 days. It could be enough, or not, depending on your use case.
You can create custom log bucket, with a different retention period, or sing the logs in BigQuery.
The main advantage of BigQuery if the capacity to join the logs data with other data in BigQuery, to perform powerful analytics computation. But still depends on your use case.

AWS quicksight and influx db

Hi I have an influxDb installed on aws ec2 instance, wanted to show its data on aws quicksight. As I don't see influx dB in predefined data source list of aws quicksight. Will it be possible to create data source for influxDb and show its data on quick sight view. How i can defined my custom datasource for influxdb.
As I know influxDb compatibility is good with Grafana, so not sure whether I will be abel get data on quicksight view. Please let me know if you are aware, how can I achieve it.
Thanks.
Currently, AWS Quicksight doesn't support showing the metrics from InfluxDB.
To visualize your metric in AWS Quicksight, simply do following steps:
Collect data from InfluxDB and store in S3, GlueCatalog, Athena or relational database.
Show your data in Quicksight from stored data.
Let's see official documentation for more detailed information
https://docs.aws.amazon.com/quicksight/latest/user/welcome.html
Not yet a supported database worth using the send feedback setting in Quicksight to see if it is in the roadmap.

Database changes on AWS real time sync to GCP

We have Postgresql on AWS. All realtime changes from Portal UI are captured on this database. However there is a request to move these changes in realtime or near realtime to GCP.
Purpose: We want various consumers to ingest data from GCP, instead of master data source in PostgresAWS.
When a customer table (in AWS Postgres) is being inserted with a new customer record, then I want to immediately populate that record in JSON format in GCP pub sub topic.
Please let me know any reference to move a database table specific data across cloud as and when any DML event occurs?
Please note that am new to GCP and learning and exploring :)
Thanks
Databases use log shipping to update slaves/replicas. In your case, you want to update two targets (database, Cloud Pub/Sub) by having the database do the Pub/Sub update. That might be possible but will require development work.
PostgreSQL does not have a native ability to update Pub/Sub. Instead, change your requirements so that the application/service that is updating the database then updates Pub/Sub.
If you really want PostgreSQL to do this task, you will need to use PostgreSQL triggers and write a trigger function in C with the Google Cloud Pub/Sub REST API.
PostgreSQL Trigger Example
PostgreSQL Event Trigger Example
Event triggers for PostgreSQL on Amazon RDS
Cloud Pub/Sub API

how to check number of times a dynamoDB table has been accessed

I have a dynamoDB table lets say sampleTable. I want to find out how many times this table has been accessed from cli. How do i check this?
PS. I have checked the metrics but couldnt find any particular metric which gives this information.
There is no CloudWatch metric to monitor API calls to DynamoDB.
However, there is CloudTrail (CT). Thus you can to go CT's event history and look for API calls to DynamoDB from the last 90 days. You can export the history to a CSV file, and investigate off line as well.
For ongoing monitoring of the API calls you can enable CT trail which will store event log details in S3 for as long as you require:
Logging DynamoDB Operations by Using AWS CloudTrail
If you have the trial created, you can use Amazon Athena to query the log data for the statistics of interests, such as number of specific API calls to DynamoDb:
Querying AWS CloudTrail Logs
Also, you could create custom metric based on the trial's log data (once you configure CloudWatch logs for the trial):
Analyzing AWS CloudTrail in Amazon CloudWatch
However, I don't think you can differentiate between API calls done using CLI, or SDK or by other means.