I am trying to build POC on connecting to PostgreSQL using Streaming Integrator with CDC listening mode. I am new to this WSO2 product-Streaming Integrator and I am not getting any example for reference.
Can anyone help.
You can refer to the Debezium[1] documentation to configure the CDC in Postgress DB level, and then read through the Siddhi IO CDC doc[2] in order to create a cdc source in Streaming Integrator side.
[1]https://debezium.io/documentation/reference/1.4/connectors/postgresql.html#setting-up-postgresql
[2]https://siddhi-io.github.io/siddhi-io-cdc/api/latest/
[3]https://ei.docs.wso2.com/en/7.2.0/streaming-integrator/samples/CDCWithListeningMode/
Related
We have a C++ application connecting as client to WebSphere MQ using configurable queue manager and queue name. We have been asked to migrate to SSL channels for security reasons. So far we have taken care of configuring Sender and Receiver channels to use SSL.
Do we need to move the SVRCONN channels as well to use SSL?
If yes, how do we provide key-store details in code to connect to channel?
I could not find any option in MQOPEN API to provide.
I could not find any option in MQOPEN API to provide.
Its not in MQOPEN but rather MQCONNX API call. It is far better to use a CCDT (Client Channel Definition Table) file because then your code just needs to issue an MQCONN API call.
I am new with wso2 products. I am using EMM for device and app. But i want to monitor my devices continuously.
As some document suggest, i can done this using CEP in real time and also can use BAM. But i did not found any proper document to install or configure these system together (EMM, CEP, BAM).
My EMM server is already live. I am now tring to analysis the http access log to find out registration failed or other error.
But I actually need to monitor the EMM server in real time.
Do I need to run these servers separately and also have to configure them separately? Is there any way to merge all(EMM,CEP,BAM and even ESS) application and run all of them by running one carbon server?
If I need to run these server separately, then how I can configure CEP/BAM as this will monitor EMM server's API/log files/services etc?
Is there documentation for this? I can not find any document related to CEP/BAM related to EMM.
Can any one please help me for this?
WSO2 BAM product has been replaced by WSO2 DAS (Data Analytics Server). Again WSO2 DAS consist with WSO2 CEP features where as it is capable of doing both real time and batch time processing. Therefore you can DAS for both batch processing and real time processing
Both DAS and CEP deals with event streams where as in DAS streams could be persisted to event tables as data needs to be stored for batch processing [2]. On the other hand both can be integrated with other applications by using Receivers for streams. You can protocols such as thrift, soap, http, mqtt, jms and kafka when creating receivers[3]
For real time processing you need to write Execution Plans [4] which uses Siddhi Query Language [5]. DAS supports Apache spark for batch processing. Both products consist with Analytic dashboard which could be used to visualize real time and persistent data [6].
[1] http://wso2.com/products/data-analytics-server/
[2] https://docs.wso2.com/display/DAS300/Understanding+Event+Streams+and+Event+Tables
[3] https://docs.wso2.com/display/DAS300/Configuring+Event+Receivers
[4] https://docs.wso2.com/display/CEP400/Creating+a+Standalone+Execution+Plan
[5] https://docs.wso2.com/display/CEP400/SiddhiQL+Guide+3.0
[6] https://docs.wso2.com/display/DAS300/Analytics+Dashboard
Yes its possible. You will need to use a data publisher to publish events to DAS.
I am wondering if I can use BAM and CEP to monitor requests from client, and even find the bottleneck of the service.
I found zipkin, a project that could do this, but the base of my application is WSO2, I don't want to get other projects from scratch.
Yes, you can use BAM/CEP for this. If you need real time monitoring you can use CEP and you can use BAM for batch process. From BAM 2.4.0 onwards, CEP features have been added inside BAM also hence you can use BAM and do real time analytics.
What type of services are involved with your scenario? Depends on this you can use already existing data publisher or write new data publisher for BAM/CEP to publish your request details. For example if you are having chain of axis2 webservice calls for a request from client, and you want to monitor where the bottle neck/more time consumed, then you may use the service stats publishing, and monitor the average time take to process the message which will help you to see where the actual delay has been introduced. For this you can use existing service statistics publisher feature. Also BAM will allow you to create your own dashboard to visualize, hence you can customize the dashboard.
Also with BAM 2.4.0 we have introduced notifications feature also which you can define some threshold value and configure to send notification if that cross that threshold value.
I am using BAM 2.2.0. I configured the service statistics toolbox inside the BAM server based on the documentation. And run the example program "service-stats"it is working fine.
But when I configure BAM inside my AS server using service data publisher configuration, and test the BAM server.Connection was established. But when I click the dashboard in BAM it shows an empty page with some msg how to configure AS .
Currently inside the BAM available script I can see "service-stats-271". How can I visualize my AS service status in BAM. Both servers are running in two machines.
Seeing "service-stats-271" is natural after installing the toolbox. But first you should see whether data has arrived to Cassandra from AS. For that you can login to Cassandra Explorer in BAM Management Console and see whether there is your column family existing in the EVENT_KS keyspace. If yes see whether there are any rows relevant to your events. If yes see whether the data has arrived to the H2 datbase during the execution of the Hive query.
If your data is not correctly published to Cassandra, please read [1] again. Sometimes you may not have done the following instruction mentioned there.
Go to <WSO2 Application Server home>/repository/conf/etc and open bam.xml file and enable ServiceDataPublishing as follows:
<BamConfig>
<ServiceDataPublishing>enable</ServiceDataPublishing>
</BamConfig>
[1] http://docs.wso2.org/wiki/display/BAM220/Setting+up+Service+Statistics+Data+Agent
I have successfully installed wso2 cep engine on Solaris 10 box. As events I'm receiving UDP feed (pipe separated data lines). How can I configure CEP engine to receive the UDP feed and process it?
Thanks
We don't yet have a UDP data receiver but we welcome you to write one :). You can push the events directly to the CEP engine (look at how the current data receivers do it) or use the data publisher API if you want to send it to a remote CEP engine (via thrift .. which would be kind of silly!). If you choose to write one please join architecture#wso2.org and ask for help / suggestions. See http://wso2.org/mail.