I have a 3 node ESB cluster. Each node has its own mssql registry db. Additionally, there is a shared db for config and governance mount points.
I have a CAR which contains a proxy with a wspolicy. This car fails to deploy with a m says saying that there is a problem with the registry stream. Looking at synaps sources show that the resource stream is unlikely to be open.
I made a CAR with only the policy artefact. It deploys to the remote
Registry fine. I can see it via the Mgt GUI. I can see it via SQL query.
I set TRACE logging on the entire esb. When i deploy the original CAR I can see the policy committed to the registry, later when synapse tries to
Read the policy on the proxy deploy the error is raised.
I have a second cluster setup the same way. Just different host names and sql. Server. This AR file deploys fine on that.
I have checked my axis2.xml and registry.xml and see no problems.
Any clue what can cause synapse to have a problem reading on deploy but not on simpl install of policy? I noticed that my mgt host name was not right in the DNS and will get network
Guys to fix but I am not sure this will be any impact here. That is used in the URL for the remote registry elment. I am using jdbc registry not web service so is that even used?
[2017-01-27 13:29:44,823] INFO - Building Axis service for Proxy service : Authenticate_XXXXXXXX {org.apache.synapse.core.axis2.ProxyService}
[2017-01-27 13:29:44,823] DEBUG - Entry: AxisOperation::getInputAction {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,823] DEBUG - Exit: AxisOperation::getInputAction null {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,823] DEBUG - Entry: AxisOperation::setSoapAction, previous soapAction: null updated soapAction: urn:mediate {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,823] DEBUG - Exit: AxisOperation::setSoapAction {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,823] DEBUG - mapActionToOperation: Mapping Action to Operation: action: out; operation: org.apache.axis2.description.InOutAxisOperation#15f408b5named: mediate {$
[2017-01-27 13:29:44,823] DEBUG - DEBUG_FRAME = org.apache.axis2.util.JavaUtils.callStackToString(JavaUtils.java:564)
[2017-01-27 13:29:44,824] DEBUG - mapActionToOperation: Mapping Action to Operation: action: in; operation: org.apache.axis2.description.InOutAxisOperation#15f408b5named: mediate {o$
[2017-01-27 13:29:44,824] DEBUG - DEBUG_FRAME = org.apache.axis2.util.JavaUtils.callStackToString(JavaUtils.java:564)
[2017-01-27 13:29:44,824] DEBUG - mapActionToOperation: Mapping Action to Operation: action: mediate; operation: org.apache.axis2.description.InOutAxisOperation#15f408b5named: media$
[2017-01-27 13:29:44,824] DEBUG - DEBUG_FRAME = org.apache.axis2.util.JavaUtils.callStackToString(JavaUtils.java:564)
[2017-01-27 13:29:44,824] DEBUG - Entry: AxisOperation::getInputAction {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,824] DEBUG - Debug: AxisOperation::getInputAction - using soapAction {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,824] DEBUG - Exit: AxisOperation::getInputAction urn:mediate {org.apache.axis2.description.AxisOperation}
[2017-01-27 13:29:44,824] DEBUG - mapActionToOperation: Mapping Action to Operation: action: urn:mediate; operation: org.apache.axis2.description.InOutAxisOperation#15f408b5named: m$
[2017-01-27 13:29:44,824] DEBUG - DEBUG_FRAME = org.apache.axis2.util.JavaUtils.callStackToString(JavaUtils.java:564)
[2017-01-27 13:29:44,825] DEBUG - Will not evaluate the value of the remote entry with a key conf:/ws-policy/Secure_XXXXXXXX.xml, because the registry is not availabl$
[2017-01-27 13:29:44,825] WARN - Cannot convert null to a StreamSource {org.apache.synapse.config.SynapseConfigUtils}
[2017-01-27 13:29:44,825] ERROR - ProxyService Deployment from the file : /usr/local/wso2/wso2esb-4.9.0/tmp/carbonapps/-1234/1485485984115XXXXXXX_Deploy_.car/Authenticate_XXXXXXXX
org.apache.synapse.SynapseException: Cannot convert null to a StreamSource
at org.apache.synapse.config.SynapseConfigUtils.handleException(SynapseConfigUtils.java:578)
at org.apache.synapse.config.SynapseConfigUtils.getStreamSource(SynapseConfigUtils.java:79)
at org.apache.synapse.core.axis2.ProxyService.getPolicyFromKey(ProxyService.java:822)
at org.apache.synapse.core.axis2.ProxyService.buildAxisService(ProxyService.java:608)
at org.apache.synapse.deployers.ProxyServiceDeployer.deploySynapseArtifact(ProxyServiceDeployer.java:80)
at org.wso2.carbon.proxyadmin.ProxyServiceDeployer.deploySynapseArtifact(ProxyServiceDeployer.java:46)
Turns out that the {$CARBON}/repository/deployment/server/synapse-configs/default/registry.xml file was missing on my install. I have no idea how that happened. Replacing from original install archive solved the issue.
Related
I have installed wso2 EI 6.6.0 in Ubuntu OS. Setting up the message broker profile is done as described here
Profile started and URL got in logs, But the management console is not accessible by using that URL.
Logs:
CARBON_HOME environment variable is set to /usr/lib/wso2/wso2ei/6.6.0/wso2/broker
Using Java memory options: -Xms256m -Xmx1024m
andes [org.wso2.andes.wso2.internal.QpidBundleActivator] INFO : Setting BundleContext in PluginManager
callhome [org.wso2.callhome.internal.CallHomeActivator] DEBUG : Activating CallHome agent
[2022-05-18 16:34:43,814] INFO {org.ops4j.pax.logging.spi.support.EventAdminConfigurationNotifier} - Sending Event Admin nofification (configuration successful) to org/ops4j/pax/logging/Configuration
[2022-05-18 16:34:44,195] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Starting WSO2 Carbon...
[2022-05-18 16:34:44,207] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Operating System : Linux 5.4.0-110-generic, amd64
[2022-05-18 16:34:44,208] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Home : /usr/lib/wso2/wso2ei/6.6.0/jdk/jdk1.8.0_211/jre
[2022-05-18 16:34:44,209] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Version : 1.8.0_211
[2022-05-18 16:34:44,209] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java VM : Java HotSpot(TM) 64-Bit Server VM 25.211-b12,Oracle Corporation
[2022-05-18 16:34:44,210] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Carbon Home : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker
[2022-05-18 16:34:44,210] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Temp Dir : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/tmp
[2022-05-18 16:34:44,210] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - User : wso2, en-null, Etc/UTC
[2022-05-18 16:34:44,407] INFO {org.wso2.carbon.crypto.provider.internal.DefaultCryptoProviderComponent} - 'CryptoService.Secret' property has not been set. 'org.wso2.carbon.crypto.provider.SymmetricKeyInternalCryptoProvider' won't be registered as an internal crypto provider. Please set the secret if the provider needs to be registered.
[2022-05-18 16:34:46,860] WARN {org.wso2.carbon.registry.core.config.RegistryConfigurationProcessor} - Could not find the handler class org.wso2.carbon.mediation.library.RegistryCachingHandler. This handler will not be registered. All handler and filter classes should be in the class path of the Registry.
[2022-05-18 16:34:46,944] INFO {org.wso2.carbon.registry.core.jdbc.EmbeddedRegistryService} - Configured Registry in 78ms
[2022-05-18 16:34:47,031] INFO {org.wso2.carbon.registry.core.internal.RegistryCoreServiceComponent} - Registry Mode : READ-WRITE
[2022-05-18 16:34:47,040] INFO {org.wso2.andes.configuration.AndesConfigurationManager} - Main andes configuration located at : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/conf/broker.xml
[2022-05-18 16:34:47,164] INFO {org.wso2.andes.configuration.AndesConfigurationManager} - Main andes configuration located at : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/conf/broker.xml
[2022-05-18 16:34:47,229] INFO {org.wso2.carbon.metrics.impl.util.JDBCReporterBuilder} - Creating JDBC reporter for Metrics with source 'powercorewsodev', data source 'jdbc/WSO2MetricsDB' and 60 seconds polling period
[2022-05-18 16:34:47,232] INFO {org.wso2.carbon.metrics.impl.util.JmxReporterBuilder} - Creating JMX reporter for Metrics with domain 'org.wso2.carbon.metrics'
[2022-05-18 16:34:47,239] INFO {org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started JMX reporter for Metrics
[2022-05-18 16:34:47,247] INFO {org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started JDBC reporter for Metrics
[2022-05-18 16:34:49,277] INFO {org.wso2.carbon.registry.indexing.solr.SolrClient} - Default Embedded Solr Server Initialized
[2022-05-18 16:34:49,615] INFO {org.wso2.carbon.user.core.internal.UserStoreMgtDSComponent} - Carbon UserStoreMgtDSComponent activated successfully.
[2022-05-18 16:34:50,270] INFO {org.wso2.carbon.identity.user.store.configuration.deployer.UserStoreConfigurationDeployer} - User Store Configuration Deployer initiated.
[2022-05-18 16:34:50,272] INFO {org.wso2.carbon.identity.user.store.configuration.deployer.UserStoreConfigurationDeployer} - User Store Configuration Deployer initiated.
[2022-05-18 16:34:53,903] INFO {org.wso2.carbon.core.init.CarbonServerManager} - Repository : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/repository/deployment/server/
[2022-05-18 16:34:53,921] INFO {org.wso2.carbon.andes.core.internal.ds.QueueManagerServiceDS} - Successfully created the queue manager service
[2022-05-18 16:34:53,929] INFO {org.wso2.carbon.andes.core.internal.ds.SubscriptionManagerServiceDS} - Successfully created the subscription manager service
[2022-05-18 16:34:53,988] INFO {org.wso2.carbon.core.multitenancy.eager.TenantLoadingConfig} - Using tenant lazy loading policy...
[2022-05-18 16:34:54,006] INFO {org.wso2.carbon.core.internal.permission.update.PermissionUpdater} - Permission cache updated for tenant -1234
[2022-05-18 16:34:54,472] INFO {org.wso2.andes.configuration.AndesConfigurationManager} - Main andes configuration located at : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/conf/broker.xml
[2022-05-18 16:34:54,493] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - Activating Andes Message Broker Engine...
[2022-05-18 16:34:54,509] INFO {org.wso2.andes.server.Broker} - Starting Qpid using configuration : /usr/lib/wso2/wso2ei/6.6.0/wso2/broker/conf/advanced/qpid-config.xml
[2022-05-18 16:34:54,554] INFO {org.wso2.andes.server.registry.ApplicationRegistry} - Initialising Application Registry(org.wso2.andes.server.registry.ConfigurationFileApplicationRegistry#3c636fa7)
[2022-05-18 16:34:54,585] INFO {org.wso2.andes.server.plugins.PluginManager} - Opened service trackers
[Broker] BRK-1001 : Startup : Version: 0.11 Build: 90784:90849
[2022-05-18 16:34:54,699] INFO {org.wso2.andes.server.management.JMXManagedObjectRegistry} - Initialising managed object registry using jplatform MBean server
[2022-05-18 16:34:54,706] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - PrincipalDatabase concrete implementation : org.wso2.carbon.andes.authentication.andes.CarbonBasedPrincipalDatabase
[2022-05-18 16:34:54,712] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Initialised PLAIN SASL provider successfully
[2022-05-18 16:34:54,714] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Additional SASL providers successfully registered.
[2022-05-18 16:34:54,715] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Registering UserManagementMBean
[Broker] MNG-1001 : Startup
[Broker] MNG-1004 : Ready : Using the platform JMX Agent
[2022-05-18 16:34:54,810] INFO {org.wso2.andes.store.rdbms.RDBMSConnection} - JDBC connection established with jndi config WSO2MBStoreDB
[2022-05-18 16:34:54,829] INFO {org.wso2.andes.store.rdbms.RDBMSAndesContextStoreImpl} - Andes Context Store initialised
[2022-05-18 16:34:54,830] INFO {org.wso2.andes.kernel.AndesKernelBoot} - AndesContextStore initialised with org.wso2.andes.store.rdbms.RDBMSAndesContextStoreImpl
[2022-05-18 16:34:54,846] INFO {org.wso2.andes.store.rdbms.RDBMSConnection} - JDBC connection established with jndi config WSO2MBStoreDB
[2022-05-18 16:34:54,910] INFO {org.wso2.andes.store.rdbms.RDBMSMessageStoreImpl} - Message Store initialised
[2022-05-18 16:34:54,912] INFO {org.wso2.andes.kernel.AndesKernelBoot} - Andes MessageStore initialised with org.wso2.andes.store.rdbms.RDBMSMessageStoreImpl
[2022-05-18 16:34:54,968] INFO {org.wso2.andes.server.cluster.ClusterManager} - Initializing Standalone Mode. Current Node ID:NODE:powercorewsodev/127.0.1.1 127.0.1.1
[2022-05-18 16:34:55,115] INFO {org.wso2.andes.kernel.Andes} - Andes API initialised.
[2022-05-18 16:34:55,164] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: Internel_channel)
[2022-05-18 16:34:55,176] INFO {org.wso2.andes.kernel.AndesKernelBoot} - Syncing exchanges, queues, bindings and subscriptions
[2022-05-18 16:34:55,187] INFO {org.wso2.andes.kernel.disruptor.inbound.InboundDBSyncRequestEvent} - Running DB sync task.
[2022-05-18 16:34:55,189] WARN {org.wso2.andes.kernel.disruptor.inbound.InboundDBSyncRequestEvent} - Recovering node. Adding exchange messageRouterName=amq.dlc,type=DLC,autoDelete=false
[2022-05-18 16:34:55,190] INFO {org.wso2.andes.kernel.Andes} - Starting Safe Zone Calculator for slots.
[2022-05-18 16:34:55,192] INFO {org.wso2.andes.kernel.AndesContextInformationManager} - Message Router Sync [create]: amq.dlc
[2022-05-18 16:34:55,193] WARN {org.wso2.andes.kernel.disruptor.inbound.InboundDBSyncRequestEvent} - Recovering node. Adding queue to queue registry queueName=deadletterchannel,queueOwner=admin,isExclusive=false,isDurable=true,isShared=false,lastPurgedTimestamp=0
[2022-05-18 16:34:55,272] INFO {org.wso2.andes.kernel.AndesContextInformationManager} - Queue Sync [create]: deadletterchannel
[2022-05-18 16:34:55,276] WARN {org.wso2.andes.kernel.disruptor.inbound.InboundDBSyncRequestEvent} - Recovering node. Adding binding [Binding]E=amq.dlc/Q=deadletterchannel/RK=deadletterchannel/D=true/EX=false
[2022-05-18 16:34:55,284] INFO {org.wso2.andes.kernel.AndesContextInformationManager} - Binding Sync [create]: [Binding]E=amq.dlc/Q=deadletterchannel/RK=deadletterchannel/D=true/EX=false
[Broker] BRK-1002 : Starting : Listening on TCP port 5675
[2022-05-18 16:34:55,296] INFO {qpid.message.broker.listening} - [Broker] BRK-1002 : Starting : Listening on TCP port 5675
[2022-05-18 16:34:55,309] WARN {org.wso2.andes.configuration.AndesConfigurationManager} - Error when trying to read property : transports/amqp/sslConnection/ciphers. Switching to default value :
[Broker] BRK-1002 : Starting : Listening on TCP/SSL port 8675
[2022-05-18 16:34:55,315] INFO {qpid.message.broker.listening} - [Broker] BRK-1002 : Starting : Listening on TCP/SSL port 8675
[Broker] BRK-1004 : Qpid Broker Ready
[2022-05-18 16:34:55,320] INFO {org.wso2.andes.kernel.MessagingEngine} - Starting SlotDelivery Workers.
[2022-05-18 16:34:55,321] INFO {org.wso2.andes.task.TaskExecutorService} - Starting task manager. Task count 0
[2022-05-18 16:34:55,326] INFO {org.wso2.andes.kernel.MessagingEngine} - Start Disruptor writing messages to store.
[2022-05-18 16:34:55,411] INFO {org.wso2.andes.mqtt.MQTTopicManager} - MQTT andes connecting bridge initialized successfully
[2022-05-18 16:34:55,538] INFO {org.dna.mqtt.moquette.server.netty.NettyAcceptor} - Server binded host: 0.0.0.0, port: 1886
[2022-05-18 16:34:55,551] INFO {org.dna.mqtt.moquette.server.netty.NettyAcceptor} - Starting SSL on port 8886
[2022-05-18 16:34:55,553] INFO {org.dna.mqtt.moquette.server.netty.NettyAcceptor} - Server binded host: 0.0.0.0, port: 8886
[2022-05-18 16:34:55,560] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - AMQP Host Address : 0.0.0.0 Port : 5675
[2022-05-18 16:34:55,561] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - Successfully connected to AMQP server on port 5675
[2022-05-18 16:34:55,562] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - MQTT Host Address : 0.0.0.0 Port : 1886
[2022-05-18 16:34:55,563] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - Successfully connected to MQTT server on port 1886
[2022-05-18 16:34:55,564] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - WSO2 Message Broker is started.
[2022-05-18 16:34:56,020] INFO {org.wso2.carbon.core.deployment.DeploymentInterceptor} - Deploying Axis2 service: echo {super-tenant}
[2022-05-18 16:34:56,047] INFO {org.wso2.carbon.core.deployment.DeploymentInterceptor} - Deploying Axis2 service: Version {super-tenant}
[2022-05-18 16:34:56,057] INFO {org.wso2.carbon.core.transports.http.HttpTransportListener} - HTTP port : 9766
[2022-05-18 16:34:56,063] INFO {org.wso2.carbon.core.transports.http.HttpsTransportListener} - HTTPS port : 9446
[2022-05-18 16:34:56,278] INFO {org.wso2.carbon.core.init.JMXServerManager} - JMX Service URL : service:jmx:rmi://localhost:11114/jndi/rmi://localhost:10002/jmxrmi
[2022-05-18 16:34:56,282] INFO {org.wso2.carbon.core.internal.StartupFinalizerServiceComponent} - Server : WSO2 Message Broker-3.2.0
[2022-05-18 16:34:56,284] INFO {org.wso2.carbon.core.internal.StartupFinalizerServiceComponent} - WSO2 Carbon started in 17 sec
[2022-05-18 16:34:56,286] INFO {org.wso2.callhome.internal.CallHomeObserver} -
..............................................................................
There are 234 updates available for the product 'wso2ei-6.6.0'.[WARNING] There
are 50 critical security updates for the product 'wso2ei-6.6.0'. WSO2 strongly
recommends to apply these updates in production as soon as possible.
..............................................................................
[2022-05-18 16:34:57,026] INFO {org.wso2.carbon.ui.internal.CarbonUIServiceComponent} - Mgt Console URL : https://10.140.0.11:9446/carbon/
Note: No error on logs and some WARN message also got. In logs I have given some invalid URL
Can anyone please check log and let me know reason why url is not accessible?
I installed wso2am-3.0.0 as a service on linux machine and i changed the default database to mysql by editing the master-datasources.xml file. However, when i start the service by running sudo service wso2am-3.0.0 start, I got stucked here as shown below:
TID: [2020-02-19 00:16:22,738] INFO {org.wso2.config.mapper.ConfigParser} - Applying Configurations upon new Templates {org.wso2.config.mapper.ConfigParser}
TID: [2020-02-19 00:16:22,739] WARN {org.wso2.config.mapper.ConfigParser} - Configurations Changed in :repository/conf/datasources/master-datasources.xml {org.wso2.config.mapper.ConfigParser}
TID: [2020-02-19 00:16:22,739] WARN {org.wso2.config.mapper.ConfigParser} - Configurations Changed in :repository/conf/carbon.xml {org.wso2.config.mapper.ConfigParser}
TID: [2020-02-19 00:16:22,739] WARN {org.wso2.config.mapper.ConfigParser} - Overriding files in configuration directory /usr/lib/wso2/wso2am/3.0.0 {org.wso2.config.mapper.ConfigParser}
And nothing else happens
From API Manager v3.0.0, we have introduced a new configuration model where now you have a deployment.toml to configure. You don't need to touch any xml config files. deployment.toml can be found in repository/conf location. Although you change the configs in xml files, those will be overridden when server starts up.
Please refer how you can change databases to mysql - https://apim.docs.wso2.com/en/3.0.0/InstallAndSetup/SettingUpDatabases/ChangingDefaultDatabases/changing-to-mysql/
I have WSO2 ESB (4.9.0) and WS02 MB (3.1.0) installed on a mounted drive on a server running Ubuntu 16.04.5 LTS.
The ESB has API endpoints configured that of which push received data to the message broker upon a post request. This process was working flawlessly until I updated the server via the typical update commands i.e. sudo apt-get update,
sudo apt-get upgrade,
sudo apt-get dist-upgrade followed by a system reboot.
Upon rebooting and starting the MB followed by the ESB (both manually via sh wso2server.sh), I receive the following error from the ESB:
ERROR - JMSConnectionFactory JMS Exception while creating connection through factory 'QueueConnectionFactory' Could not connect to broker URL: tcp://localhost:61616. Reason: java.net.ConnectException: Connection refused (Connection refused)
WARN - JMSPollingConsumer Inbound JMS endpoint unable to get a connection.
This obviously prevents the ESB sending messages to the MB. What could be causing this?
On a side note, attempting the same process via a non-root account results in the following error:
Error: JAVA_HOME is not defined correctly. CARBON cannot execute java
Message Broker log as root (Sections are omitted):
root#[REDACTED]:/mnt/wso2mb-3.1.0/wso2mb-3.1.0/bin# sh wso2server.sh
JAVA_HOME environment variable is set to /usr/lib/jvm/java-8-oracle
CARBON_HOME environment variable is set to /mnt/wso2mb-3.1.0/wso2mb-3.1.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
[2019-02-06 14:01:34,947] WARN {org.apache.axiom.util.stax.dialect.StAXDialectDetector} - Unable to determine dialect of the StAX implementation at bundleresource://13.fwk1845904670/
[2019-02-06 14:01:34,947] WARN {org.apache.axiom.util.stax.dialect.StAXDialectDetector} - Unable to determine dialect of the StAX implementation at bundleresource://13.fwk1845904670/
INFO {org.wso2.andes.wso2.internal.QpidBundleActivator} - Setting BundleContext in PluginManager
[2019-02-06 14:01:35,921] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Starting WSO2 Carbon...
[2019-02-06 14:01:35,922] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Operating System : Linux 4.4.0-141-generic, amd64
[2019-02-06 14:01:35,922] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Home : /usr/lib/jvm/java-8-oracle/jre
[2019-02-06 14:01:35,923] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Version : 1.8.0_201
[2019-02-06 14:01:35,923] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java VM : Java HotSpot(TM) 64-Bit Server VM 25.201-b09,Oracle Corporation
[2019-02-06 14:01:35,923] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Carbon Home : /mnt/wso2mb-3.1.0/wso2mb-3.1.0
[2019-02-06 14:01:35,924] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Temp Dir : /mnt/wso2mb-3.1.0/wso2mb-3.1.0/tmp
[2019-02-06 14:01:35,924] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - User : root, en-GB, Etc/GMT
[2019-02-06 14:01:36,067] WARN {org.wso2.carbon.core.bootup.validator.util.ValidationResultPrinter} - Carbon is configured to use the default keystore (wso2carbon.jks). To maximize security when deploying to a production environment, configure a new keystore with a unique password in the production server profile.
[2019-02-06 14:01:36,073] INFO {org.wso2.carbon.databridge.agent.thrift.AgentHolder} - Agent created !
[2019-02-06 14:01:36,093] INFO {org.wso2.carbon.databridge.agent.thrift.internal.AgentDS} - Successfully deployed Agent Client
[2019-02-06 14:01:37,935] INFO {org.wso2.carbon.registry.core.jdbc.EmbeddedRegistryService} - Configured Registry in 107ms
[2019-02-06 14:01:38,014] INFO {org.wso2.carbon.registry.core.internal.RegistryCoreServiceComponent} - Registry Mode : READ-WRITE
[2019-02-06 14:01:38,078] INFO {org.wso2.carbon.metrics.impl.util.JDBCReporterBuilder} - Creating JDBC reporter for Metrics with source '[REDACTED]', data source 'jdbc/WSO2MetricsDB' and 60 seconds polling period
[2019-02-06 14:01:38,079] INFO {org.wso2.carbon.metrics.impl.util.JmxReporterBuilder} - Creating JMX reporter for Metrics with domain 'org.wso2.carbon.metrics'
[2019-02-06 14:01:38,090] INFO {org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started JDBC reporter for Metrics
[2019-02-06 14:01:38,090] INFO {org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started JMX reporter for Metrics
[2019-02-06 14:01:38,327] INFO {org.wso2.carbon.user.core.internal.UserStoreMgtDSComponent} - Carbon UserStoreMgtDSComponent activated successfully.
[2019-02-06 14:01:45,805] INFO {org.apache.axis2.deployment.ClusterBuilder} - Clustering has been disabled
[2019-02-06 14:01:45,966] INFO {org.wso2.carbon.identity.user.store.configuration.deployer.UserStoreConfigurationDeployer} - User Store Configuration Deployer initiated.
[2019-02-06 14:01:45,966] INFO {org.wso2.carbon.identity.user.store.configuration.deployer.UserStoreConfigurationDeployer} - User Store Configuration Deployer initiated.
[2019-02-06 14:01:46,056] INFO {org.apache.axis2.deployment.ModuleDeployer} - Deploying module: addressing-1.6.1-wso2v16 - file:/mnt/wso2mb-3.1.0/wso2mb-3.1.0/repository/deployment/client/modules/addressing-1.6.1-wso2v16.mar
[2019-02-06 14:01:46,060] INFO {org.apache.axis2.deployment.ModuleDeployer} - Deploying module: rampart-1.6.1-wso2v10 - file:/mnt/wso2mb-3.1.0/wso2mb-3.1.0/repository/deployment/client/modules/rampart-1.6.1-wso2v10.mar
[2019-02-06 14:01:46,334] INFO {org.apache.axis2.deployment.DeploymentEngine} - Deploying Web service: org.wso2.carbon.andes.admin-3.1.1 -
[2019-02-06 14:01:46,368] INFO {org.apache.axis2.deployment.DeploymentEngine} - Deploying Web service: org.wso2.carbon.andes.event.admin-3.1.1 -
[2019-02-06 14:01:46,710] WARN {org.apache.axis2.description.java2wsdl.DefaultSchemaGenerator} - We don't support method overloading. Ignoring [validateAudienceRestriction]
[2019-02-06 14:01:47,285] INFO {org.apache.axis2.deployment.DeploymentEngine} - Deploying Web service: org.wso2.carbon.tryit-4.4.8 -
[2019-02-06 14:01:47,471] INFO {org.wso2.carbon.core.init.CarbonServerManager} - Repository : /mnt/wso2mb-3.1.0/wso2mb-3.1.0/repository/deployment/server/
[2019-02-06 14:01:47,485] INFO {org.wso2.carbon.andes.core.internal.ds.QueueManagerServiceDS} - Successfully created the queue manager service
[2019-02-06 14:01:47,489] INFO {org.wso2.carbon.andes.core.internal.ds.SubscriptionManagerServiceDS} - Successfully created the subscription manager service
[2019-02-06 14:01:47,539] INFO {org.wso2.carbon.core.multitenancy.eager.TenantLoadingConfig} - Using tenant lazy loading policy...
[2019-02-06 14:01:47,549] INFO {org.wso2.carbon.core.internal.permission.update.PermissionUpdater} - Permission cache updated for tenant -1234
[2019-02-06 14:01:47,607] INFO {org.wso2.andes.configuration.AndesConfigurationManager} - Main andes configuration located at : /mnt/wso2mb-3.1.0/wso2mb-3.1.0/repository/conf/broker.xml
[2019-02-06 14:01:47,714] INFO {org.wso2.carbon.andes.internal.QpidServiceComponent} - Activating Andes Message Broker Engine...
[2019-02-06 14:01:47,728] INFO {org.wso2.andes.server.Broker} - Starting Qpid using configuration : /mnt/wso2mb-3.1.0/wso2mb-3.1.0/repository/conf/advanced/qpid-config.xml
[2019-02-06 14:01:47,759] INFO {org.wso2.andes.server.registry.ApplicationRegistry} - Initialising Application Registry(org.wso2.andes.server.registry.ConfigurationFileApplicationRegistry#683c51f5)
[2019-02-06 14:01:47,782] INFO {org.wso2.andes.server.plugins.PluginManager} - Opened service trackers
[Broker] BRK-1001 : Startup : Version: 0.11 Build: 90784:90849
[2019-02-06 14:01:47,891] INFO {org.wso2.andes.server.management.JMXManagedObjectRegistry} - Initialising managed object registry using jplatform MBean server
[2019-02-06 14:01:47,896] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - PrincipalDatabase concrete implementation : org.wso2.carbon.andes.authentication.andes.CarbonBasedPrincipalDatabase
[2019-02-06 14:01:47,900] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Initialised PLAIN SASL provider successfully
[2019-02-06 14:01:47,900] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Additional SASL providers successfully registered.
[2019-02-06 14:01:47,900] INFO {org.wso2.andes.server.security.auth.manager.PrincipalDatabaseAuthenticationManager} - Registering UserManagementMBean
[Broker] MNG-1001 : Startup
[Broker] MNG-1004 : Ready : Using the platform JMX Agent
[2019-02-06 14:01:48,003] INFO {org.wso2.andes.store.rdbms.RDBMSConnection} - JDBC connection established with jndi config WSO2MBStoreDB
[2019-02-06 14:01:48,017] INFO {org.wso2.andes.store.rdbms.RDBMSAndesContextStoreImpl} - Andes Context Store initialised
[2019-02-06 14:01:48,017] INFO {org.wso2.andes.kernel.AndesKernelBoot} - AndesContextStore initialised with org.wso2.andes.store.rdbms.RDBMSAndesContextStoreImpl
[2019-02-06 14:01:48,040] INFO {org.wso2.andes.store.rdbms.RDBMSConnection} - JDBC connection established with jndi config WSO2MBStoreDB
[2019-02-06 14:01:48,067] INFO {org.wso2.andes.store.rdbms.RDBMSMessageStoreImpl} - Message Store initialised
[2019-02-06 14:01:48,067] INFO {org.wso2.andes.kernel.AndesKernelBoot} - Andes MessageStore initialised with org.wso2.andes.store.rdbms.RDBMSMessageStoreImpl
[2019-02-06 14:01:48,144] INFO {org.wso2.andes.kernel.Andes} - Andes API initialised.
INFO {org.wso2.carbon.core.init.JMXServerManager} - JMX Service URL : service:jmx:rmi://localhost:11112/jndi/rmi://localhost:10000/jmxrmi
[2019-02-06 14:01:49,974] INFO {org.wso2.carbon.core.internal.StartupFinalizerServiceComponent} - Server : WSO2 Message Broker-3.1.0
[2019-02-06 14:01:49,975] INFO {org.wso2.carbon.core.internal.StartupFinalizerServiceComponent} - WSO2 Carbon started in 16 sec
[2019-02-06 14:01:50,176] INFO {org.wso2.carbon.ui.internal.CarbonUIServiceComponent} - Mgt Console URL : https://[REDACTED]:9444/carbon/
[2019-02-06 14:06:45,627] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53018)
[2019-02-06 14:06:45,743] INFO {org.wso2.andes.subscription.SubscriptionEngine} - Local subscription ADDED [[REDACTED]]ID=0#[REDACTED]/[REDACTED]/T=1549462005677/D=true/X=false/O=null/E=amq.direct/ET=org.wso2.andes.server.exchange.DirectExchange$1#61094da2/EUD=0/S=true
[2019-02-06 14:06:46,630] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53022)
[2019-02-06 14:06:46,663] INFO {org.wso2.andes.subscription.SubscriptionEngine} - Local subscription ADDED [[REDACTED]]ID=1#[REDACTED]/[REDACTED]/T=1549462006662/D=true/X=false/O=null/E=amq.direct/ET=org.wso2.andes.server.exchange.DirectExchange$1#61094da2/EUD=0/S=true
[2019-02-06 14:06:47,636] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53026)
[2019-02-06 14:06:48,677] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53030)
[2019-02-06 14:06:49,678] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53034)
[2019-02-06 14:06:49,691] INFO {org.wso2.andes.subscription.SubscriptionEngine} - Local subscription ADDED [[REDACTED]]ID=4#[REDACTED]/[REDACTED]/T=1549462009690/D=true/X=false/O=null/E=amq.direct/ET=org.wso2.andes.server.exchange.DirectExchange$1#61094da2/EUD=0/S=true
[2019-02-06 14:06:50,689] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53040)
[2019-02-06 14:06:50,762] INFO {org.wso2.andes.subscription.SubscriptionEngine} - Local subscription ADDED [[REDACTED]]ID=5#[REDACTED]/[REDACTED]/T=1549462010761/D=false/X=true/O=clientID/E=amq.topic/ET=org.wso2.andes.server.exchange.TopicExchange$1#74034026/EUD=0/S=true
[2019-02-06 14:06:51,719] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53044)
[2019-02-06 14:06:52,739] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53048)
[2019-02-06 14:06:53,784] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53052)
[2019-02-06 14:06:54,771] INFO {org.wso2.andes.kernel.AndesChannel} - Channel created (ID: 127.0.0.1:53056)
[2019-02-06 14:06:54,784] INFO {org.wso2.andes.subscription.SubscriptionEngine} - Local subscription ADDED [[REDACTED]]ID=9#[REDACTED]/[REDACTED]/T=1549462014782/D=true/X=false/O=null/E=amq.direct/ET=org.wso2.andes.server.exchange.DirectExchange$1#61094da2/EUD=0/S=true
ESB log as root (Sections are omitted):
root#[REDACTED]:/mnt/wso2esb-4.9.0/wso2esb-4.9.0/bin# sh wso2server.sh
JAVA_HOME environment variable is set to /usr/lib/jvm/java-8-oracle
CARBON_HOME environment variable is set to /mnt/wso2esb-4.9.0/wso2esb-4.9.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
[2019-02-06 14:06:27,453] INFO - CarbonCoreActivator Starting WSO2 Carbon...
[2019-02-06 14:06:27,458] INFO - CarbonCoreActivator Operating System : Linux 4.4.0-141-generic, amd64
[2019-02-06 14:06:27,458] INFO - CarbonCoreActivator Java Home : /usr/lib/jvm/java-8-oracle/jre
[2019-02-06 14:06:27,459] INFO - CarbonCoreActivator Java Version : 1.8.0_201
[2019-02-06 14:06:27,459] INFO - CarbonCoreActivator Java VM : Java HotSpot(TM) 64-Bit Server VM 25.201-b09,Oracle Corporation
[2019-02-06 14:06:27,459] INFO - CarbonCoreActivator Carbon Home : /mnt/wso2esb-4.9.0/wso2esb-4.9.0
[2019-02-06 14:06:27,459] INFO - CarbonCoreActivator Java Temp Dir : /mnt/wso2esb-4.9.0/wso2esb-4.9.0/tmp
[2019-02-06 14:06:27,460] INFO - CarbonCoreActivator User : root, en-GB, Etc/GMT
[2019-02-06 14:06:27,629] WARN - ValidationResultPrinter Carbon is configured to use the default keystore (wso2carbon.jks). To maximize security when deploying to a production environment, configure a new keystore with a unique password in the production server profile.
[2019-02-06 14:06:27,639] INFO - AgentHolder Agent created !
[2019-02-06 14:06:27,671] INFO - AgentDS Successfully deployed Agent Client
[2019-02-06 14:06:30,171] INFO - EmbeddedRegistryService Configured Registry in 81ms
[2019-02-06 14:06:30,221] INFO - RegistryCoreServiceComponent Registry Mode : READ-WRITE
[2019-02-06 14:06:32,887] INFO - SolrClient Default Embedded Solr Server Initialized
[2019-02-06 14:06:33,288] INFO - UserStoreMgtDSComponent Carbon UserStoreMgtDSComponent activated successfully.
[2019-02-06 14:06:40,096] INFO - TaglibUriRule TLD skipped. URI: http://tiles.apache.org/tags-tiles is already defined
[2019-02-06 14:06:40,764] INFO - ClusterBuilder Clustering has been disabled
[2019-02-06 14:06:40,926] INFO - UserStoreConfigurationDeployer User Store Configuration Deployer initiated.
[2019-02-06 14:06:40,926] INFO - UserStoreConfigurationDeployer User Store Configuration Deployer initiated.
[2019-02-06 14:06:40,949] INFO - JMSSender JMS Sender started
[2019-02-06 14:06:40,951] INFO - JMSSender JMS Transport Sender initialized...
[2019-02-06 14:06:40,951] INFO - PassThroughHttpSender Initializing Pass-through HTTP/S Sender...
[2019-02-06 14:06:40,996] INFO - PassThroughHttpSender Pass-through HTTP Sender started...
[2019-02-06 14:06:40,997] INFO - PassThroughHttpSSLSender Initializing Pass-through HTTP/S Sender...
[2019-02-06 14:06:41,002] INFO - ClientConnFactoryBuilder HTTPS Loading Identity Keystore from : repository/resources/security/wso2carbon.jks
[2019-02-06 14:06:41,007] INFO - ClientConnFactoryBuilder HTTPS Loading Trust Keystore from : repository/resources/security/client-truststore.jks
[2019-02-06 14:06:41,010] INFO - PassThroughHttpSSLSender Pass-through HTTPS Sender started...
[2019-02-06 14:06:41,060] INFO - JMSConnectionFactory JMS ConnectionFactory : myTopicConnectionFactory initialized
[2019-02-06 14:06:41,061] INFO - JMSConnectionFactory JMS ConnectionFactory : default initialized
[2019-02-06 14:06:41,062] INFO - JMSConnectionFactory JMS ConnectionFactory : myQueueConnectionFactory initialized
[2019-02-06 14:06:41,062] INFO - JMSListener JMS Transport Receiver/Listener initialized...
[2019-02-06 14:06:41,063] INFO - PassThroughHttpListener Initializing Pass-through HTTP/S Listener...
[2019-02-06 14:06:41,095] INFO - PassThroughHttpSSLListener Initializing Pass-through HTTP/S Listener...
[2019-02-06 14:06:41,175] INFO - ModuleDeployer Deploying module: addressing-1.6.1-wso2v14 - file:/mnt/wso2esb-4.9.0/wso2esb-4.9.0/repository/deployment/client/modules/addressing-1.6.1-wso2v14.mar
[2019-02-06 14:06:41,178] INFO - ModuleDeployer Deploying module: rampart-1.6.1-wso2v12 - file:/mnt/wso2esb-4.9.0/wso2esb-4.9.0/repository/deployment/client/modules/rampart-1.6.1-wso2v12.mar
[2019-02-06 14:06:42,074] WARN - DefaultSchemaGenerator We don't support method overloading. Ignoring [validateAudienceRestriction]
[2019-02-06 14:06:42,356] INFO - DeploymentEngine Deploying Web service: org.wso2.carbon.message.processor-4.4.10 -
[2019-02-06 14:06:42,366] INFO - DeploymentEngine Deploying Web service: org.wso2.carbon.message.store-4.4.10 -
[2019-02-06 14:06:42,961] INFO - DeploymentInterceptor Deploying Axis2 service: wso2carbon-sts {super-tenant}
[2019-02-06 14:06:42,983] INFO - DeploymentEngine Deploying Web service: org.wso2.carbon.sts-4.5.6 -
[2019-02-06 14:06:43,089] INFO - DeploymentEngine Deploying Web service: org.wso2.carbon.tryit-4.4.7 -
[2019-02-06 14:06:43,308] INFO - CarbonServerManager Repository : /mnt/wso2esb-4.9.0/wso2esb-4.9.0/repository/deployment/server/
[2019-02-06 14:06:43,442] INFO - TenantLoadingConfig Using tenant lazy loading policy...
[2019-02-06 14:06:43,453] INFO - PermissionUpdater Permission cache updated for tenant -1234
[2019-02-06 14:06:43,511] INFO - RuleEngineConfigDS Successfully registered the Rule Config service
[2019-02-06 14:06:43,550] INFO - ServiceBusInitializer Starting ESB...
[2019-02-06 14:06:43,564] INFO - ServiceBusInitializer Initializing Apache Synapse...
[2019-02-06 14:06:43,571] INFO - SynapseControllerFactory Using Synapse home : /mnt/wso2esb-4.9.0/wso2esb-4.9.0/.
[2019-02-06 14:06:43,573] INFO - SynapseControllerFactory Using synapse.xml location : /mnt/wso2esb-4.9.0/wso2esb-4.9.0/././repository/deployment/server/synapse-configs/default
[2019-02-06 14:06:43,573] INFO - SynapseControllerFactory Using server name : localhost
[2019-02-06 14:06:43,580] INFO - SynapseControllerFactory The timeout handler will run every : 15s
[2019-02-06 14:06:43,594] INFO - Axis2SynapseController Initializing Synapse at : Wed Feb 06 14:06:43 GMT 2019
[2019-02-06 14:06:43,605] INFO - CarbonSynapseController Loading the mediation configuration from the file system
[2019-02-06 14:06:43,608] INFO - MultiXMLConfigurationBuilder Building synapse configuration from the synapse artifact repository at : ././repository/deployment/server/synapse-configs/default
[2019-02-06 14:06:43,613] INFO - XMLConfigurationBuilder Generating the Synapse configuration model by parsing the XML configuration
[2019-02-06 14:06:43,735] INFO - MessageStoreFactory Successfully added Message Store configuration of : [JMSMS].
[2019-02-06 14:06:43,737] INFO - MessageStoreFactory Successfully added Message Store configuration of : [WSO2MS].
[2019-02-06 14:06:43,752] INFO - SynapseConfigurationBuilder Loaded Synapse configuration from the artifact repository at : ././repository/deployment/server/synapse-configs/default
[2019-02-06 14:06:43,756] INFO - Axis2SynapseController Loading mediator extensions...
[2019-02-06 14:06:43,764] INFO - DeploymentInterceptor Deploying Axis2 service: echo {super-tenant}
[2019-02-06 14:06:43,765] INFO - DeploymentEngine Deploying Web service: Echo.aar - file:/mnt/wso2esb-4.9.0/wso2esb-4.9.0/repository/deployment/server/axis2services/Echo.aar
[2019-02-06 14:06:43,774] INFO - DeploymentInterceptor Deploying Axis2 service: Version {super-tenant}
[2019-02-06 14:06:43,775] INFO - DeploymentEngine Deploying Web service: Version.aar - file:/mnt/wso2esb-4.9.0/wso2esb-4.9.0/repository/deployment/server/axis2services/Version.aar
[2019-02-06 14:06:43,775] INFO - Axis2SynapseController Deploying the Synapse service...
[2019-02-06 14:06:43,777] INFO - Axis2SynapseController Deploying Proxy services...
[2019-02-06 14:06:56,493] INFO - JMXServerManager JMX Service URL : service:jmx:rmi://localhost:11111/jndi/rmi://localhost:9999/jmxrmi
[2019-02-06 14:06:56,500] INFO - StartupFinalizerServiceComponent Server : WSO2 Enterprise Service Bus-4.9.0
[2019-02-06 14:06:56,502] INFO - StartupFinalizerServiceComponent WSO2 Carbon started in 33 sec
[2019-02-06 14:06:56,729] INFO - CarbonUIServiceComponent Mgt Console URL : https://[REDACTED]:9443/carbon/
[2019-02-06 14:06:57,206] ERROR - JMSConnectionFactory JMS Exception while creating connection through factory 'QueueConnectionFactory' Could not connect to broker URL: tcp://localhost:61616. Reason: java.net.ConnectException: Connection refused (Connection refused)
[2019-02-06 14:06:57,207] WARN - JMSPollingConsumer Inbound JMS endpoint unable to get a connection.
The following error occurred due to your inbound endpoint trying to connect to the ActiveMQ. The default port of the ActiveMQ is 61616.
[2019-02-06 14:06:57,206] ERROR - JMSConnectionFactory JMS Exception while creating connection through factory 'QueueConnectionFactory' Could not connect to broker URL: tcp://localhost:61616. Reason: java.net.ConnectException: Connection refused (Connection refused)
[2019-02-06 14:06:57,207] WARN - JMSPollingConsumer Inbound JMS endpoint unable to get a connection.
I am not sure how it got changed after server updates. Anyway, you should be able to change the inbound endpoint configuration to work with the WSO2 MB 3.1.0 going through the following documentation [1].
The following error coming because of root doesn't have access to the JAVA_HOME. I mean the environment variable you have set as JAVA_HOME is not visible to the root user.
Error: JAVA_HOME is not defined correctly. CARBON cannot execute java
Hope above information will help to resolve the issue.
[1] https://docs.wso2.com/display/ESB490/Configuring+the+JMS+Inbound+Protocol+with+WSO2+Message+Broker
Cheers!
In order to setup analytical server for API-Manager,i followed exactly same steps as specified in below wso2 documentation.
https://docs.wso2.com/display/AM220/Configuring+APIM+Analytics.
However i am facing below issues while running the API-M And API-Analytic instance.
WSO2 API-M:
[2018-05-08 02:52:05,378] ERROR - DataEndpointConnectionWorker Error while trying to connect to the endpoint. Cannot borrow client
for ssl://localhost:7712
org.wso2.carbon.databridge.agent.exception.DataEndpointAuthenticationException:
Cannot borrow client for ssl://localhost:7712
at org.wso2.carbon.databridge.agent.endpoint.DataEndpointConnectionWorker.connect(DataEndpointConnectionWorker.java:99)
at org.wso2.carbon.databridge.agent.endpoint.DataEndpointConnectionWorker.run(DataEndpointConnectionWorker.java:42)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724) Caused by: org.wso2.carbon.databridge.agent.exception.DataEndpointSecurityException:
Error while trying to connect to ssl://localhost:7712
at org.wso2.carbon.databridge.agent.endpoint.thrift.ThriftSecureClientPoolFactory.createClient(ThriftSecureClientPoolFactory.java:81)
at org.wso2.carbon.databridge.agent.client.AbstractClientPoolFactory.makeObject(AbstractClientPoolFactory.java:39)
at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1212)
at org.wso2.carbon.databridge.agent.endpoint.DataEndpointConnectionWorker.connect(DataEndpointConnectionWorker.java:91)
... 7 more Caused by: org.apache.thrift.transport.TTransportException: Could not connect to
localhost on port 7712
at org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:237)
at org.apache.thrift.transport.TSSLTransportFactory.getClientSocket(TSSLTransportFactory.java:169)
at org.wso2.carbon.databridge.agent.endpoint.thrift.ThriftSecureClientPoolFactory.createClient(ThriftSecureClientPoolFactory.java:63)
... 10 more Caused by: java.net.ConnectException: Connection refused: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:79)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
at sun.security.ssl.SSLSocketImpl.(SSLSocketImpl.java:407)
at sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:88)
at org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:233)
... 12 more [2018-05-08 02:52:34,371] WARN - DataEndpointGroup No receiver is reachable at reconnection, will try
to reconnect every 30 sec [2018-05-08 02:52:35,378] ERROR -
DataEndpointConnectionWorker Error while trying to connect to
ssl://localhost:7712
org.wso2.carbon.databridge.agent.exception.DataEndpointSecurityException:
Error while trying to connect to ssl://localhost:7712
at org.wso2.carbon.databridge.agent.endpoint.thrift.ThriftSecureClientPoolFactory.createClient(ThriftSecureClientPoolFactory.java:81)
at org.wso2.carbon.databridge.agent.client.AbstractClientPoolFactory.makeObject(AbstractClientPoolFactory.java:39)
at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1212)
WSO2 API-Analytic:
JAVA_HOME environment variable is set to C:\Program Files\Java\jdk1.7.0_25 CARBON_HOME environment variable is set to
C:\WSO2AM~4\WSO2AM~1\bin.. Loading spark environment variables
[2018-05-08 02:36:02,932] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - Starting WSO2
Carbon... [2018-05-08 02:36:02,936] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - Operating
System : Windows Server 2008 R2 6.1, amd64 [2018-05-08 02:36:02,936]
INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Home
: C:\Program Files\Java\jdk1.7.0_25\jre [2018-05-08 02:36:02,936]
INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java
Version : 1.7.0_25 [2018-05-08 02:36:02,937] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - Java VM
: Java HotSpot(TM) 64-Bit Server VM 23.25-b01,Oracle Corporation
[2018-05-08 02:36:02,937] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - Carbon Home
: C:\WSO2AM~4\WSO2AM~1\bin.. [2018-05-08 02:36:02,937] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Temp Dir
: C:\WSO2AM~4\WSO2AM~1\bin..\tmp [2018-05-08 02:36:02,937] INFO
{org.wso2.carbon.core.internal.CarbonCoreActivator} - User
: wsoadm_dev_svc, en-US, America/Los_Angeles [2018-05-08 02:36:03,570]
INFO
{org.wso2.carbon.event.output.adapter.kafka.internal.ds.KafkaEventAdapterServiceDS}
- Successfully deployed the Kafka output event adapto [2018-05-08 02:36:03,887] INFO
{org.wso2.carbon.event.template.manager.core.internal.ds.TemplateDeployerServiceTrackerDS}
- Successfully deployed the execution manager [2018-05-08 02:36:15,048] INFO
{org.wso2.carbon.databridge.receiver.binary.internal.BinaryDataReceiver}
- Started Binary SSL Transport on port : 9712 [2018-05-08 02:36:15,050] INFO
{org.wso2.carbon.databridge.receiver.binary.internal.BinaryDataReceiver}
- Started Binary TCP Transport on port : 9612 [2018-05-08 02:36:15,207] INFO
{org.wso2.carbon.databridge.core.internal.DataBridgeDS} -
Successfully deployed Agent Server [2018-05-08 02:36:15,388] INFO
{org.wso2.carbon.registry.core.jdbc.EmbeddedRegistryService} -
Configured Registry in 64ms [2018-05-08 02:36:15,912] INFO
{org.wso2.carbon.registry.core.internal.RegistryCoreServiceComponent}
- Registry Mode : READ-WRITE [2018-05-08 02:36:22,854] INFO {org.wso2.carbon.metrics.impl.util.JmxReporterBuilder} - Creating JMX
reporter for Metrics with domain 'org.wso2.carbon.metrics' [2018-05-08
02:36:22,861] INFO
{org.wso2.carbon.metrics.impl.util.JDBCReporterBuilder} - Creating
JDBC reporter for Metrics with source 'SOADEVV001', data source 'jdbc/
[2018-05-08 02:36:22,862] INFO
{org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started
JMX reporter for Metrics [2018-05-08 02:36:22,870] INFO
{org.wso2.carbon.metrics.impl.reporter.AbstractReporter} - Started
JDBC reporter for Metrics [2018-05-08 02:36:26,352] INFO
{org.wso2.carbon.registry.indexing.solr.SolrClient} - Default
Embedded Solr Server Initialized [2018-05-08 02:36:27,524] INFO
{org.wso2.carbon.user.core.internal.UserStoreMgtDSComponent} - Carbon
UserStoreMgtDSComponent activated successfully.
[2018-05-08 02:37:32,134] WARN {org.wso2.carbon.core.init.CarbonServerManager} - Carbon
initialization is delayed due to the following unsatisfied items:
[2018-05-08 02:37:32,498] WARN
{org.wso2.carbon.core.init.CarbonServerManager} - Waiting for
required OSGi Service: org.apache.axis2.engine.AxisObserver
[2018-05-08 02:38:32,135] WARN
{org.wso2.carbon.core.init.CarbonServerManager} - Carbon
initialization is delayed due to the following unsatisfied items:
Note:I am using same Machine for both API-M and API API-Analytic instance.
For APIM Offset is set to 0 and for API-Analytic it is 1.
I am using default H2 DB for for both.
Any help would be appreciated.
I am deploying WSO2 API Manager 2.1 and Analytics using the Pattern as specified - https://github.com/wso2/docker-apim/tree/master/docker-compose/pattern-3
Here in all the components - nginx, Publisher, Store, Traffic Manager, Gateway Worker, Gateway Manager, Key Manager and Analytics are deployed as separate docker containers.
When I started these containers, it worked fine and by default it was using the mysql server for storing all the data.
But as per our requirement, we had to use the Oracle DB and hence, we created a user in there with all the required permissions and then run the oracle scripts and finally started all the containers one by one.
In addition for Analytics, we created two separate users for two data sources - WSO2_ANALYTICS_EVENT_STORE_DB and WSO2_ANALYTICS_PROCESSED_DATA_STORE_DB (Didnt run any scripts for these).
And now we have a problem with the Analytics COntainer not able to start and throwing the error -
[2017-07-11 12:53:54,017] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Starting WSO2 Carbon...
[2017-07-11 12:53:54,017] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Operating System : Linux 4.8.0-53-generic, amd64
[2017-07-11 12:53:54,017] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Home : /mnt/jdk-7u80/jre
[2017-07-11 12:53:54,017] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Version : 1.7.0_80
[2017-07-11 12:53:54,017] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java VM : Java HotSpot(TM) 64-Bit Server VM 24.80-b11,Oracle Corporation
[2017-07-11 12:53:54,018] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Carbon Home : /mnt/186.12.12.12/wso2am-analytics-2.1.0
[2017-07-11 12:53:54,018] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - Java Temp Dir : /mnt/186.12.12.12/wso2am-analytics-2.1.0/tmp
[2017-07-11 12:53:54,018] INFO {org.wso2.carbon.core.internal.CarbonCoreActivator} - User : root, en-US, GMT
[2017-07-11 12:54:34,104] INFO {org.wso2.carbon.core.internal.permission.update.PermissionUpdater} - Permission cache updated for tenant -1234
[2017-07-11 12:54:34,235] INFO {org.wso2.carbon.core.transports.http.HttpsTransportListener} - HTTPS port : 9444
[2017-07-11 12:54:34,235] INFO {org.wso2.carbon.core.transports.http.HttpTransportListener} - HTTP port : 9764
[2017-07-11 12:54:36,547] INFO {org.wso2.carbon.webapp.mgt.TomcatGenericWebappsDeployer} - Deployed webapp: StandardEngine[Catalina].StandardHost[localhost].StandardContext[/analytics].File[/mnt/186.12.12.12/wso2am-analytics-2.1.0/repository/deployment/server/webapps/analytics.war]
[2017-07-11 12:54:36,593] INFO {org.wso2.carbon.webapp.mgt.TomcatGenericWebappsDeployer} - Deployed webapp: StandardEngine[Catalina].StandardHost[localhost].StandardContext[/inputwebsocket].File[/mnt/186.12.12.12/wso2am-analytics-2.1.0/repository/deployment/server/webapps/inputwebsocket.war]
[2017-07-11 12:54:36,622] INFO {org.wso2.carbon.webapp.mgt.TomcatGenericWebappsDeployer} - Deployed webapp: StandardEngine[Catalina].StandardHost[localhost].StandardContext[/outputwebsocket].File[/mnt/186.12.12.12/wso2am-analytics-2.1.0/repository/deployment/server/webapps/outputwebsocket.war]
[
[2017-07-11 12:54:43,116] INFO {org.wso2.carbon.event.processor.core.EventProcessorDeployer} - Execution plan deployment held back and in inactive state : APIMAnalytics-RequestSummarizer-RequestSummarizer-realtime1.siddhiql, Dependency validation exception: Stream org.wso2.apimgt.statistics.requestsPerMinPerKeyStream:1.0.0 does not exist
[2017-07-11 12:54:43,186] INFO {org.wso2.carbon.event.processor.core.EventProcessorDeployer} - Execution plan deployment held back and in inactive state : APIMAnalytics-UnusualIPAccessTemplate-UnusualIPAccessAlert-realtime1.siddhiql, Dependency validation exception: Stream org.wso2.apimgt.statistics.perMinuteRequest:1.0.0 does not exist
[2017-07-11 12:54:43,218] INFO {org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver} - Thrift Server started at 0.0.0.0
[2017-07-11 12:54:43,246] INFO {org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver} - Thrift SSL port : 7712
[2017-07-11 12:54:43,253] INFO {org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver} - Thrift port : 7612
[2017-07-11 12:54:43,277] INFO {org.apache.tomcat.util.net.NioSelectorPool} - Using a shared selector for servlet write/read
[2017-07-11 12:54:43,355] INFO {org.apache.tomcat.util.net.NioSelectorPool} - Using a shared selector for servlet write/read
[2017-07-11 12:54:43,408] INFO {org.wso2.carbon.ntask.core.service.impl.TaskServiceImpl} - Task service starting in STANDALONE mode...
[2017-07-11 12:54:44,030] ERROR {org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceComponent} - Error in activating analytics data service: null
java.lang.RuntimeException
at org.wso2.carbon.analytics.datasource.rdbms.RDBMSAnalyticsRecordStore$RDBMSResultSetIterator.next(RDBMSAnalyticsRecordStore.java:881)
at org.wso2.carbon.analytics.datasource.rdbms.RDBMSAnalyticsRecordStore$RDBMSResultSetIterator.hasNext(RDBMSAnalyticsRecordStore.java:843)
at org.apache.commons.collections.IteratorUtils.toList(IteratorUtils.java:848)
at org.apache.commons.collections.IteratorUtils.toList(IteratorUtils.java:825)
at org.wso2.carbon.analytics.datasource.core.util.GenericUtils.listRecords(GenericUtils.java:284)
[2017-07-11 12:54:55,566] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected
[2017-07-11 12:55:05,564] ERROR {org.wso2.carbon.databridge.core.internal.queue.QueueWorker} - Dropping wrongly formatted event sent for -1234
org.wso2.carbon.databridge.core.exception.EventConversionException: Error when converting loganalyzer:1.0.0 of event bundle with events 1
at org.wso2.carbon.databridge.receiver.thrift.converter.ThriftEventConverter.createEventList(ThriftEventConverter.java:181)
at org.wso2.carbon.databridge.receiver.thrift.converter.ThriftEventConverter.toEventList(ThriftEventConverter.java:90)
at org.wso2.carbon.databridge.core.internal.queue.QueueWorker.run(QueueWorker.java:73)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.wso2.carbon.databridge.core.exception.EventConversionException: No StreamDefinition for streamId loganalyzer:1.0.0 present in cache
Can someone please let me know how to resolve this issue.
You can get the newer version of jar from http://maven.wso2.org/nexus/content/groups/public/org/wso2/carbon/analytics/org.wso2.carbon.analytics.datasource.rdbms/