I am facing the following error while executing MapReduce job in Linux(CentOS). I added all the jars in classpath. The database name and table name already in the hive database with some column of data in the table. Then also I can't able to access the data from the hive database table.
I'm using vanilla version of hadoop for work. Should i need to edit hive-site.xml file by mysql driver path, username and password for hive?. if yes please tell me the procedure to add username and password for hive.
I placed all dependency files inside the hive and MapReduce prog and also im using vanilla version of Hadoop for the calculation purpose. and also i'm getting
org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9083.
while executing
hive --service metastore
murali]# hadoop jar /home/murali/workspace/hadoop/HiveInputForMapper/target/HiveInputForMapper-0.0.1-SNAPSHOT.jar com.cosmonet.HiveInputDriver -libjars $LIBJARS
Java HotSpot(TM) Server VM warning: You have loaded library /hadoop/hadoop/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
14/12/02 18:53:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/12/02 18:53:09 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
14/12/02 18:53:10 INFO metastore.ObjectStore: ObjectStore, initialize called
14/12/02 18:53:10 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
14/12/02 18:53:10 INFO DataNucleus.Persistence: Property hive.metastore.integral.jdo.pushdown unknown - will be ignored
14/12/02 18:53:13 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
14/12/02 18:53:13 INFO metastore.MetaStoreDirectSql: MySQL check failed, assuming we are not on mysql: Lexical error at line 1, column 5. Encountered: "#" (64), after : "".
14/12/02 18:53:15 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table.
14/12/02 18:53:15 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table.
14/12/02 18:53:15 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table.
14/12/02 18:53:15 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table.
14/12/02 18:53:15 INFO DataNucleus.Query: Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery#0" since the connection used is closing
14/12/02 18:53:15 INFO metastore.ObjectStore: Initialized ObjectStore
14/12/02 18:53:15 INFO metastore.HiveMetaStore: Added admin role in metastore
14/12/02 18:53:15 INFO metastore.HiveMetaStore: Added public role in metastore
14/12/02 18:53:16 INFO metastore.HiveMetaStore: No user is added in admin role, since config is empty
14/12/02 18:53:16 INFO metastore.HiveMetaStore: 0: get_databases: NonExistentDatabaseUsedForHealthCheck
14/12/02 18:53:16 INFO HiveMetaStore.audit: ugi=root ip=unknown-ip-addr cmd=get_databases: NonExistentDatabaseUsedForHealthCheck
14/12/02 18:53:16 INFO metastore.HiveMetaStore: 0: get_table : db=default tbl=cpr_transaction
14/12/02 18:53:16 INFO HiveMetaStore.audit: ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=cpr_transaction
Exception in thread "main" java.io.IOException: NoSuchObjectException(message:default.cpr_transaction table not found)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:71)
at com.cosmonet.HiveInputDriver.run(HiveInputDriver.java:26)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.cosmonet.HiveInputDriver.main(HiveInputDriver.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: NoSuchObjectException(message:default.cpr_transaction table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1560)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:105)
at com.sun.proxy.$Proxy9.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:997)
at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
... 10 more
Seems like a configuration issue. Are you sure you have configured the hive-site.xml correctly ?
This is file from which the Hive cli client picks up the metastore url and connects to execute queries.
Also i see that you hive cli is trying to connect to 'default' db. Is that the DB where your table is ?
Related
I was trying to configure Business network Operator services in my solution by adding the toolkit provided by r3 as corrdapp dependancy in my application.I am able to build the application but when I runnodes i am getting error for Notary
UPDATE
I am adding the log
[ERROR] 2020-09-04T14:21:15,399Z [main] internal.Node. - Unable to install Corda service com.r3.businessnetworks.membership.flows.bno.service.BNOConfigurationService - [errorCode=dfc7g6, moreInformationAt=https://errors.corda.net/OS/4.5/dfc7g6]
java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_201]
[...]
at net.corda.node.Corda.main(Corda.kt:13) ~[corda-node-4.5.jar:?]
Caused by: java.lang.NullPointerException
at com.r3.businessnetworks.membership.flows.ConfigUtils.loadConfig(ConfigUtils.kt:16) ~[?:?]
at com.r3.businessnetworks.membership.flows.bno.service.BNOConfigurationService.<init>(BNOConfigurationService.kt:21) ~[?:?]
... 33 more
[ERROR] 2020-09-04T14:21:15,458Z [main] internal.NodeStartupLogging. - Exception during node startup - [errorCode=dfc7g6, moreInformationAt=https://errors.corda.net/OS/4.5/dfc7g6]
java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_201]
[...]
at net.corda.cliutils.CordaCliWrapperKt.start(CordaCliWrapper.kt:89) ~[corda-tools-cliutils-4.5.jar:?]
at net.corda.node.Corda.main(Corda.kt:13) ~[corda-node-4.5.jar:?]
Caused by: java.lang.NullPointerException
at com.r3.businessnetworks.membership.flows.ConfigUtils.loadConfig(ConfigUtils.kt:16) ~[?:?]
at com.r3.businessnetworks.membership.flows.bno.service.BNOConfigurationService.<init>(BNOConfigurationService.kt:21) ~[?:?]
... 33 more
You are missing the configuration file of this CorDapp as explained here; you must:
Create a config folder inside your node's cordapps folder (i.e. node-folder/cordapps/config).
Inside that folder create a membership-service.conf file.
Inside that file add:
// Whitelist of accepted BNOs. Attempt to communicate to not whitelisted
// BNO would result into an exception
bnoWhitelist = ["O=BNO,L=New York,C=US", "O=BNO,L=London,C=GB"]
// Name of the notary to use for BNO transactions such as membership approval
notaryName = "O=Notary,L=Longon,C=GB"
The CorDapp that you're using relies on a configuration file (the above 3 steps create that file) and it causes the NullPointerException when it's missing. To understand more about CorDapp configuration files, read my article.
On a side note, according to this; the CorDapp that you're using will be deprecated on 31 September 2020.
I'm currently developing ETL scripts locally using the AWS Glue ETL library.
I'm facing an issue when extracting data from S3 bucket as DynamicFrame.
When I want to convert to a DataFrame using toDF(), it will always trigger this exception:
py4j.protocol.Py4JJavaError: An error occurred while calling o52.toDF
...
ERROR Executor: Exception in task 5.0 in stage 3.0 (TID 29)
java.lang.IllegalStateException: Connection pool shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.pool.AbstractConnPool.lease(AbstractConnPool.java:191)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.requestConnection(PoolingHttpClientConnectionManager.java:267)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
at com.amazonaws.http.conn.$Proxy15.requestConnection(Unknown Source)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:176)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1330)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1145)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:802)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:770)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:744)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:704)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:686)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:550)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:530)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5062)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5008)
at com.amazonaws.services.s3.AmazonS3Client.getObject(AmazonS3Client.java:1490)
at org.apache.hadoop.fs.s3a.S3AInputStream.reopen(S3AInputStream.java:148)
at org.apache.hadoop.fs.s3a.S3AInputStream.lazySeek(S3AInputStream.java:281)
at org.apache.hadoop.fs.s3a.S3AInputStream.read(S3AInputStream.java:364)
at java.io.DataInputStream.read(DataInputStream.java:149)
at org.apache.hadoop.io.compress.DecompressorStream.getCompressedData(DecompressorStream.java:179)
at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:163)
at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:105)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.amazonaws.services.glue.readers.BufferedStream.read(DynamicRecordReader.scala:91)
at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.ensureLoaded(ByteSourceJsonBootstrapper.java:489)
at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.detectEncoding(ByteSourceJsonBootstrapper.java:126)
at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.constructParser(ByteSourceJsonBootstrapper.java:215)
I tried the same code on AWS Glue DevEndpoint and it works fine. Any idea how to resolve this?
Please go with java8, your issue will be resolved
check java -version
I had the same issue when running the dev env with following specs:
Scala version 2.11.12
Spark version 2.4.3
Glue 1.0.0
To fix it, add the following line to the spark configuration in $SPARK_HOME/conf/spark-defaults.conf
spark.master local
Alternatively, depending on how you are running your job, you can configure this dynamically if you are in control of the spark context. i.e.
from pyspark.conf import SparkConf
from pyspark.context import SparkContext
conf = SparkConf()
conf.setMaster("local").setAppName("My app")
sc = SparkContext(conf=conf)
I have found this happens when running in local mode with multiple threads, I have found that increasing fs.s3.connection.maximum or fs.s3a.connection.maximum does not fix the issue. Although this post indicates that it should https://kb.databricks.com/jobs/job-fails-connection-pool.html
installed Wso2 as shown in wso2 documentation, changed the default db to mssql and now i keep getting errors on trying to restart the server
it is running on ubuntu
ERROR {org.wso2.carbon.apacheds.impl.ApacheLDAPServer} - Error starting LDAP server.
org.apache.directory.shared.ldap.exception.LdapConfigurationException: ERR_171 Failed to bind an LDAP service (10,389) to the service registry.
at org.apache.directory.server.ldap.LdapServer.startNetwork(LdapServer.java:582)
ERROR {org.wso2.carbon.user.core.common.DefaultRealm} - nullType class java.lang.reflect.InvocationTargetException
org.wso2.carbon.user.core.UserStoreException: nullType class java.lang.reflect.InvocationTargetException
at org.wso2.carbon.user.core.common.DefaultRealm.createObjectWithOptions(DefaultRealm.java:395)
at org.wso2.carbon.user.core.common.DefaultRealm.initializeObjects(DefaultRealm.java:222)
at org.wso2.carbon.user.core.common.DefaultRealm.init(DefaultRealm.java:127)
at org.wso2.carbon.user.core.common.DefaultRealmService.initializeRealm(DefaultRealmService.java:264)
at org.wso2.carbon.user.core.common.DefaultRealmService.<init>(DefaultRealmService.java:102)
[
2019-08-26 15:59:40,317] ERROR {org.wso2.carbon.user.core.internal.Activator} - Cannot start User Manager Core bundle
org.wso2.carbon.user.core.UserStoreException: Cannot initialize the realm.
at org.wso2.carbon.user.core.common.DefaultRealmService.initializeRealm(DefaultRealmService.java:274)
at org.wso2.carbon.user.core.common.DefaultRealmService.<init>(DefaultRealmService.java:102)
at org.wso2.carbon.user.core.common.DefaultRealmService.<init>(DefaultRealmService.java:115)
at org.wso2.carbon.user.core.internal.Activator.startDeploy(Activator.java:72)
at org.wso2.carbon.user.core.internal.BundleCheckActivator.start(BundleCheckActivator.java:61)
at org.eclipse.osgi.framework.internal.core.BundleContextImpl$1.run(BundleContextImpl.java:711)
at java.security.AccessController.doPrivileged(Native Method)
i have put bits of the errors i get when starting the server
please can anyone help i am new to this
Could you check if you have followed the steps given in this guide when changing the default DB to MSSQL?
[1] https://docs.wso2.com/display/ADMIN44x/Changing+to+MSSQL
To start, I think this issue is related to the issue in this post. However, the fix for HBase shell connectivity suggested in comments did not work for me either, and I see no resolution.
Connecting to my Bigtable cluster from the HBase shell just hangs on any command. Example:
ubuntu:/opt/hbase-1.1.2# ./bin/hbase shell
2016-02-29 13:43:38,975 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-02-29 13:43:39,114 INFO [main] grpc.BigtableSession: Opening connection for projectId [removed], zoneId us-central1-b, clusterId [removed], on data host bigtable.googleapis.com, table admin host bigtabletableadmin.googleapis.com.
2016-02-29 13:43:39,191 INFO [BigtableSession-startup-0] grpc.BigtableSession: gRPC is using the JDK provider (alpn-boot jar)
2016-02-29 13:43:39,516 INFO [bigtable-connection-shared-executor-pool1-t2] io.RefreshingOAuth2CredentialsInterceptor: Refreshing the OAuth token
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 1.1.2, rcc2b70cf03e3378800661ec5cab11eb43fafe0fc, Wed Aug 26 20:11:27 PDT 2015
hbase(main):001:0> list
TABLE
The shell just hangs there indefinitely and does this on any command entered.
Here are the results CheckConfig utility:
ubuntu:/opt/hbase-1.1.2# ./bin/hbase com.google.cloud.bigtable.hbase.CheckConfig
User Agent: bigtable-hbase-1.1-0.2.2
Project ID: [removed]
Cluster Id: [removed]
ZoneId: us-central1-b
Cluster admin host: bigtableclusteradmin.googleapis.com
Table admin host: bigtabletableadmin.googleapis.com
Data host: bigtable.googleapis.com
Attempting credential refresh...
Exception in thread "main" java.lang.IllegalAccessError: tried to access field sun.security.ssl.Handshaker.localSupportedSignAlgs from class sun.security.ssl.ClientHandshaker
at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:278)
at sun.security.ssl.Handshaker.processLoop(Handshaker.java:913)
at sun.security.ssl.Handshaker.process_record(Handshaker.java:849)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1035)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1344)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1371)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1355)
at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1093)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:250)
at com.google.bigtable.repackaged.com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:77)
at com.google.bigtable.repackaged.com.google.api.client.http.HttpRequest.execute(HttpRequest.java:965)
at com.google.auth.oauth2.ServiceAccountCredentials.refreshAccessToken(ServiceAccountCredentials.java:222)
at com.google.auth.oauth2.OAuth2Credentials.refresh(OAuth2Credentials.java:76)
at com.google.cloud.bigtable.hbase.CheckConfig.main(CheckConfig.java:68)
Here are the relevant versions and environment variables:
Linux ubuntu7 3.19.0-30-generic #34~14.04.1-Ubuntu SMP Fri Oct 2 22:09:39 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
java version "1.7.0_95"
export ALPN_VERSION=7.1.3.v20150130
export HBASE_CLASSPATH="$(pwd)/lib/bigtable/bigtable-hbase-1.1-0.2.2.jar"
export HBASE_OPTS="${HBASE_OPTS} -Xms1024m -Xmx2048m -Xbootclasspath/p:$(pwd)/lib/bigtable/alpn-boot-${ALPN_VERSION}.jar"
I'd appreciate any solutions/advice/hints at resolving this. Thanks!
You might wish to use our Quickstart for HBase Shell access - It should just work. (Take a look at the hbase-site & hbase-env after running quickstart to see how to configure in the future)
The 1.7.0_95 release of Java is incompatible w/ alpn-boot. We are moving all of our samples to use netty-tcnative-boringssl see the Managed-VM-GAE example for additional info.
I'm unable to instal informatica in windows 8.can any one please advice. attached the error log
error log:
Tuesday, July 29, 2014
This log was generated during Informatica 9.1.0 with HotFix 2 Services installation
Components installing are ... : server,ODBC6.1,isp,services,java,tomcat,tools,DataTransformation,jasperreports-server-4.0.1-bin
Disk Space Check Enabled : true
Enter the installation directory : F:\Informatica_install
Required Disk Space: 1,712 MB
Available Disk Space: 107,112 MB
Registry Entry
Registry Key : HKEY_LOCAL_MACHINE\SOFTWARE\Informatica 9.1.0
Value Name : ROOT_DIR
Data : F:\Informatica_install
Registry Key : HKEY_LOCAL_MACHINE\SOFTWARE\Informatica 9.1.0\Server
Value Name : ISP_HOME
Data : F:\Informatica_install\isp
Installing VS C++ 2008 RT
F:\Informatica_install\tools\VS2008\vcredist_x64.exe /q
COMMAND_EXITCODE: 1
Configuring files
F:\Informatica_install\services\MetadataManagerService\utilities\mmcmd\mmcmd.bat
F:\Informatica_install\services\MetadataManagerService\utilities\mmBackupUtil\backupCmdLine.bat
Creating Shortcuts
Installing VS C++ 2005 RT
cd /d "F:\Informatica_install\DataTransformation\bin"
vcredist_x64.exe /q:a /c:"VCREDI~2.EXE /q:a /c:""msiexec /i vcredist.msi /qn /l*v %SystemDrive%\vcredist.log"" "
COMMAND_EXITCODE: 0
Test Connection Exception -java.sql.SQLNonTransientConnectionException: [informatica][Oracle JDBC Driver]Error establishing socket to host and port: localhost:1521. Reason: Connection refused: connect
Test Connection Exception -java.sql.SQLNonTransientConnectionException: [informatica][Oracle JDBC Driver]Error establishing socket to host and port: localhost:1521. Reason: Connection refused: connect
DB TYPE : Oracle
Database user ID: : system
User password: : *
Custom JDBC Connection String : jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true
Domain name: : Domain_Sai
Node host name: : Sai
Node name: : node01_Sai
Node port number: : 6005
NODE_ADDRESS : Sai:6005
LOGS_DIRECTORY : F:\Informatica_install\isp\logs
BACKUP_DIRECTORY : F:\Informatica_install\server\infa_shared\Backup
DOMAIN_USER : Administrator
DOMAIN_PSSWD : *
NODEOPTIONS_XML : F:\Informatica_install\isp\bin\nodeoptions.xml
Free ports detected by the installer:
Service Manager port:6006
Informatica Administrator port:6007
Service Manager shutdown port:6008
Informatica Administrator shutdown port:6009
Command Executed : F:\Informatica_install\isp\bin\infasetup.bat defineDomain -du "system" -dp -dt "Oracle" -dn "Domain_Sai" -cs "jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true" -nn "node01_Sai" -na "Sai:6005" -ad "Administrator" -pd -rf "F:\Informatica_install\isp\bin\nodeoptions.xml" -sp "6006" -ap "6008" -mi "6013" -ma "6113" -sv "6007" -asp "6009" -f -ld "F:\Informatica_install\isp\logs" -bd "F:\Informatica_install\server\infa_shared\Backup" -tls "false"
Exit Code : 1
OutPut :
Error : '"F:\Informatica_install\java\jre\bin\java"' is not recognized as an internal or external command,
operable program or batch file.
Domain name: : Domain_Admin
Node host name: : Sai
Node name: : node01_Sai
Node port number: : 6005
NODE_ADDRESS : Sai:6005
LOGS_DIRECTORY : F:\Informatica_install\isp\logs
BACKUP_DIRECTORY : F:\Informatica_install\server\infa_shared\Backup
DOMAIN_USER : Administrator
DOMAIN_PSSWD : *
NODEOPTIONS_XML : F:\Informatica_install\isp\bin\nodeoptions.xml
Free ports detected by the installer:
Service Manager port:6006
Informatica Administrator port:6007
Service Manager shutdown port:6008
Informatica Administrator shutdown port:6009
Command Executed : F:\Informatica_install\isp\bin\infasetup.bat defineDomain -du "system" -dp -dt "Oracle" -dn "Domain_Admin" -cs "jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true" -nn "node01_Sai" -na "Sai:6005" -ad "Administrator" -pd -rf "F:\Informatica_install\isp\bin\nodeoptions.xml" -sp "6006" -ap "6008" -mi "6013" -ma "6113" -sv "6007" -asp "6009" -f -ld "F:\Informatica_install\isp\logs" -bd "F:\Informatica_install\server\infa_shared\Backup" -tls "false"
Exit Code : 1
OutPut :
Error : '"F:\Informatica_install\java\jre\bin\java"' is not recognized as an internal or external command,
operable program or batch file.
DB TYPE : Oracle
Database user ID: : system
User password: : *
Custom JDBC Connection String : jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true
Domain name: : Domain_Sai
Node host name: : Sai
Node name: : node01_Sai
Node port number: : 6005
NODE_ADDRESS : Sai:6005
LOGS_DIRECTORY : F:\Informatica_install\isp\logs
BACKUP_DIRECTORY : F:\Informatica_install\server\infa_shared\Backup
DOMAIN_USER : Administrator
DOMAIN_PSSWD : *
NODEOPTIONS_XML : F:\Informatica_install\isp\bin\nodeoptions.xml
Free ports detected by the installer:
Service Manager port:6006
Informatica Administrator port:6007
Service Manager shutdown port:6008
Informatica Administrator shutdown port:6009
Command Executed : F:\Informatica_install\isp\bin\infasetup.bat defineDomain -du "system" -dp -dt "Oracle" -dn "Domain_Sai" -cs "jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true" -nn "node01_Sai" -na "Sai:6005" -ad "Administrator" -pd -rf "F:\Informatica_install\isp\bin\nodeoptions.xml" -sp "6006" -ap "6008" -mi "6013" -ma "6113" -sv "6007" -asp "6009" -f -ld "F:\Informatica_install\isp\logs" -bd "F:\Informatica_install\server\infa_shared\Backup" -tls "false"
Exit Code : -1
OutPut : [ICMD_10033] Command [defineDomain] failed with error [[INFASETUP_10002] Cannot create the domain because of the following error: [RSVCSHARED_00014] Internal error. The Repository Capability ['Persistence'] failed to initialize for the following reason: '[PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES51593' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
'. Contact Informatica Global Customer Support..].
Error : Jul 29, 2014 3:18:06 PM com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl initDB
INFO: Domain Repository Service init method is called.
Jul 29, 2014 3:18:09 PM com.informatica.repository.persistence.service.impl.PersistenceManagerImpl initialize
SEVERE: Unable to initialize persistence component due to: [PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES51593' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
com.informatica.repository.persistence.PersistenceInternalException: [PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES51593' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.repository.persistence.database.DatabaseHandler.detectSchemaName(DatabaseHandler.java:1098)
at com.informatica.repository.persistence.database.DatabaseHandler.getSchemaName(DatabaseHandler.java:838)
at com.informatica.repository.persistence.database.DDLGenRepositoryConfigurationManagerImpl.initializeConfiguration(DDLGenRepositoryConfigurationManager.java:310)
at com.informatica.repository.persistence.database.DDLGenRepositoryConfigurationManagerImpl.<init>(DDLGenRepositoryConfigurationManager.java:287)
at com.informatica.repository.persistence.database.DatabaseRepositoryHandler.<init>(DatabaseRepositoryHandler.java:122)
at com.informatica.repository.persistence.database.DatabasePersister.createRepositoryHandler(DatabasePersister.java:51)
at com.informatica.repository.persistence.service.impl.AbstractPersister.initialize(AbstractPersister.java:100)
at com.informatica.repository.persistence.service.impl.PersistenceManagerImpl.initialize(PersistenceManagerImpl.java:96)
at com.informatica.repository.persistence.service.impl.PersistenceManagerImpl.initialize(PersistenceManagerImpl.java:67)
at com.informatica.repository.service.capability.impl.persistence.PersistenceCapabilityManagerImpl.init(PersistenceCapabilityManagerImpl.java:125)
at com.informatica.repository.service.impl.RepositoryServiceManagerImpl.initPersistence(RepositoryServiceManagerImpl.java:1025)
at com.informatica.repository.service.impl.RepositoryServiceManagerImpl.initService(RepositoryServiceManagerImpl.java:236)
at com.informatica.repository.deployer.embedded.EmbeddedRepositoryConnectionFactory.initializeRepositorySvc(EmbeddedRepositoryConnectionFactory.java:513)
at com.informatica.repository.deployer.embedded.EmbeddedRepositoryConnectionFactory.connect(EmbeddedRepositoryConnectionFactory.java:182)
at com.informatica.project.repository.deployer.common.SetupEmbeddedJRS.getEmbeddedJRSInstance(SetupEmbeddedJRS.java:94)
at com.informatica.project.repository.deployer.embedded.EmbeddedConnectionFactory.initializeProjectRepoSvc(EmbeddedConnectionFactory.java:458)
at com.informatica.project.repository.deployer.embedded.EmbeddedConnectionFactory.connect(EmbeddedConnectionFactory.java:162)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.initImpl(PRSDomainRepositoryServiceImpl.java:226)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.initDB(PRSDomainRepositoryServiceImpl.java:639)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.init(PRSDomainRepositoryServiceImpl.java:536)
at com.informatica.isp.infasetup.impl.ConfigDomainPluginImpl.defineDomain(ConfigDomainPluginImpl.java:225)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at com.informatica.pcsf.cmdframework.PluginCommand.run(PluginCommand.java:46)
at com.informatica.pcsf.cmdframework.Infasetup.execute(Infasetup.java:190)
at com.informatica.pcsf.cmdframework.Infasetup.main(Infasetup.java:85)
Caused by: com.informatica.repository.persistence.PersistenceInitializationException: [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES51593' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.repository.persistence.database.oracle.OracleHandler.createView(OracleHandler.java:599)
at com.informatica.repository.persistence.database.DatabaseHandler.detectSchemaName(DatabaseHandler.java:1084)
... 27 more
Caused by: com.informatica.repository.persistence.ExceptionSurrogate: java.sql.SQLException: [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.jdbc.oraclebase.ddb9.b(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb9.a(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb8.b(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb8.a(Unknown Source)
at com.informatica.jdbc.oracle.ddm.q(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.v(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.x(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.executeUpdate(Unknown Source)
at com.informatica.repository.persistence.database.oracle.OracleHandler.createView(OracleHandler.java:597)
... 28 more
Test Connection Exception -java.sql.SQLException: [informatica][Oracle JDBC Driver][Oracle]ORA-01045: user SAI lacks CREATE SESSION privilege; logon denied
Test Connection Exception -java.sql.SQLException: [informatica][Oracle JDBC Driver][Oracle]ORA-01045: user SAI lacks CREATE SESSION privilege; logon denied
Test Connection Exception -java.sql.SQLException: [informatica][Oracle JDBC Driver][Oracle]ORA-01045: user SAI lacks CREATE SESSION privilege; logon denied
Test Connection Exception -java.sql.SQLInvalidAuthorizationSpecException: [informatica][Oracle JDBC Driver][Oracle]ORA-01017: invalid username/password; logon denied
DB TYPE : Oracle
Database user ID: : system
User password: : *
Custom JDBC Connection String : jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true
Domain name: : Domain_Sai
Node host name: : Sai
Node name: : node01_Sai
Node port number: : 6005
NODE_ADDRESS : Sai:6005
LOGS_DIRECTORY : F:\Informatica_install\isp\logs
BACKUP_DIRECTORY : F:\Informatica_install\server\infa_shared\Backup
DOMAIN_USER : Administrator
DOMAIN_PSSWD : *
NODEOPTIONS_XML : F:\Informatica_install\isp\bin\nodeoptions.xml
Free ports detected by the installer:
Service Manager port:6006
Informatica Administrator port:6007
Service Manager shutdown port:6008
Informatica Administrator shutdown port:6009
Command Executed : F:\Informatica_install\isp\bin\infasetup.bat defineDomain -du "system" -dp -dt "Oracle" -dn "Domain_Sai" -cs "jdbc:informatica:oracle://localhost:1521;ServiceName=orcl;MaxPooledStatements=20;CatalogOptions=0;BatchPerformanceWorkaround=true" -nn "node01_Sai" -na "Sai:6005" -ad "Administrator" -pd -rf "F:\Informatica_install\isp\bin\nodeoptions.xml" -sp "6006" -ap "6008" -mi "6013" -ma "6113" -sv "6007" -asp "6009" -f -ld "F:\Informatica_install\isp\logs" -bd "F:\Informatica_install\server\infa_shared\Backup" -tls "false"
Exit Code : -1
OutPut : [ICMD_10033] Command [defineDomain] failed with error [[INFASETUP_10002] Cannot create the domain because of the following error: [RSVCSHARED_00014] Internal error. The Repository Capability ['Persistence'] failed to initialize for the following reason: '[PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES33840' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
'. Contact Informatica Global Customer Support..].
Error : Jul 29, 2014 3:20:18 PM com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl initDB
INFO: Domain Repository Service init method is called.
Jul 29, 2014 3:20:19 PM com.informatica.repository.persistence.service.impl.PersistenceManagerImpl initialize
SEVERE: Unable to initialize persistence component due to: [PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES33840' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
com.informatica.repository.persistence.PersistenceInternalException: [PERSISTENCEAPI_0307] [DBPERSISTER_0014] Internal error. A test query execution caused an exception. Contact Informatica Global Customer Support. This was caused by [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES33840' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.repository.persistence.database.DatabaseHandler.detectSchemaName(DatabaseHandler.java:1098)
at com.informatica.repository.persistence.database.DatabaseHandler.getSchemaName(DatabaseHandler.java:838)
at com.informatica.repository.persistence.database.DDLGenRepositoryConfigurationManagerImpl.initializeConfiguration(DDLGenRepositoryConfigurationManager.java:310)
at com.informatica.repository.persistence.database.DDLGenRepositoryConfigurationManagerImpl.<init>(DDLGenRepositoryConfigurationManager.java:287)
at com.informatica.repository.persistence.database.DatabaseRepositoryHandler.<init>(DatabaseRepositoryHandler.java:122)
at com.informatica.repository.persistence.database.DatabasePersister.createRepositoryHandler(DatabasePersister.java:51)
at com.informatica.repository.persistence.service.impl.AbstractPersister.initialize(AbstractPersister.java:100)
at com.informatica.repository.persistence.service.impl.PersistenceManagerImpl.initialize(PersistenceManagerImpl.java:96)
at com.informatica.repository.persistence.service.impl.PersistenceManagerImpl.initialize(PersistenceManagerImpl.java:67)
at com.informatica.repository.service.capability.impl.persistence.PersistenceCapabilityManagerImpl.init(PersistenceCapabilityManagerImpl.java:125)
at com.informatica.repository.service.impl.RepositoryServiceManagerImpl.initPersistence(RepositoryServiceManagerImpl.java:1025)
at com.informatica.repository.service.impl.RepositoryServiceManagerImpl.initService(RepositoryServiceManagerImpl.java:236)
at com.informatica.repository.deployer.embedded.EmbeddedRepositoryConnectionFactory.initializeRepositorySvc(EmbeddedRepositoryConnectionFactory.java:513)
at com.informatica.repository.deployer.embedded.EmbeddedRepositoryConnectionFactory.connect(EmbeddedRepositoryConnectionFactory.java:182)
at com.informatica.project.repository.deployer.common.SetupEmbeddedJRS.getEmbeddedJRSInstance(SetupEmbeddedJRS.java:94)
at com.informatica.project.repository.deployer.embedded.EmbeddedConnectionFactory.initializeProjectRepoSvc(EmbeddedConnectionFactory.java:458)
at com.informatica.project.repository.deployer.embedded.EmbeddedConnectionFactory.connect(EmbeddedConnectionFactory.java:162)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.initImpl(PRSDomainRepositoryServiceImpl.java:226)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.initDB(PRSDomainRepositoryServiceImpl.java:639)
at com.informatica.isp.domainrepositoryservice.impl.PRSDomainRepositoryServiceImpl.init(PRSDomainRepositoryServiceImpl.java:536)
at com.informatica.isp.infasetup.impl.ConfigDomainPluginImpl.defineDomain(ConfigDomainPluginImpl.java:225)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at com.informatica.pcsf.cmdframework.PluginCommand.run(PluginCommand.java:46)
at com.informatica.pcsf.cmdframework.Infasetup.execute(Infasetup.java:190)
at com.informatica.pcsf.cmdframework.Infasetup.main(Infasetup.java:85)
Caused by: com.informatica.repository.persistence.PersistenceInitializationException: [PERSISTENCEAPI_0307] [VIEWS_0014] Failed to create view 'MRI_MRSSCHEMATES33840' This was caused by [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.repository.persistence.database.oracle.OracleHandler.createView(OracleHandler.java:599)
at com.informatica.repository.persistence.database.DatabaseHandler.detectSchemaName(DatabaseHandler.java:1084)
... 27 more
Caused by: com.informatica.repository.persistence.ExceptionSurrogate: java.sql.SQLException: [informatica][Oracle JDBC Driver][Oracle]ORA-01031: insufficient privileges
at com.informatica.jdbc.oraclebase.ddb9.b(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb9.a(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb8.b(Unknown Source)
at com.informatica.jdbc.oraclebase.ddb8.a(Unknown Source)
at com.informatica.jdbc.oracle.ddm.q(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.v(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.x(Unknown Source)
at com.informatica.jdbc.oraclebase.ddel.executeUpdate(Unknown Source)
at com.informatica.repository.persistence.database.oracle.OracleHandler.createView(OracleHandler.java:597)
... 28 more
Installation Status:ERROR
The Informatica 9.1.0 HotFix 2 installation is complete.
Tuesday, July 29, 2014
All the errors occurred when the setup process tried to access a local instance of Oracle. You don't mention any RDBMS in your question, so my guess is that you don't have any installed.
Successfully installed informatica 9 on windows 8. Problem is with domain creation. Rebooted my system and installed both oracle and informatica with out changing default paths. One more thing is java should be intalled in your system
When I was trying to install Informatica on Windows 8, it installed successfully, the domain was created without problems (on a remote Oracle Instance at a separate server) but when the machine was rebooted and the Informatica service was successfully started, Administration console was not available. Nothing was listening on the 6008 port.
The Informatica support told me that this Operating system is not supported and it should not work.