I referred to this question but I have a different question
Get VS Code Python extension to connect to Jupyter running on remote AWS EMR master node
Environment:
The Jupyter Notebook is on AWS EMR.
To access notebook from the browser using a SOCKS5 proxy. To do so, I have to connect to the VPN to work, SSH using PuTTY using .ppk file and Tunnel (Dynamic Port Forwarding).
To automate the step above, I am using PLink(Homepage | Docs | Download) : c:\stuff\plink.exe --ssh -i c:\stuff\file.ppk -D XXXX user-name#<some_IP_address
I can successfully enable proxy by using msedge.exe --proxy-server="socks5://<address>" or chrome.exe --proxy-server="socks5://<address>"
VS Code Version:
C:\Users\ablaze>code --version
1.55.2
3c4e3df9e89829dce27b7b5c24508306b151f30d
x64
Objective:
How can I access the remote Jupyter Notebook hosted on AWS EMR behind a proxy from Visual Studio Code?
I tried and failed:
Given Visual Studio Code is built on top of Electron and benefits from all the networking stack capabilities of Chromium.
I used Plink like above to SSH and then executed the following command on my windows command prompt: C:\Users\ablaze>code --proxy-server="socks5://<address>" --verbose
Error message:
[17668:0505/104410.116:WARNING:dns_config_service_win.cc(692)] Failed to read DnsConfig.
[main 2021-05-05T14:44:10.224Z] Starting VS Code
[main 2021-05-05T14:44:10.224Z] from: c:\Users\ablaze\AppData\Local\Programs\Microsoft VS Code\resources\app
[main 2021-05-05T14:44:10.224Z] args: {
_: [],
...
'no-proxy-server': false,
'proxy-server': 'socks5://localhost:8088',
...
logsPath: 'C:\\Users\\ablaze\\AppData\\Roaming\\Code\\logs\\20210505T104410'
}
...
[main 2021-05-05T14:44:10.258Z] windowsManager#open pathsToOpen [
{
backupPath: 'C:\\Users\\ablaze\\AppData\\Roaming\\Code\\Backups\\1620224957079',
remoteAuthority: undefined
}
]
To double check I also opened the log file C:\Users\ablaze\AppData\Roaming\Code\logs\20210505T104410\main.log
...
[2021-05-05 10:44:40.345] [main] [trace] update#checkForUpdates, state = idle
[2021-05-05 10:44:40.345] [main] [info] update#setState checking for updates
[2021-05-05 10:44:40.345] [main] [trace] RequestService#request https://update.code.visualstudio.com/api/update/win32-x64-user/stable/3c4e3df9e89829dce27b7b5c24508306b151f30d
[2021-05-05 10:44:40.346] [main] [trace] resolveShellEnv(): skipped (Windows)
[2021-05-05 10:44:44.354] [main] [error] Error: net::ERR_PROXY_CONNECTION_FAILED
at SimpleURLLoaderWrapper.<anonymous> (electron/js2c/browser_init.js:109:6508)
at SimpleURLLoaderWrapper.emit (events.js:315:20)
[2021-05-05 10:44:44.354] [main] [info] update#setState idle
I have a working GCP account and trying to run a dataflow job which ingest data from on-prem oracle to BigQuery using cloud SDK. I have installed the versioned cloud SDK tool and configured my account. I want to use the JDBCToBigQuery template.
Tried executing:
mvn compile exec:java -Dexec.mainClass=com.google.cloud.teleport.templates.JdbcToBigQuery -Dexec.cleanupDaemonThreads=false -Dexec.args="--driverJars=gs://********/jars/ojdbc8-8.0.17.jar --driverClassName=oracle.jdbc.OracleDriver --connectionURL=***** --query='select * from schema.users' --outputTable= ***** --bigQueryLoadingTemporaryDirectory=***** --username=***** --password=****** --project=***** --runner=DirectRunner"
It throws this error:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:24 min
[INFO] Finished at: 2019-11-21T23:02:45-05:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java (default-cli) on project google-cloud-teleport-java: An exception occured while executing the Java class. org.apache.beam.sdk.util.UserCodeException: java.lang.RuntimeException: java.io.IOException: Error reading gs://********/jars/ojdbc8-8.0.17.jar: connect timed out -> [Help 1]
I am working behind the company's proxy but have taken care of that by incorporating proxy settings.
Trying to troubleshoot this error, can anyone help out in this?
P.S.: Newbie to google cloud services
I have tried to use docker toolbox to setup Hyperledger V1.0 in my local machines.
I according to this document：
http://hyperledger-fabric.readthedocs.io/en/latest/asset_setup.html
But when I tried to deploy chaincode.
$node deploy.js
I got an error message：
info: Returning a new winston logger with default configurations
info: [Chain.js]: Constructed Chain instance: name - fabric-client1, securityEnabled: true, TCert download batch size: 10, network mode: true
info: [Peer.js]: Peer.const - url: grpc://localhost:8051 options grpc.ssl_target_name_override=tlsca, grpc.default_authority=tlsca
info: [Peer.js]: Peer.const - url: grpc://localhost:8055 options grpc.ssl_target_name_override=tlsca, grpc.default_authority=tlsca
info: [Peer.js]: Peer.const - url: grpc://localhost:8056 options grpc.ssl_target_name_override=tlsca, grpc.default_authority=tlsca
info: [Client.js]: Failed to load user "admin" from local key value store
info: [FabricCAClientImpl.js]: Successfully constructed Fabric COP service client: endpoint - {"protocol":"http","hostname":"localhost","port":8054}
info: [crypto_ecdsa_aes]: This class requires a KeyValueStore to save keys, no store was passed in, using the default store C:\Users\daniel\.hfc-key-store
[2017-04-15 22:14:29.268] [ERROR] Helper - Error: Calling enrollment endpoint failed with error [Error: connect ECONNREFUSED 127.0.0.1:8054]
at ClientRequest.<anonymous> (C:\Users\daniel\node_modules\fabric-ca-client\lib\FabricCAClientImpl.js:304:12)
at emitOne (events.js:96:13)
at ClientRequest.emit (events.js:188:7)
at Socket.socketErrorListener (_http_client.js:310:9)
at emitOne (events.js:96:13)
at Socket.emit (events.js:188:7)
at emitErrorNT (net.js:1278:8)
at _combinedTickCallback (internal/process/next_tick.js:74:11)
at process._tickCallback (internal/process/next_tick.js:98:9)
[2017-04-15 22:14:29.273] [ERROR] DEPLOY - Error: Failed to obtain an enrolled user
at ca_client.enroll.then.then.then.catch (C:\Users\daniel\helper.js:59:12)
at process._tickCallback (internal/process/next_tick.js:103:7)
events.js:160
throw er; // Unhandled 'error' event
^
Error: Connect Failed
at ClientDuplexStream._emitStatusIfDone (C:\Users\daniel\node_modules\grpc\src\node\src\client.js:201:19)
at ClientDuplexStream._readsDone (C:\Users\daniel\node_modules\grpc\src\node\src\client.js:169:8)
at readCallback (C:\Users\daniel\node_modules\grpc\src\node\src\client.js:229:12)
Is this an question about unable to connect to ca? Or other causes?
Edit:
Environment:
OS: Windows 10 Professional Edition
Docker Toolbox: 17.04.0-ce
Go: 1.7.5
Node.js: 6.10.0
My steps:
1.Open Docker Quickstart Terminal and key commands.
$curl -L https://raw.githubusercontent.com/hyperledger/fabric/master/examples/sfhackfest/sfhackfest.tar.gz -o sfhackfest.tar.gz 2> /dev/null; tar -xvf sfhackfest.tar.gz
$docker-compose -f docker-compose-gettingstarted.yml build
$docker-compose -f docker-compose-gettingstarted.yml up -d
$docker ps
It has been confirmed that six containers have been activated
2.Download examples and install modules.
$curl -OOOOOO https://raw.githubusercontent.com/hyperledger/fabric-sdk-node/v1.0-alpha/examples/balance-transfer/{config.json,deploy.js,helper.js,invoke.js,query.js,package.json}
//This link didn't work, so I downloaded the required files from GitHub of fabric-sdk-node
$npm install --global windows-build-tools
$npm install
3.Try to deploy chaincode.
$node deploy.js
There were several problems, not the least of which that documentation was outdated and was for a preview release of Hyperledger Fabric. The docs are actually in the process of being removed as we need to update our examples / samples.
You mentioned Docker Toolbox - so are you trying to run all of this on Windows or Mac?
UPDATE:
So one of the issue with Docker Toolbox or Docker for Windows is that you cannot use localhost / 127.0.0.1 as the address when trying to communicate from apps on the host (even in the QuickStart Terminal) to the endpoints of the Docker containers. When the QuickStart Terminal first launches Docker, you'll see that it will output the IP address of the endpoint you should use when communicating with exposed ports.
I was having the same issue while following the latest "Writing Your First Application" tutorial (http://hyperledger-fabric.readthedocs.io/en/latest/write_first_app.html). I had installed all the pre-requisites and the fabric-samples and started the local network.
When I got to the step of enrolling the Admin user, $ node enrollAdmin.js, I was getting the same error message as above, Error: connect ECONNREFUSED, followed by the localhost domain.
As the first answer suggests, the root cause is that I'm running Docker Toolbox. I'm developing on an older Mac, OSX v10.9.5, so I couldn't use Docker for Mac.
To fix the issue, I replaced 'localhost' in the enrollAdmin.js code with the IP from Docker Toolbox.
Here are the steps I took:
Started Docker with Applications > Docker Quickstart Terminal
Copied the IP from this sentence: docker is configured to use the default machine with IP...
Opened the copy of enrollAdmin.js from fabric-samples/fabcar directory
Found this code:
// be sure to change the http to https when the CA is running TLS enabled
fabric_ca_client = new Fabric_CA_Client('http://localhost:7054', tlsOptions , 'ca.example.com', crypto_suite); // <-- This is the line to change
Replaced 'localhost' with the Docker IP, leaving the port :7054 as is.
Saved
Re-ran the command, $ node enrollAdmin.js
The script connected to the CA and successfully completed the Admin enrollment.
On to the next step!
I'm following Amazon's tutorial for installing IIS on AWS using Chef.
The problem is that when I execute the custom cookbook I see the following:
# Logfile created on 2016-03-31 01:32:10 +0000 by logger.rb/41954
[2016-03-31T01:32:10+00:00] INFO: Started chef-zero at http://localhost:8889 with repository at C:/chef
One version per cookbook
data_bags at C:/chef/runs/3011e6d2-9695-4cc2-97d0-b509c34c0b64/data_bags
nodes at C:/chef/runs/3011e6d2-9695-4cc2-97d0-b509c34c0b64/nodes
[2016-03-31T01:32:15+00:00] INFO: *** Chef 12.2.1 ***
[2016-03-31T01:32:15+00:00] INFO: Chef-client pid: 2584
[2016-03-31T01:32:48+00:00] INFO: Setting the run_list to [] from CLI options
[2016-03-31T01:32:48+00:00] INFO: Run List is []
[2016-03-31T01:32:48+00:00] INFO: Run List expands to []
[2016-03-31T01:32:48+00:00] INFO: Starting Chef Run for iis-app-server
[2016-03-31T01:32:48+00:00] INFO: Running start handlers
[2016-03-31T01:32:48+00:00] INFO: Start handlers complete.
[2016-03-31T01:32:48+00:00] INFO: HTTP Request Returned 404 Not Found : Object not found: /reports/nodes/iis-app-server/runs
[2016-03-31T01:32:48+00:00] INFO: Loading cookbooks []
[2016-03-31T01:32:48+00:00] WARN: Node iis-app-server has an empty run list.
[2016-03-31T01:32:49+00:00] INFO: Chef Run complete in 0.218745 seconds
[2016-03-31T01:32:49+00:00] INFO: Running report handlers
[2016-03-31T01:32:49+00:00] INFO: Report handlers complete
It's unable to load the cookbooks for some reason.
The log you shown is the second Chef run, which should be empty for update_custom_cookbooks command. If you check the log, the update custom cookbooks should be in the first chef run at the top of your log.
In a hoplon project, by executing: boot development, i get these errors:
I/O exception (java.net.SocketException) caught when connecting to the target host: Network is unreachable
Failed to collect dependencies for [#<Dependency org.clojure:clojure:jar:1.6.0 (compile)> #<Dependency tailrecursion:boot.core:jar:2.5.1 (compile)> #<Dependency tailrecursion:boot.task:jar:2.2.4 (compile)> #<Dependency tailrecursion:hoplon:jar:5.10.23
Failed to read artifact descriptor for org.clojure:clojure:jar:1.6.0
↳ Caused by: Could not transfer artifact org.clojure:clojure:pom:1.6.0 from/to http://repo1.maven.org/maven2/ (http://repo1.maven.org/maven2/): Connection to http://repo1.maven.org refused
I have boot installed on my machine. (Ubuntu 12.04)
Any suggestions?