Uploads via InitiateFileTransferToGuest is extreamly slow - vmware

The InitiateFileTransferToGuest let's me upload a file to a VM via the ESXi host it's running on.
When I perform the HTTP upload, I'm only getting about 8 Mb/s.
When I use dd on the source machine and target VM, I get about 730 MB/s reads & writes.
When I use iperf between the source machine and target VM, I get 8 Gb/s throughput.
I get the same HTTP upload speed if I use curl or Python's requests module.
All three machines (source, target VM, and ESXi host) are on the same 10 GbE subnet.
Is there some HTTP buffer setting in ESXi that needs adjustment?

What's happening here is that the file is traversing the host and going into the VM with no reliance on the VM's networking configuration. It's using the VM's instance of VMware Tools.
This certainly won't be the most performant option, as you've found already, but it is extremely handy when there are network limitations or the VM is otherwise inaccessible externally, but it is powered on with VMware Tools running.

Related

How do I shrink boot disk size?

I'm new-ish to GCP and this is the first time I've run into a need to downsize a disk.
Background: I resized my boot disk from 1.5 TB to 12 TB to download a lot of data for a research project. But it turns out that the boot disk has an MBR partition type, which according to the GCP docs means "the maximum size of such disk would be 2 TB". Now I cannot use 10 TB out of 12 TB despite paying for it...
I created an additional disk of size 1.5 TB and used rsync -avxP /old/ /new/ to copy all files from the old boot disk to the new disk. Then I unmounted the old disk and tried to start the VM with the new disk as boot disk. But I'm getting an SSH error and cannot access my VM:
Code: 4003
Reason: failed to
connect to backend
Please ensure that:
your user account has iap.tunnelInstances.accessViaIAP permission
VM has a firewall rule that allows TCP ingress traffic from the IP range xx.xxx.xxx.x/xx, port: 22
you can make a proper https connection to the IAP for TCP hostname: https://tunnel.cloudproxy.app You may be able to connect without using
the Cloud Identity-Aware Proxy.
Has anyone encountered this before? How can I either use the 10 TB or solve the SSH problem? Thanks.
I have followed the suggestions at
Google Cloud How to reduce disk size?
How to mount new disk after reaching the 2TB limit Google Cloud
but have not been able to resolve my issue.

Cloud Compute Engine VS VPS

Today I set up my first VM instance on Google Cloud Platform.
I wanted to install a simple lampp server with apache, php and MySQL.
And this is what I have done (ssh and a bunsh of apt-get install).
Everything works fine!
Now I heard that these instances are suppose to be scalable, which means if I have 100,000 http requests per second on my server it shouldn't lag.
So why do I need to select the RAM to install on my VM instance (shouldn't I pay according to the resources my VM use)?
Because I chose 2Go but will my instance be able to serve the 100,000 http request per s?
If not, what is the point to choose a VM instance instead of a VPS or dedicated server (because I can also choose my RAM on these solutions)?

Is it possible to map a EC2 drive to a local drive with a letter?

In one of our client scenario each laptop running a client software has to have a mapped S:\ drive.
Earlier they would map this S:\ drive to a drive in a Server on the same network like \\Server-name\$D
Now they are planning to move this server to EC2 in AWS. Is it possible to map the drive from EC2 server in local machine?
Local machine is in aclient network connected to AWS via VPN and DirectConnect.
In my research online (I am trying to map an Amazon EC2 drive to a local machine), I came to know that you can enable a VPN on EC2 server to make this happen. But I am looking for a inbuilt windows option as this is a as-is migration to AWS.

How to set up a Amazon EC2 instance local network to run a pktgen-dpdk experiment?

I want to run a dpdk experiment using Amazon EC2 service. But there are a great number of services in AWS. I don't know which one to choose.
My experiment need two servers connected together using 10Gbps network adpater supporting dpdk. I run pktgen-dpdk on one server to send packets towards the other server. And another dpdk application will run in the other server to deal with these packets.
I think I can rent servers such c4.8xlarge c4.4xlarge. But I don't know how to set up the local network between them. The local network should have low latency.
Any suggestions will be appreciated! Thank you!
You're looking for Virtual Private Cloud (VPC). An AWS EC2 "instance" like your c4.8xlarge is just a machine. The VPC and several other components allow you to set up a broader network, routing, security groups (basically, a firewall) and other networking capabilities, including in your case a Gateway, which would allow your dpkg system to look out onto the Internet to find dependencies.
The in-network latency is extremely low, < 1ms in our experience. I think most current EC2 instances support 10Gbps networking and other speedy network capabilities.

(AWS) EFS File Sync through VBox

I'm trying to move about 100GB of data from one of my internal hosts up to our new AWS EFS volume.
My first inclination was to use rsync to get a trusted copy up to the volume, but I'm looking at somewhere around 8Mb/s and my first copy operation has taken somewhere around 24 full hours.
I read up on EFS File sync, a utility that's supposed to accelerate the copying operations of large datasets.
In the setup, the instructions dictate that I need to use a ESXi Virtual Image to launch a VM appliance that will connect up to AWS. I believe the recommendation is to use a hypervisor that can be assigned a reachable IP, but I only have my workstation to use.
I'm running into trouble configuring the appliance's network, so that it can handshake with the EFS Agent. I tried using a bridged adapter, but my corporate network uses AD and won't assign an IP to the VM.
Any suggestions?