ESXi 5.5 - My Experience (and some questions)


Recommended Posts

i used this

 

 

 

  1. Log in as root through ssh or just go to the console terminal (refer Enable SSH at ESX Host)
  2. Now you need to find out the physical disk path that you will be doing RDM, using either the following commands:
    • esxcfg-mpath -l
    • ls -al /vmfs/devices/disks
  3. Then you need to map the disk as a virtual disk using following command:
    vmkfstools -r /vmfs/devices/disks/<physical disk path> /vmfs/volumes/<vmfs datastore name>/<folder name>/<virtual disk name>.vmdk

Now you can view the physical disk as virtual disk and add it to VM.

Link to comment
Share on other sites

So your doing raw mapping then..

 

I don't have any raw mapped drives connected to linux, and all of mine are in ntfs.  Trying to see how we can get apples to apples comparison.  Can you map those disks to windows, what filesystem are they?

 

My linux vm does not have lot of disk space, and its only got 256MB ram given to it..  But I did run a sysbench with io with file 20 times larger than its mem 5GB.  Keep in mind this is on datastore disk, off ssd.. But curious what your numbers are.  And when I get home tonight I could try it with physical mapped disk.

 

Did you limit your vm in anyway in esxi, how much ram did you give it, cpus?

 

So install sysbench on your linux.

 

So I did a cpu benchmark, and you can see from graph were it pretty much pegged out the system 1500 mhz and 100 % cpu.

 

So here is io test

root@ubuntu:/home/budman# sysbench --test=fileio --file-total-size=2.56G prepare

sysbench 0.4.12:  multi-threaded system evaluation benchmark



FATAL: Invalid value for file-total-size: 0

root@ubuntu:/home/budman# sysbench --test=fileio --file-total-size=5G prepare

sysbench 0.4.12:  multi-threaded system evaluation benchmark



128 files, 40960Kb each, 5120Mb total

Creating files for the test...

root@ubuntu:/home/budman# sysbench --test=fileio --file-total-size=5G --file-test-mode=rndrw --init-rng=on --max-time=300 --max-requests=0 run

sysbench 0.4.12:  multi-threaded system evaluation benchmark



Running the test with following options:

Number of threads: 1

Initializing random number generator from timer.





Extra file open flags: 0

128 files, 40Mb each

5Gb total file size

Block size 16Kb

Number of random requests for random IO: 0

Read/Write ratio for combined random IO test: 1.50

Periodic FSYNC enabled, calling fsync() each 100 requests.

Calling fsync() at the end of test, Enabled.

Using synchronous I/O mode

Doing random r/w test

Threads started!

Time limit exceeded, exiting...

Done.



Operations performed:  264181 Read, 176120 Write, 563584 Other = 1003885 Total

Read 4.0311Gb  Written 2.6874Gb  Total transferred 6.7185Gb  (22.93Mb/sec)

 1467.52 Requests/sec executed



Test execution summary:

    total time:                          300.0316s

    total number of events:              440301

    total time taken by event execution: 238.1075

    per-request statistics:

         min:                                  0.01ms

         avg:                                  0.54ms

         max:                                234.37ms

         approx.  95 percentile:               0.68ms



Threads fairness:

    events (avg/stddev):           440301.0000/0.00

    execution time (avg/stddev):   238.1075/0.00



root@ubuntu:/home/budman#

Notice the 22.9mbps -- what do you get?

 

Here is cpu test

 

root@ubuntu:/home/budman# sysbench --test=cpu --cpu-max-prime=20000 run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 1

Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 20000


Test execution summary:
    total time:                          135.6849s
    total number of events:              10000
    total time taken by event execution: 135.6728
    per-request statistics:
         min:                                 10.42ms
         avg:                                 13.57ms
         max:                                313.99ms
         approx.  95 percentile:              23.30ms

Threads fairness:
    events (avg/stddev):           10000.0000/0.00
    execution time (avg/stddev):   135.6728/0.00

root@ubuntu:/home/budman#

 

What is your total time to complete the cpu test?

 

Here is graph from esxi

post-14624-0-96906000-1424784220.png

 

 

 

 

Link to comment
Share on other sites

found the issue

 

on the IO test

 

(1.1977Mb/sec)

 

 

CPU test took 42 seconds

 

 

 

my arch VM was only sightly better 

 

(1.6926Mb/sec)
Link to comment
Share on other sites

Yeah something wrong there..

 

What about simple speed test with hdparm

 

root@ubuntu:/home/budman# hdparm -t /dev/sda

/dev/sda:
 Timing buffered disk reads: 620 MB in  3.01 seconds = 205.81 MB/sec
root@ubuntu:/home/budman#

 

that is test to just the vm os drive that is on a ssd datastore just a virtual disk.

 

Can you connect the disks to windows, so we can do some apple to apple comparisons.. I have my disks in a pool and share up my video off them, and they are ntfs - don't really want to move them to a linux vm.

 

Here is test of my raw mapped disks to my windows 7 vm.  Drive on left is older 1tb disk, one on right is 2tb disk..  As can see 80MBps even on the slow disk..

 

post-14624-0-38333400-1424870463.png

Link to comment
Share on other sites

ok so did a test with it mapped to a window VM ( i will look out the windows laptop later)

 

post-229387-0-14315000-1424879402.png

 

 

also did hdparm in the os

haggis@plex:~$ sudo hdparm -t /dev/sda

/dev/sda:
 Timing buffered disk reads: 140 MB in  3.03 seconds =  46.24 MB/sec



also did the same on the other drives from the VM Plex

haggis@plex:~$ sudo hdparm -t /dev/sdb

/dev/sdb:
 Timing buffered disk reads: 296 MB in  3.01 seconds =  98.35 MB/sec
haggis@plex:~$ sudo hdparm -t /dev/sdc

/dev/sdc:
 Timing buffered disk reads: 228 MB in  3.00 seconds =  75.91 MB/sec
haggis@plex:~$ sudo hdparm -t /dev/sdd

/dev/sdd:
 Timing buffered disk reads: 158 MB in  3.02 seconds =  52.36 MB/sec


also tried copying some large files instead of lots of small ones

haggis@plex:~$ rsync -av --progress /home/data/file.mp4  /home/backup/
sending incremental file list
file.mp4
   
363277805 100%   25.92MB/s    0:00:13 (xfer#1, to-check=0/1)

sent 363322284 bytes  received 31 bytes  26912764.07 bytes/sec
total size is 363277805  speedup is 1.00

                      
haggis@plex:~$ rsync -av --progress /home/backup/file.mp4 /home/data/
sending incremental file list
file.mp4

363277805 100%   27.30MB/s    0:00:12 (xfer#1, to-check=0/1)

sent 363322260 bytes  received 31 bytes  26912762.30 bytes/sec
total size is 363277805  speedup is 1.00
Link to comment
Share on other sites

So the OS drive test is to your virtual disk on your datastore disk. 

 

Those speeds from hdparm seem a bit low, those older disks - what is the connection sata ?

 

26MBps seems pretty horrific.. Guess need to do write test.

 

But those speeds in windows is bad..  Is this some usb1 flash drive you? ;)

 

I can run the crystal disk..  But those speeds are terrible

Link to comment
Share on other sites

There is clearly something wrong with this setup, I have a small hp microserver and performance is fantastic.  There is something wrong if he is seeing such ###### performance with such high load.

 

This thread is so long and I don't recall what he had, but I don't even think it was microserver.

 

BTW -- you don't have torrents running to these disks when your doing your testing are you?

Link to comment
Share on other sites

There is clearly something wrong with this setup, I have a small hp microserver and performance is fantastic.  There is something wrong if he is seeing such ###### performance with such high load.

 

This thread is so long and I don't recall what he had, but I don't even think it was microserver.

 

BTW -- you don't have torrents running to these disks when your doing your testing are you?

 

 

Its a HP Microserver N54L

 

now any torrent i download i set up to run over night :)

 

once i get a spare few hours i will rebuild it

Link to comment
Share on other sites

Ah so N54L, which is newer than my N40L ;)  but your torrent question didn't answer the question..  Is torrents running while your testing.. They could be hammering the disk, etc.

 

I personally will never run torrents locally again - that is what seedboxes are for ;)

Link to comment
Share on other sites

Tranmission is still running yes but nothing downloading or seeding

 

I will kill transmission later and give that a try though :)

Link to comment
Share on other sites

Ah so N54L, which is newer than my N40L ;)  but your torrent question didn't answer the question..  Is torrents running while your testing.. They could be hammering the disk, etc.

 

I personally will never run torrents locally again - that is what seedboxes are for ;)

 

For once I'll agree with you - seedboxes are the way to go for large torrents. Help with ratio on private trackers as well.

Link to comment
Share on other sites

I just use the onboard, did you put it in ahci mode?  I do have a mod bios that enabled ahci on the other sata ports but your just using the 4 bays right?

Link to comment
Share on other sites

i have the modded bios too

 

when i go into the sata configuration some are showing as 1.5gbps, this could be the drives though, i really need to get some news drives and go from there

 

needing more storage anyway

Link to comment
Share on other sites

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.