Difference between revisions of "4U VMware cluster"

From Hackerspace ACKspace
Jump to: navigation, search
m (Pics or it didn't happen)
Line 11: Line 11:
  
 
1) DONE
 
1) DONE
<UL><LI>Hardware platform: HP DL350 G5</LI>
+
<UL><LI>Hardware platform: HP DL360 G5</LI>
 
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache</LI>
 
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory</LI>
Line 22: Line 22:
  
 
2) DONE
 
2) DONE
<UL><LI>Hardware platform: HP DL350 G5</LI>
+
<UL><LI>Hardware platform: HP DL360 G5</LI>
 
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache</LI>
 
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory</LI>
Line 32: Line 32:
 
<LI>Boot disk: Todo: 32GB USB stick</LI></UL>
 
<LI>Boot disk: Todo: 32GB USB stick</LI></UL>
  
3) Todo!
+
3) Pending...
<UL><LI>Hardware platform: HP DL350 G5</LI>
+
<UL><LI>Hardware platform: HP DL360 G5 DONE</LI>
<LI>CPU: for now: 1x Quadcore Xeon E5405 2GHz 64 bit 6MB cache DONE</LI>
+
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache DONE</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory DONE</LI>
 
<LI>Memory: 20GB PC2-5300F ECC Fully buffered memory DONE</LI>
</LI>Network: 2xBCM5705 gigabit Ethernet with offload engine + dual gigabit Intel PRO1000PT DONE</LI>
+
<LI>Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT DONE</LI>
 +
<LI>Power: 2x 700W hotswap power supply DONE</LI>
 
<LI>Harddisk: none</LI>
 
<LI>Harddisk: none</LI>
<LI>Management port: ILO2 100Mbit Ethernet</LI></UL>
+
<LI>Optical drive: ??? T.B.D.</LI>
 +
<LI>Management port: ILO2 100Mbit Ethernet</LI>
 +
<LI>Boot disk: Todo: 32GB USB stick</LI></UL>
  
4) Todo!
+
4) Pending...
<UL><LI>Hardware platform: HP DL350 G5</LI>
+
<UL><LI>Hardware platform: HP DL360 G5 DONE</LI>
<LI>CPU: ????? T.B.D.</LI>
+
<LI>CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache DONE</LI>
 
<LI>Memory: 16GB PC2-5300F ECC Fully buffered memory DONE</LI>
 
<LI>Memory: 16GB PC2-5300F ECC Fully buffered memory DONE</LI>
<LI>Network: 2xBCM5705 gigabit Ethernet with offload engine + dual gigabit Intel PRO1000PT DONE</LI>
+
<LI>Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT DONE</LI>
<LI>Harddisk: 3-5x SATA 500-1000GB 7200RPM 2.5inch drive + 240GB SSD <-- Still open for suggestions</LI>
+
<LI>Harddisk: 3-5x SATA 500-1000GB 7200RPM 2.5inch drive + 256GB SSD <-- Still open for suggestions</LI>
 +
<LI>Power: 2x 700W hotswap power supply DONE</LI>
 +
<LI>Optical drive: ??? T.B.D.</LI>
 
<LI>Management port: ILO2 100Mbit Ethernet</LI></UL>
 
<LI>Management port: ILO2 100Mbit Ethernet</LI></UL>
  
Line 52: Line 57:
 
[[File:Spare_mem.jpg|400px]]
 
[[File:Spare_mem.jpg|400px]]
  
Upgrades: Memory upgrades can be from 4x4GB+4x1GB = 20GB to a configuration of 8x4GB=32GB. CPU upgrade can be to a dual quadcore system. With purchase of a single E5405 CPU, two systems can already be equipped with 2xE5420 and 2xE5405 quadcores. I believe it's best to keep the storage server on a fast dual core CPU, like 3,7GHz, because the file server process is mostly single thread. 16GB should be plenty to run a good ZFS system to host all VM data storage with iSCSI connections. The 3rd and 4th are planned on 4xGbE as for now, but if two LP Intel PRO1000PT cards become available, they too can go to the 6xGbE.
+
Upgrades: Memory upgrades can be from 4x4GB+4x1GB = 20GB to a configuration of 8x4GB=32GB. CPU upgrade can be to a dual quadcore system. With purchase of a single E5405 CPU, all three VMWare systems can already be equipped with 4xE5420 and 2xE5405 quadcores. I believe it's best to keep the storage server on a fast dual core CPU, like 3,7GHz, because the file server process is mostly single thread. For now it will run on a 2.5GHz quadcore. 16GB should be plenty to run a good ZFS system to host all VM data storage with iSCSI connections.  
 +
 
 +
All four systems are planned with 6x gigabit ethernet hooked up to 2 Dell Powerconnect 5324 switches. Two of the gigabit can be used for the iSCSI connection, two for the VM's connection, and two for the shared vMotion/management interface. The host OS for the iSCSI server is still undetermined, but it has to support ZFS with ZIL and L2ARC capabilities at good speeds. Hopefully an SSD drive will be a positive influence to the fileserver's speed.

Revision as of 19:35, 4 August 2014

Project: 4U VMware cluster
Featured:
State Active
Members Danny Witberg
GitHub No GitHub project defined. Add your project here.
Description Make a mini VMware cluster
Picture
No project picture! Fill in form Picture or Upload a jpeg here

VMWare and virtual computing in general had many benefits over a physical server farm. One VMWare host can accomodate multiple virtual servers. Shared resources means better use of the actual hardware. In a cluster of hosts, several automation processes can be achieved such as auto restart upon failed VM, and automatic recovery after a failed host. To experiment with such a system, you will have to have a minimum of 3 host servers, and a shared storage system or datapool. My goal with this project is to set up the hardware in a mini 4U cluster system.

DL360G5.jpg

The cluster is comprised of 4 HP DL360G5 1U servers. They are fairly cheap to come by, can easily be upgraded and are compact. This is an overview of the 4 systems:

1) DONE

  • Hardware platform: HP DL360 G5
  • CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache
  • Memory: 20GB PC2-5300F ECC Fully buffered memory
  • Harddisk: none installed
  • Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT
  • Power: 2x 700W hotswap power supply
  • Optical drive: DVD/CD rewriter
  • Management port: ILO2 100Mbit Ethernet
  • Boot disk: 32GB USB drive

2) DONE

  • Hardware platform: HP DL360 G5
  • CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache
  • Memory: 20GB PC2-5300F ECC Fully buffered memory
  • Harddisk: none installed
  • Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT
  • Power: 2x 700W hotswap power supply
  • Optical drive: DVD/CD rewriter
  • Management port: ILO2 100Mbit Ethernet
  • Boot disk: Todo: 32GB USB stick

3) Pending...

  • Hardware platform: HP DL360 G5 DONE
  • CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache DONE
  • Memory: 20GB PC2-5300F ECC Fully buffered memory DONE
  • Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT DONE
  • Power: 2x 700W hotswap power supply DONE
  • Harddisk: none
  • Optical drive: ??? T.B.D.
  • Management port: ILO2 100Mbit Ethernet
  • Boot disk: Todo: 32GB USB stick

4) Pending...

  • Hardware platform: HP DL360 G5 DONE
  • CPU: 1x Quadcore Xeon E5420 2.5GHz 64 bit 6MB cache DONE
  • Memory: 16GB PC2-5300F ECC Fully buffered memory DONE
  • Network: 2xBCM5705 gigabit Ethernet with offload engine + 2x dual gigabit Intel PRO1000PT DONE
  • Harddisk: 3-5x SATA 500-1000GB 7200RPM 2.5inch drive + 256GB SSD <-- Still open for suggestions
  • Power: 2x 700W hotswap power supply DONE
  • Optical drive: ??? T.B.D.
  • Management port: ILO2 100Mbit Ethernet

DL360 inside.jpg

Spare mem.jpg

Upgrades: Memory upgrades can be from 4x4GB+4x1GB = 20GB to a configuration of 8x4GB=32GB. CPU upgrade can be to a dual quadcore system. With purchase of a single E5405 CPU, all three VMWare systems can already be equipped with 4xE5420 and 2xE5405 quadcores. I believe it's best to keep the storage server on a fast dual core CPU, like 3,7GHz, because the file server process is mostly single thread. For now it will run on a 2.5GHz quadcore. 16GB should be plenty to run a good ZFS system to host all VM data storage with iSCSI connections.

All four systems are planned with 6x gigabit ethernet hooked up to 2 Dell Powerconnect 5324 switches. Two of the gigabit can be used for the iSCSI connection, two for the VM's connection, and two for the shared vMotion/management interface. The host OS for the iSCSI server is still undetermined, but it has to support ZFS with ZIL and L2ARC capabilities at good speeds. Hopefully an SSD drive will be a positive influence to the fileserver's speed.