If something is worth doing, it's worth over-doing, right? So we're burning down the bikeshed and now we've got this extra hardware lying around. So maybe we can cratacenter it all up. The milk crates were nice, but something more durable that requires fewer zip ties would be cool. Someone, probably jokingly, pointed us to the Gator Cases Lightweight Rolling Rack Case with Retractable Tow Handle and Recessed Wheels; 10U It's a 10U rack, but with roller wheels and a handle.
Only having 10U means we had to make some decisions about what could be redundant and what couldn't. You don't really want to run this without a UPS, so we budgeted 2U on a Tripp Lite SMART1500LCD 1500VA Smart UPS Battery
We couldn't fit any of the old NASes we had in to a rack, not without burning 4U and adding a shelf, so we went with the Synology 2U 8-Bay NAS RackStation (RS1219+) with Western Digital 8TB WD Red NAS Internal Hard Drive - 5400 RPM Eight 8TB drives in a RAID 6 configuration grants us about 44TB of useful space, allowing for a two-drive failure before data loss occurs.
We already had the Supermicro SuperServer E200-8D - Mini-1Uboxes, but needed to add the SuperMicro CSE-E200 RACKMOUNT KIT for SYS-E200-8D MCP-290-10110-0B in order to make them rack mountable. I typically like no fewer than four nodes in an ESX cluster, so I can have a node offline but still have some redundancy, but I had to roll that back to three because of the space constraints.
I originally looked at the Ubiquiti UniFi Switch - 48 Ports Managed (US-48-500W)but managing things with a cloudkey isn't what I was trying to do here. There were also some interesting side-effects to putting two cloudkeys on the same subnet, as we had lab in the bikeshed, and now the cratacenter. the seemed to be fighting for control so I had to abandon that pretty quickly. I settled on two Ubiquiti EdgeSwitch ES-48-500W Managed PoE, Gigabit Switches instead, as they could be managed with the command line and not forget everthing on a reboot.
Adding the redundant switches leaves us with only 1U left in the Gator case, and I don't like the idea of non-redundant hardware for the firewalls. Even the Cratacenter 1.0 had redundant OpenBSD boxes in the form of Dual net5501s from Soekris Engineering. To add insult to injury, Soekris Engineering suspended operations in the US in April 2017. So I needed both a replacement hardware that can run OpenBSD, and a way to fit two of them into a 1U space. While I labbed it out. I just used two old Soekris Net6501s in 1U cases and only used a single switch.
The 1U rack mount kits had a caddy for the power supply. I used a Kano kit with montior as a deployment node to load operating systems and configure switches. There will be more on that later.
Now it was ready to roll to the bikeshed so we could leverage the power of VMware storage vmotion to migrate the data from the Synology Disk Station 8-Bay Network Attached Storage (DS1815+) and into the RS1219+, and then to evacuate an ESX node one at a time and move it into the crate. More on that in a later post.
With the maximum of 3 nodes moved, and all of the bikshed infrastructure migrated to the crate, I let it run for a week to see if any problems shook out.
Then it was moving day. The rolley wheels on the crate work fine, but I was moving other things out of the bikeshed as well, so I just threw the crate into the little red wagon.