[BlueOnyx:20772] Re: BlueOnyx Shop, NewLinQ service restoration

[Greg Kuhnert]

Hello Blueonyx World.

I’ve just landed back home after the server move. What can I say. It was an experience. One that I hope to not have to do again any time soon. For something of this magnitude, I had purchased a shock proof 19RU rack flight case for shipping the hardware. Despite paying over weight freight, tagging as fragile, mounting in this shock proof case, the server ended up having a hardware fault. It was not initially obviously a hardware issue. The box was rebooting - and it appeared to be software related. I was at first thinking it was kernel related (as there was a kernel upgrade that was activated after power down from previous location). We eventually gave up, and Chris helped out locating some alternate hardware… while in parallel his team did some diagnostics on the original machine.

Summary:
1. In running memtest - it was failing. Swapped with known working ram - Still failed.
2. The cables that go to the main board from the front panel on the case had come loose.

Conclusion:
The only way both of those things can happen while being in the protective case that I used would be if the case was dropped from a significant height while in transit. How else would those cables get lose! Its just insane.

Anyway. Chris and team. Thanks again for all your help.

GK

> On 1 Mar 2017, at 11:00 am, Chris Gebhardt - VIRTBIZ Internet <cobaltfacts at virtbiz.com> wrote:
> 
> Hi all,
> 
> I'm taking a moment to update you on the status of the server move. We've had some unexpected challenges but are working through them.  You may well hear from Greg and/or Michael but while those guys are deep into their tasks, I'll get a quick update out.
> 
> As some have noticed, and was previously announced at BlueOnyx.it, the systems responsible for handling the BlueOnyx Shop, NewLinQ and other various services made a physical move over the weekend, and arrived at our DAL1 facility Monday afternoon.
> 
> The equipment was brought personally by Greg Kuhnert of Compass Networks.  He and members of our team unpacked and loaded everything into its new home and got to work routing the IP addresses, which were also ported across to our network.
> 
> After a fair amount of work and troubleshooting, it became clear that the main server has suffered from some sort of jet lag and has encountered a fault that we have as yet been unable to fully diagnose. In the interest of getting service restored as quickly as possible, we have fired up another server and have loaded the critical services there.   That will give us the opportunity to get to the bottom of the apparent hardware fault without hitting users with a sustained outage.
> 
> So the current status is that the user- and customer-facing bits of the BlueOnyx Shop and NewLinQ are fully operational.   In the coming hours and days you can expect some brief interruptions in service as configuration changes and various tweaks and upgrades are implemented.
> 
> I'll take a moment of personal privilege and give some special thanks to Team BlueOnyx.  Especially Greg who flew halfway around the world with this stuff and has gotten very little sleep in the past few days in his commitment to get things running for the BlueOnyx Community.  Also Michael Stauber for being on-call for us whenever we have a sticky question.   And lastly, the VIRTBIZ datacenter support crew, who continue to make me proud.  Provisioning emergency gear, help with rack & stack logistics, making burger runs...     This has been (and will continue to be) a group effort.
> 
> We're proud to be the host datacenter for the BlueOnyx project.  The software, the people behind it, and the BlueOnyx community at large are really a special thing.
> 
> Stay tuned.
> 
> -- 
> Chris Gebhardt
> VIRTBIZ Internet Services
> Access, Web Hosting, Colocation, Dedicated
> www.virtbiz.com | toll-free (866) 4 VIRTBIZ
> _______________________________________________
> Blueonyx mailing list
> Blueonyx at mail.blueonyx.it
> http://mail.blueonyx.it/mailman/listinfo/blueonyx