News: 1616374632

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

OVH writes off another data centre – SBG1 – as small second fire detected, doused

(2021/03/22)


OVH has written off a second data centre because of the March 10th fire that destroyed its SBG2 facility.

Founder and CTO Octave Klaba. In a Saturday update, OVH founder and CTO Octave Klaba wrote: “We don’t plan to restart SBG1. Ever.” Previous guidance on SBG1 suggested only a few racks were destroyed, while others were considered recoverable. The fire has already destroyed the SBG2 data centre.

[1]

Klaba's [2]announcement followed news of a second fire on the site.

Update March,19 9:30pm

The batteries were in unused room, not used, not connected. We didn’t have the fire, but we had lot of smoke. The situation is under control now. Everybody is safe.

We stop the operation in SBG for this night. We will take the decision tomorrow. — Octave Klaba (@olesovhcom) [3]March 19, 2021

[4]

Klaba has also detailed further delays to restoration of the Strasbourg site as new conduits are dug to bring power to SBG3. The CTO offered further information in a pair of Sunday tweets detailing restoration efforts.

Update March,21 10:30pm

SBG3:

pCI: 60% of VPS: UP. 100% CEPH: UP. We continue to clean up pCS data + metadata.

pCC: clean up. tomorrow we hope to restart 40%.

BM: 25% UP

SBG4:

ETA: Wed,24

SBG1:

61AD/62AD in SBG4: Fri,26/Sun,28

61E/62E in RBX/GRA: no ETA yet because clean up. [5]pic.twitter.com/w3yYCMZHhq — Octave Klaba (@olesovhcom) [6]March 21, 2021

OVH customers, meanwhile, have surfaced a [7]post to the OVH forums by Klaba from November 2017 that discussed a power outage that the CTO described as “the worst incident that can happen to us.”

[8]

Damage at OVH Strasbourg.

Click to enlarge

The post describes how the Strasbourg site initially used shipping containers and Klaba wrote that decision meant “we have not prepared the site for large scale.” He then said the company also made two design errors:

We did not bring the SBG site up to internal standards which provide for 2 independent 20KV electrical inlets, like all our DC sites which have several double electrical inlets. This is a significant investment of around 2 to 3 million euros per electrical arrival, but we believe that this is part of our internal standard.

We built the SBG2 electrical network by placing it on the SBG1 electrical network, instead of making them independent of each other, as in all our data centers. At OVH, each datacenter number means that the electrical network is independent of another datacenter. Everywhere except on the SBG site.

At the time, Klaba promised that work to remedy the problems would start ASAP.

[9]

The 2017 post was made in the wake of a power outage that took down the data centres, a scenario Klaba described as “the worst incident that can happen to us.” ®

Get our [10]Tech Resources



[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YFgkb2-Lq7ns@bD13koMJwAAAFA&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[2] https://twitter.com/olesovhcom/status/1373280258171019271

[3] https://twitter.com/olesovhcom/status/1373008716484726785?ref_src=twsrc%5Etfw

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YFgkb2-Lq7ns@bD13koMJwAAAFA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://t.co/w3yYCMZHhq

[6] https://twitter.com/olesovhcom/status/1373745746063806465?ref_src=twsrc%5Etfw

[7] http://travaux.ovh.net/?do=details&id=28247

[8] https://regmedia.co.uk/2021/03/22/ovh_strasbourg_fire_shutterstock_editorial_only.jpg

[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YFgkb2-Lq7ns@bD13koMJwAAAFA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[10] https://whitepapers.theregister.com/

You get what you pay for

Anonymous Coward

OVH is cheap and cheerful

Perhaps they could take out a subscription for OVH Zerto "Disaster Recovery"? Oh, wait ...

Re: You get what you pay for

Starace

Maybe cheap, but definitely not cheerful right now.

Motorized vehicles only.