News: 1609748107

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Server won't boot? Forgot to make that backup? Have no fear, just blame Microsoft

(2021/01/04)


Who, Me? The perils of dusty old kit, a cashing-in of brownie points and if in doubt, blame Microsoft! Start the week with another Register reader [1]Who, Me? confession.

"George" (for that is not his name) was that most common of breeds in the tech world – a self-taught IT guy responsible for a small network of users at a local firm. Keeping things ticking over were four crusty old Windows Server 2003 boxes taking care of Domain Controller duties, file sharing, email and backup.

"The 'servers'," admitted George, "were actually desktop boxes crammed beneath a desk and connected to a KVM, router, cable modem and such via an unholy rats' nest of cables which I never messed with – dust... what dust?

"The backup system was to xcopy the data files to the DC boxes then synchronize weekly with robocopy. There were always three copies of any file, none more than two hours older than the live version."

Homebrew backup scripts involving xcopy can be such a delight, as we're sure many a reader can attest.

Windows might have frozen, but at least my feet are toasty [2]READ MORE

Thankfully, George eventually received funding to replace those ancient beige boxes with something a little swifter and rack-based. Having assembled and configured his new toys, he only had the data left to migrate. He wasn't the only one doing some maintenance; on the Sunday before his planned go-live the building power had to be shut off. So he arranged to come in when the power was restored in order to shift the files.

What could possibly go wrong?

One by one he fired up all the hardware, with only those dusty old Windows Servers left to switch on. Without really considering what he was doing, George reached under the desk and jabbed the power buttons in quick succession.

"To my horror," he said, "I heard zapping sounds."

A thick coating of dust and a power cycle do not make the happiest of bedfellows as George, to his alarm, discovered.

All the boxes were dead except one which, to George's unalloyed delight, seemed to be grinding back into life. Sort of. "I was thanking every deity of every religion in the history of the world when I saw that it was asking if I wanted to run chkdsk to repair the data drive," he said.

The problem was that it was Sunday and getting the spares to fix the servers, or adapters to move the data drives, wasn't an option. Certainly not before the bleating of the users would begin on Monday. Repairing the data drive on the only running server (which he dared not power cycle again) seemed the best, and only, course of action.

George gingerly pressed Y and put himself in the lap of the chkdsk gods.

"The stars aligned," he cheered, "and sometime later I had the data back. I copied it over to the rack then started Explorer to see what it all looked like."

The answer was... not great. His users were prone to fiddling with directory structures and filenames, which meant that by the end of the week everything on the backup looked a bit scrambled compared to the live version. "I suppose I should have sync'd before the power went off," he sighed, "but hey... what could go wrong?"

The next few hours were spent feverishly trying to piece the file system back together. He got close, but admitted that things weren't 100 per cent pristine.

"The next day people noticed that some directory structures had changed and some filenames differed from what they had been the previous Friday," said George.

He was faced with a dilemma. Should he confess all and throw himself at the mercy of the users? Or should he lie his ass off in an effort to divert attention from his own fsck-wittery?

"I put on an authoritative air," he said, "and informed anyone who asked that the new version of Windows Server (which we had to have as the new hardware wouldn't run on anything less!) had some subtle differences in file-handling procedures compared to the old version and there may be (ahem) 'unexpected differences' in some folders."

Thankfully, the users were so delighted with the much-improved performance from the new kit that nobody queried his explanation.

"It was the only time in my career I resorted to the 'baffle 'em with bullshit' tactic, thank God no one knew anything about Windows Server 2008 or file systems.

"As I had established a reputation for being honest and open about things IT, I had enough credit that I could get away with a little bit of economy with the truth (and no one noticed how long my nose was getting!)

"I went out and bought Backup Exec and a tape drive the same day!"

We're sure the majority of Register readers would never dream of dodging a stream of the brown stuff by such methods. But maybe you're one of the minority who would? Confess all with an email to [3]Who, Me? ®

Get our [4]Tech Resources



[1] https://www.theregister.com/Tag/who-me

[2] https://www.theregister.com/2020/12/21/who_me/

[3] mailto:whome@theregister.com

[4] https://whitepapers.theregister.com/

Out of the Frying pan, into the Fire?

chivo243

Went out and bought Backup Exec? Especially from that time... We used it, and moved on.

Re: Out of the Frying pan, into the Fire?

Gotno iShit Wantno iShit

I was about to post a counter but then remembered the version I used for years ran (flawlessly) on NT server 4.0. Jeez, how'd I get so old?

Learnt my lesson early on

don't you hate it when you lose your account

6 hours of hammering away, the birds were starting to twitter and I took a loo break. Came back to 3 horrified friends sitting round a blank sceen, one had accidentally killed the power. After they left I reloaded Elite from cassette and saved at every bloody space station. Some lessons stay with you.

A hard lesson...

TonyJ

...that everyone has learned at some point: Ageing hardware that hasn't been power-cycled for yonks tends to give up and die when it finally gets turned off and back on.

Re: A hard lesson...

Lars

You are talking about Windows I assume.

Re: A hard lesson...

TonyJ

No I am talking about hardware.

Re: A hard lesson...

don't you hate it when you lose your account

Yip. Had it happen on an old Linux workhorse I inherited at one place. Blew one of the mirrored drives and was eternally thankful I managed to bring the other to life.

We have all been there

OGShakes

I remember having to pull an all night repair session on a server that I was replacing the tape drive on, it turned out it had never been turned off and did not want to start after I shut it down. As a bit of a 'kill or cure' I put one of the disks from the raid array in a desktop and it magically booted fine giving us back the data.

Baffleing 'em with BS

Pascal Monett

As a consultant, I'm guessing it would be easy, but in the long run I believe it is better to be quite honest and own up to one's mistakes. Once you have a reputation for being a liar, it doesn't go away.

That said, I will freely admit that I have sometimes responded quite positively to a user's question about "did you take care of that ?", only to go and feverishly code the solution once the user had gone away.

But I never lie. It's bad for business relations.

Viking, n.:
1. Daring Scandinavian seafarers, explorers, adventurers,
entrepreneurs world-famous for their aggressive, nautical import
business, highly leveraged takeovers and blue eyes.
2. Bloodthirsty sea pirates who ravaged northern Europe beginning
in the 9th century.

Hagar's note: The first definition is much preferred; the second is used
only by malcontents, the envious, and disgruntled owners of waterfront
property.