News: 1720769593

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Stop installing that software – you may have just died

(2024/07/12)


On Call Life on the frontlines of tech support can be tough, which is why each Friday The Register brings you a fresh instalment of On Call, our reader-contributed column in which you tell your peers what you've endured in the name of work.

This week, meet a reader we'll Regomize as "Lyle" who told us about the phase of his career in the mid-1990s during which he installed enterprise management software at Air Force bases, then stuck around to drill staff in its use.

When Lyle arrived for one such gig, he was told that the base was participating in wargames during the week, and that judges of this event might be present at various moments. As a civilian, he was assured none of this would impact his work.

[1]

As he settled in, Lyle noticed a member of the unit's engineering corps come in to work on the air conditioning, then leave.

[2]

[3]

The next day, the aircon engineer returned and was waved through – front desk staff recognized him and didn't check for ID.

That infraction was observed by a wargames judge who, upset by the lax security, decreed that the facility had just been disabled by a bomb and everyone inside was unable to work … or maybe even out of the game entirely.

[4]Innocent techie jailed for taking hours to fix storage

[5]For the record: You just ordered me to cause a very expensive outage

[6]You're wrong, I'm right, and you're hiding the data that proves it

[7]We need a volunteer to literally crawl over broken glass to fix this network

Lyle played along – but also pointed out that his hourly rate handily topped three figures. So while he was entirely happy to spend the day being paid to read a book instead of installing software, maybe having him do so was not a great use of the military budget?

High-stakes negotiations with the wargames supervisor eventually saw Lyle miraculously restored to combat readiness after three hours.

[8]

As On Call stories often do, this one had on odd epilog: during this job Lyle noticed a very old Sperry-Unisys computer ticking away. He later learned those machines were eventually ripped out of the base … to provide parts for real live air traffic control systems that relied on the same ancient platform and had run out of spares.

What's the strangest reason you've been forced to stop work? Don't stop now, [9]click here to send On Call your story so we can consider it for a future Friday. ®

Get our [10]Tech Resources



[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZpD@umQCbcKSTUTMu2B7pQAAAQ8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZpD@umQCbcKSTUTMu2B7pQAAAQ8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZpD@umQCbcKSTUTMu2B7pQAAAQ8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[4] https://www.theregister.com/2024/07/05/on_call/

[5] https://www.theregister.com/2024/06/28/on_call/

[6] https://www.theregister.com/2024/06/21/on_call/

[7] https://www.theregister.com/2024/06/14/on_call/

[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZpD@umQCbcKSTUTMu2B7pQAAAQ8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[9] mailto:oncall@theregister.com

[10] https://whitepapers.theregister.com/



Korev

That sounds pretty sweet, as you'd expect from Tate and Lyle...

Korev

As the Americans are wont to say "It was the bomb"

Red Sceptic

"All your base are belong to us"

Strangest?

Caver_Dave

"You can't go into that room until the atomised chicken dust has settled!"

The glass window from the control room where I was, through to "that room", had a windscreen wiper on it, and although they might have been exaggerating with the word "atomised", there was no way I was going into "that room".

It was in a facility that performed R&D for the aerospace sector. I can't say more because ==>

Re: Strangest?

jmch

If they were shooting chickens into aircraft engines to simulate bird strikes, I hope they thawed the chicken first!!

Re: Strangest?

b0llchit

It froze just before hitting the blades.

Re: Strangest?

H in The Hague

"I hope they thawed the chicken first!!"

This is probably apocryphal:

A few decades ago the folk working on high speed trains decided they needed to test the windscreen for resistance against bird strikes. So, taking inspiration from aerospace, they fired chickens at it, which always shattered the windscreen, however strong it was. Finally they asked their aerospace colleagues for advice and were told "Thaw the chicken first."

A good weekend to all Commentards -->

"What's the strangest reason you've been forced to stop work?"

jmch

I can't remember the exact details now, but there was a time when some legal bods decided our team couldn't access the data we needed, so we were twiddling our thumbs for a few days before it got sorted. I'm pretty sure that there will be a vast number of IT pros working with financial or government customers who have similair stories.

The other issue I came across but didn't impact me directly was location-based. Due to some legal minutiae, offshore team members from certain countries were not allowed to work in our base country at all, and to be on the safe side, our legal team banned them from coming to the office. So when we had our onsite team meetings, they would travel as tourists and we had our 'team days' at the nearest pub.

No strange reason to stop work but I did spot an old box still in action

Michael H.F. Wilkinson

But I did spot an ancient HP-1000 mini-computer from 1977 or so chugging away processing data from the Westerbork Radio Synthesis Telescope (at one time one of the largest radio telescopes in the world) in 1996. It basically had been chugging away since the commissioning of the telescope. By the time of my visit they had set up a Linux PC to process the same data, and wanted it running 24/7 for a year before considering decommissioning the HP-1000. Some old boxes are very hard to kill.

Re: No strange reason to stop work but I did spot an old box still in action

GlenP

That's reminded me of a piece of inspection equipment my Dad "inherited" for his department when another factory closed down. It was a quite revolutionary, for it's time, 3D measuring system driven by a PDP-8! This would be in around 1990, I can't remember the specific model so I'm not sure how old it was but apparently an engineer almost fell about laughing when he saw it.

Lightning

GlenP

Way back in the mid 80s our DEC support contract was, IIRC, a 4 hour response (might even have been 2 hours) during office hours but once on-site the engineer would continue until fixed.

About 19:00 one evening, and waiting for the relevant part, there was a distant sound of thunder so the engineer decreed that the risk of a lightning strike was too high to continue, and that he'd return the next day! I didn't really blame him, it wasn't critical to get the system back up that night and I wanted to get home as well.

How did you get into this room?

ColinPa

A colleague and I were working at a large bank in the US. We had been given a temporary (paper) badge for the week. Every day we had to go in through the main entrance, speak to reception who would phone for one of our contacts to come and meet us and escort us to the secure operations area where we were working.

On Friday, we parked the car as usual, and spotted the external badge lock doors were open, so we went in, up in the lift to our floor. The cleaner was in cleaning the secure area, with the power cables keeping the door open.

We said "hello" to the cleaning lady, sat down and started working.

Half an hour later the manger came past and said "hi... how did you get in here?" (as we were meant to be escorted every where).

We explained and he said "Ahh we had a power blip on the exterior doors - and they default to open for the first 30 seconds until they connect to the controller." He also fixed the cleaner's problem, by giving them their own power socket in the secure area, and some education.

The medical test case

ColinPa

I was involved in world wide games event. One day was "disaster day" when disruptive activities were planned, such as dropping power to one site, unplugging the network, a team is down with food poisoning. I had nothing to do - just be on call.

As I got out of bed that morning, I pulled a muscle in my back ( too long spent bending over low tables), and phoned in on the medical emergency number.

I lay on the floor of my hotel room as this was the place of least pain. After an hour I phone in again, saying I needed to go to the bathroom, could not get up, and was going to wet myself.

5 minutes later there was a knock at my hotel room door - "come in" I said... the person went away and came back with a master key.

There was a doctor's just across the road. (Who did not speak English) and got it sorted. Taking the "patient history" was interesting. "Nephrites? " "OK", "Pulmonary?" OK etc.

After he manipulated my back, he gave me a "happy pill" which eased the pain and made me feel very happy.

A couple of days later I was talking to one of the senior organisers about the incident, and she looked very embarrassed. When I phoned in they thought I was the "medical test case", and put it low in the list of problems to be resolved. It wasn't till my second call that they realised they had a real emergency and needed to so something about it.

Wargaming

Aladdin Sane

My dad was in the navy and during one of these exercises on an airbase was assigned to the opposing force (AKA "The Bad Guys"). As such, in the week before the official start he began hiding bundles of broom handles cut down to the size of dynamite.

After the fourth one was discovered the exercise was scrapped before it began.

Air traffic control system redeployments

PickledAardvark

"during this job Lyle noticed a very old Sperry-Unisys computer ticking away. He later learned those machines were eventually ripped out of the base … to provide parts for real live air traffic control systems that relied on the same ancient platform and had run out of spares."

During the Y2K build-up, I heard from a friend at GEC-Alsthom that some outdated Apollo workstations suffered a similar fate in the UK.

A nice intro

KarMann

When I was considering joining the AF (of the US variety, though I did end up at a base of the R variety eventually), and going to visit the base and shop where I might be serving, my visit happened to be scheduled on a day they were doing just such wargames, unbeknownst to me (but beknownst to us). As I tended to a rather iconoclastic, gothy mode of dress back then, and still had very long hair (and was/am male), the SPs (I think they already weren't called APs, Air Police, back then) thought it just had to be some of the wargame planners taking the piss, and I found myself prone in a ditch with one or two aforementioned SPs keeping their guns on me. It didn't take too long for them to sort out that I was supposed to be there, probably only about three years, or that's what it felt like.

And as for the IT angle, it isn't clear whether Lyle was at an RAF, USAF, or other-AF base, but we were cursed with a system known as Banyan Vines, which I rather loathed. Almost put me off the whole IT thing right then & there. I'm glad I did find out it could be better, eventually. But I'll give Lyle the benefit of the doubt, and assume he wasn't personally responsible for that.

Maybe you can't buy happiness, but these days you can certainly charge it.