Electron-to-joule conversion formulae? Cute. Welcome to the school of hard knocks
- Reference: 1631863745
- News link: https://www.theregister.co.uk/2021/09/17/on_call/
- Source link:
Our reader, safely Regomised as "Col", headed up the technical support team of a PABX telecom provider and installer back in the early 1990s. PABX, or Private Automatic Branch eXchange, was the telephony backbone of many an office. A failure could be both contract and career-limiting.
Col, however, was a professional and well versed in the ins and outs of such systems. Work was brisk and so, he told us, "I took on a university grad with all the spunk and vigour that comes with it. He knew the electron-to-joule conversion formulae et al."
[2]
Ah yes, the enthusiasm of youth. We remember that.
[3]
[4]
"His first call at level 3 'buck stops here' support was a rather large customer down the A4/A40 corridor of London whose handsets were randomly dying (blowing out dual extension cards mounted on an IBM backplane)."
The client was well known to Col's company. The shiny young graduate pitched up at the client site, positively fizzing with ideas. Sadly, none worked. By day two he was starting to get desperate, perhaps considering that a career in telephony might not be for him after all. Enter the cunning of age and experience.
[5]
Col was on the phone talking the youth through the next bit of troubleshooting when he heard a loud bang in the background.
"I wondered where the noise had come from," Col told us. "He explained that the door to the comms room had just closed."
[6]Not too bright, are you? Your laptop, I mean... Not you
[7]Oh! A surprise tour of the data centre! You shouldn't have. No, you really shouldn't have
[8]Fix five days of server failure with this one weird trick
[9]So the data centre's 'getting a little hot' – at 57°C, that's quite the understatement
Odd. "From memory, the partition door previously didn't make this sound on closing. I asked if it was a fire check door, he said yes, they all were."
Ah.
Col made a site visit the very next day, armed with a roll of carpet underlay and some double-sided tape. The graduate eyed him nervously – was the grad's failure to resolve the issue about to be rewarded by a sharp tap on the back of the head before being trussed up in the roll and bundled into the back of the company Mondeo?
[10]
Not this time.
A bit more background would be useful at his point: the installation consisted of Northern Telecom SDX PABX cabinets mounted on one-inch-thick fibreboard (the partition walls couldn't take the weight). "I proceeded to double-side tape the underlay to the inside of the SDX cabinet lids," said Col, "and explained to the grad that there was a 5mm gap between the lid and the cards of the system. Every time the new 60kg fire check door slammed, the wall vibrated and loosened more cards to their doom."
He also left a sign on each cabinet warning that the lids must be screwed down.
The client had failed to mention the fire door upgrades during the initial fault finding, meaning that the time spent dealing with the problem was therefore chargeable.
And Col's assistant? He learned that a multitude of fresh qualifications counted for naught in the face of hard-won experience in dealing with users.
Ever found your cunning and experience trumping wide-eyed enthusiasm? Or got a well-thumbed book of things they don't teach on training courses? Share the time your hard-won wisdom saved the day in an email to [11]On Call . ®
Get our [12]Tech Resources
[1] https://www.theregister.com/Tag/on-call
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YURnUxLsvDjiYCIoVFXp6gAAAMw&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YURnUxLsvDjiYCIoVFXp6gAAAMw&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YURnUxLsvDjiYCIoVFXp6gAAAMw&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YURnUxLsvDjiYCIoVFXp6gAAAMw&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2021/09/10/on_call/
[7] https://www.theregister.com/2021/09/03/on_call/
[8] https://www.theregister.com/2021/08/27/on_call/
[9] https://www.theregister.com/2021/08/20/on_call/
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YURnUxLsvDjiYCIoVFXp6gAAAMw&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[11] mailto:oncall@theregister.com
[12] https://whitepapers.theregister.com/
The whole problem hinged on that simple fact.
The project would have been as dead as a doormouse without it...
Once I stopped by a PFY trying to fix an user's Access application that had stopped generating email reports. He was at wit's end, having tried for hours everything he thought might possibly solve the problem. I nonchalantly asked the user if IT had done any upgrade that day. "Hm yes, they installed new printer drivers".
Ah.
After changing the default printer to PDF, the emails started once again being generated. It seems Access (at least the old version in this case) needs the printer driver to generate reports, even if they're not being actually sent to be printed.
It wasn't just Access. Excel didn't like it if it couldn't find the default printer to get the current settings; this was an issue with network printers being in the office and the user working from home,
Fix was much the same, use PDF as the default.
Back in the old days there was no PDF driver
When I first got a PC at home, it wasn't connected to a printer - paperless office...
Well, my office might have been paperless, but Microsoft Office insisted on a dummy printer being installed! That was before the days of PDF printer drivers.
Drivers
We were developing some military kit. Hardware dev. in UK, s/w in US. The US had a mock-up rig of the h/w so that they could debug. In the UK we were always having problems which the US couldn't replicate - startup fails, BSOD, etc. They blamed us, of course, and things were getting rancorous. In the end they sent some SW engineers team over to find the problem. After a fair bit of work they found that the SW configuration of our kit was different from the mock-up in the US. We'd obviously been messing round with it, which wasn't allowed, and heads were going to roll.
The US team had a support contract with a UK company to maintain/repair the servers, processors, printers, etc. Turns out that when the support company sent someone to check or repair something they also did a scan of the system and updated any drivers that were out of date. The support contract had no means of ensuring that changes like these were either authorised by the US or mirrored in the test rig. Since the US company was responsible for the contract it was their fault. US heads never rolled and the Yanks never apologised.
We had some cellular image processing software which would write out details for each object (eg cell or nucleus) it found to CSV. It worked fine on the Linux workstations but when we tried to get it running on the HPC cluster it wouldn't write anything out and the scientists were getting a bit grumbly...
It turns out that the software required the MySQL client to write out CSV files, oddly enough the client wasn't in the cluster's image...
"a multitude of fresh qualifications counted for naught"
Not entirely true. They count on the paper the HR drone looks at.
Someone with a decade or more experience in the field will always know the incidental things that no university course can possibly teach (since the teachers do not go on client site), and will therefor be able to evaluate the total environment of the problem to find the real solution.
Re: "a multitude of fresh qualifications counted for naught"
My grandfather used to create foundations for buildings. This often meant pumping out the water from the holes in the ground.
A Newly Qualified Engineer connected a pipe to the pump, and nothing happened.
My grandfather said turn the pipe round - end to end.
NQE: No - it can make no difference
Grandad - just do it.
NQE: It works!
There was a lining to the pipe, and which had got detached at one end. If you pumped the right way, the lining became smooth and lined the pipe. If you pumped the wrong way, the lining collapsed and caused a blockage.
As Grandad said "teaching new dog old tricks!"
Re: "a multitude of fresh qualifications counted for naught"
Clearly the NQE had never heard of a Tesla Valve
Re: "a multitude of fresh qualifications counted for naught"
We must also remember that a novice view on a problem can be embarrassingly accurate. We had a very large gearbox where the oil pressure-sensors indicated a major problem and the control system correctly prevented start-up. Blocked filter? Faulty pump? Pipes wrongly configured? Sensors faulty? Control fault?Wrong oil? Missing components? With the whole assembly in pieces several times, components replaced, reassembled and much scratching of heads, the new graduate asked if the by-pass valve might be incorrectly configured. After all, the handle could be placed in two ways...... "Don't be daft. Cup of tea would be good". They must have found the real problem whilst I fetched the tea because the system was up and running when I got back.
Re: "a multitude of fresh qualifications counted for naught"
The point of the story, I guess, is that every PFY needs a BOFH; but your comment highlights the other universal truth that every BOFH needs a PFY. Especially if he can take credit for the PFY's work.
Re: "a multitude of fresh qualifications counted for naught"
Where I used to work there was a microscope that connected via optic fibre to some hugely expensive card in the back of the PC. To make it work you had to connect in the wrong way round to the markings on the card. I have no idea who it was who worked that one out...
Not an IT problem, but...
A tiny radio studio in South America - no more than a basic room in a shared, largely residential, block of flats had problems with an upstairs neighbour stomping around in hobnailed boots and generally being a bit noisy.
They asked me to look at the sound-proofing, as the normal solution (acoustic box-within-a-box) would have been both expensive and would have significantly shrunk the available space. My solution? Buy the neighbour a nice thick rug... cheap, worked a treat, and he though the studio was wonderful and sang their praises.
Ask the dog - it has an 80% success rate
We had a technical person who was great at solving problems. He had a photo on the desk next to him, (I think it was of his dog). Before you could ask the person a question you had to ask the photo of the dog - it was said to have an 80% success rate!
The conversation went a bit like
"Hello Dog, this feels really stupid, but I have a problem where... ah I know the answer". Score +1 to the dog.
This was because if you had to explain the problem in simple terms and get your thoughts in order, you often could solve the problem yourself.
I read an article where it described if you are looking for something, ask yourself the question aloud "Where is the ..." this causes a different part of the brain to be used, and bypasses the temporary blindness
Re: Ask the dog - it has an 80% success rate
Sounding board... I've been the one to listen to the users issue, and ask them to walk me through their issue, only to have the coin drop and resolve the issue themselves! That's a Win-Win!
Re: Ask the dog - it has an 80% success rate
https://en.wikipedia.org/wiki/Rubber_duck_debugging
Although, with me, it's not a rubber duck I talk to but a non-programmer. I've lost count of the number of times I'd be explaining a knotty coding issue to someone when they'd notice the light coming on behind my eyes. "Gotta go!"
Re: Ask the dog - it has an 80% success rate
I'm a PM with a technical background but definitely not a developer. I always encourage devs who are struggling with a thorny issue to describe the problem to me, If they spend the time to describe what they are doing in terms I can understand then they almost always have the answer before they have finished talking.
If they get all the way through and we don't have an answer they have enough detain for us to get the team together and we'll walk through it until we find a solution.
Invariably they will have uncovered something during our discussion that will give someone else an insight that leads to a fix, often a quick chat between two developers leaves a lot of assumptions about what's been done, sometimes we do need to go down into the detail, even walking g through the code to get a resolution
Re: Ask the dog - it has an 80% success rate
The opposite.
Two guys in a team were having a technical discussion and could not resolve which of two solutions to use. They went to their manager. They had a meeting to discuss it, and after a while the boss said, I think you've made some progress, go away and work on it. Come back in 2 days.
The same thing happened, and again.
I heard the two guys complaining that their manager was useless - he didn't decide which solution to use. Totally useless etc. .
Eventually they came to a decision.
The manager said you are both experts in this field, how did you expect me,who only knows the concept to make a technical decision. My job was to get you guys to resolve it.
Afterwards (this was down the pub) the two techies said "he's right. he should not have been asked to make the decision. His job was to make us decide. Perhaps he is a good manager after all"
Re: Ask the dog - it has an 80% success rate
Ah, yes. I used to refer to that as "Teddy Bear debugging" ...
... until the fateful day when I turned to my colleague, explained the problem, worked out the issue and then, while he continued to remain silent and with no further context, I announced "You are my Teddy Bear".
I briefly considered exiting via the window.
I think "you are my rubber duck" would have been better, but still weird
Re: Ask the dog - it has an 80% success rate
I do that with crossword clues. The act of reading the clue out loud makes you hear it as well as read it, and a different part of the brain thinks about it and bam you have the answer, often before you've finished reading the clue out, which annoys/frustrates everyone who's listening.
Re: Ask the dog - it has an 80% success rate
"Yes, I talk to myself, it's the only way to get an intelligent conversation around here!"
"electron-to-joule conversion formulae"
That would be ""electronvolt""
$ units -1 "electronvolt" "joule"
* 1.6021766e-19
At least two ways of dealing with problems
Many years ago when I worked for the local power company we checked clearances from the >100kV power lines to ground with a laser survey. Turns out there were quite a few places where the stringing calculations done in the 1950s to 1970s weren't so good and the mandatory clearances weren't there, so there was a big program to fix it up, and to get more clearance (and hence more power capacity) for critical spans. All costly especially as the power couldn't be turned off until other lines had been upgraded.
One of the property offices had the realisation that the reason the clearance on one site wasn't good enough wasn't helped by a farmer building an illegal dam on the transmission easement. The farmer was 'encouraged' to remove the dam, and then to remove a bit more of the hill. Just shows that line clearance can be achieved by raising lines or lowering ground.
Electron doesn't work
You cannot convert an electron to joules. You can convert electron-volts to Joule, though.
Re: You cannot convert an electron to joules.
Throw a positron at it. :-)
At least they had a firedoor...
One of my previous employers had a server room in one end of the warehouse (think warehouse large enough to have 2 lorry loading docks) - loads of dust, variable temps and then we get to the access for the room..
Gap underneath, a mag lock (that could be opened with a hard drive magnet) and a door made of the finest in bottom of bargain basement plywood that flexed significantly when opening or closing it.
About as fireproof as a PFY'S underpants and as secure as locking a bike up with a paperclip...
Oh and their PABX was behind a network switch server rack and required squeezing past enough cabling to freak out a certain Dr. Jones with cries of "why is it always snakes?". Didn't help when age finally started to kill the cards.
Re: At least they had a firedoor...
I worked in one building where one server room was completely off limits. It was in a Victorian building and over the time the weight of the racks had increased to the point that one of the floor beams had cracked.
This had been the original server room when the company started but as it grew additional rooms were build in other buildings.
All the kit in that room was all approaching end of life and so if it failed it was replaced in a rack in another server room.
It was in that condition for a couple of years until they moved to new premises.
During decommissioning the kit was taken out 1 server at a time with only one person being allowed in the room at any point. Only the two youngest (and lightest) engineers were allowed in.
Re: At least they had a firedoor...
"Youngest (and lightest) engineers."
Because they'd yet to succumb to the effects of years of Friday liquid lunches?
Nortel clearly learnt from this...
The "Option" range could by hit by a nuclear bomb and still keep working.
The 81 was the most reliable kit I ever worked on. You counted outages in times per decade, not per year (or month as seems to be the case for "cloud")
Re: Nortel clearly learnt from this...
Did Norton go bust because their stuff was so reliable their customers didn't need to buy anything?
I'm pleased they got a handle on the door problem...