News: 1642764246

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

'Please download in Microsoft Excel': Meet the tech set to monitor IT performance across central UK government

(2022/01/21)


Exclusive The UK's Cabinet Office has launched a new approach designed to assess the IT resource needs of central government departments and measure their performance: emailing a spreadsheet and asking for multiple replies.

In a letter seen by The Register , Joanna Davinson, executive director at the Central Digital and Data Office (CDDO), said her team had created a Minimum Viable Product (MVP) Digital Dashboard which in December was presented to the Functional Leadership Group.

That MVP has now been sent to Whitehall's chief digital and information officers (CDIOs).

[1]

"We kindly

request

that your department shares data with our team by completing the attached workbook; please download the workbook in Microsoft Excel for the best user experience," she said.

[2]

[3]

CCIOs were told to send completed returns, presumably via an attachment, by 21 January.

According to Davinson's letter, the information from departments would be used to assess if departments required additional funding, track performance, and enable departmental benchmarking.

[4]

"This dashboard will be shared internally within the CDDO to support discussions and internal analysis. The update dashboard will also be shared with CDIO colleagues across government; the dashboard or underlying data will not be shared outside government," the letter read.

According to the workbook seen by The Register , the CDDO asks about the percentage of "legacy technology that the department is currently running and maintaining" and the percentage currently running "without up to date vendor support."

The workbook says:

Legacy technology can refer to your organisation's IT infrastructure and systems, hardware, and related business processes. Technology becomes legacy because of any or all of the following points. The technology now is considered an end-of-life product, out of support from the supplier, impossible to update, no longer cost-effective, or now considered to be above the acceptable risk threshold.

Central government is responsible for billions of pounds in IT spending. In Her Majesty's Revenue & Customs alone [5]a £7bn IT procurement exercise is in full swing, and appears to be slipping.

Observers might wonder why the team, supposedly the leaders of Whitehall's thrust towards digital modernisation, is using spreadsheets to share data, as well as preferring a method (download) whereby multiple copies of data may be created – making them inconsistent and insecure if shared via email.

[6]

A Cabinet Office spokesperson said the Digital Dashboard was designed to track digital performance and capability across government using a range of measures.

"The current Excel-based data commission is being used to develop an early pilot of the Dashboard, ahead of moving to a more performant solution over time, in line with agile delivery best practice," he said.

"The Dashboard metrics have been developed in collaboration with the cross-government Digital, Data and Technology (DDaT) community."

[7]UK data watchdog slaps Ministry of Justice with Enforcement Notice for breaking GDPR law

[8]UK government backs away from proposals to remove individuals' rights to challenge AI decision making

[9]UK police lack framework for adopting new tech like AI and face recognition, Lords told

[10]Key pillar in the UK's border control upgrade programme 'lacks a systems integrator'

In a separate project, Davinson is also hoping to launch a "tool" to track legacy applications in detail. In September last year, she revealed to MPs that the government had no dynamic list of risks associated with legacy applications, some of which date back to the 1980s.

"[What] we don't yet have as clearly as I would like is an ongoing process for really assessing and understanding what our cross-government legacy risk looks like, and in what direction it's going, and where do we need to intervene," she told the Public Accounts Committee (PAC).

Some 50 per cent of the $4.7bn government spent on tech in 2019 was estimated to be dedicated to “keeping the lights on” activity on “outdated systems”, according to a report entitled Organising for Digital Delivery, [11]written by the Digital Economy Council last summer . Further, it estimated that over the next five years this cost could rise to between £13bn to £22bn.

In its report, published in December

[12]PDF

, the PAC said the government had "no clear plan" for how it would replace its legacy IT estate, which can create risk across government.

In September, the country's public spending watchdog, the National Audit Office, revealed that a [13]34-year-old ICL mainframe system was one of the causes of a scandal which led to more than £1bn of state pensions not being paid .

The Home Office's programme to replace the [14]Police National Computer was delayed by at least five years with an associated cost overrun of more than £400m , said a PAC report.

Also in September, Davinson [15]told MPs her team intended to have a "tool" to monitor legacy applications ready by the beginning of 2022, although that launch date has been delayed.

Davinson has a certain amount of form in government IT. Speaking to the PAC as chief digital, data and technology officer at the Home Office in September 2020, [16]she admitted that delays to the controversial Emergency Services Network, designed to support emergency calls from fire crews, the ambulance service and police, would cost £550m per year.

The 4G-based system was originally planned to be up and running by 2017 but by 2019 was delayed by five years. A "mindset reset" in 2018 meant the scheme to upgrade Britain's blue-light comms network might not be fully available before the end of 2024.

The ®

Get our [17]Tech Resources



[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YermtiBF3IdsUlVWQXAbWwAAAII&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YermtiBF3IdsUlVWQXAbWwAAAII&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YermtiBF3IdsUlVWQXAbWwAAAII&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YermtiBF3IdsUlVWQXAbWwAAAII&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[5] https://www.theregister.com/2021/12/07/hmrc_procurement_timetable/

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YermtiBF3IdsUlVWQXAbWwAAAII&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[7] https://www.theregister.com/2022/01/19/ico_slaps_ministry_of_justice/

[8] https://www.theregister.com/2022/01/19/uk_government_back_away_from/

[9] https://www.theregister.com/2022/01/19/uk_police_lack_framework_for/

[10] https://www.theregister.com/2022/01/14/uk_border_upgrade_confusion/

[11] https://www.theregister.com/2021/08/13/mckinsey_awarded_3m_8_week_contract/

[12] https://committees.parliament.uk/publications/8146/documents/83439/default/

[13] https://www.theregister.com/2021/09/22/icl_mainframe_uk_pension_errors/

[14] https://www.theregister.com/2021/09/13/nao_home_office_nleds_report/

[15] https://www.theregister.com/2022/01/10/government_tool_to_monitor_its/

[16] https://www.theregister.com/2020/09/15/mindset_reset_emergency_services_network/

[17] https://whitepapers.theregister.com/



Ideal for data

Primus Secundus Tertius

Spreadsheets are ideal for data. But it is a pity they could not use a generic spreadsheet that will work equally with Libre Office, Google Office, Softmaker Office, ONLYOFFICE, or even good old Gnumeric.

When I was claiming Gift Aid tax rebates for a small charity, I downloaded the appropriate spreadsheet from HMRC. There was one version for Excel and one for Libre Office Calc. Other spreadsheets were unsupported. The problem seems to be the manic desire to incorporate macros within spreadsheets.

Re: Ideal for data

TRT

Databases are ideal for data. Spreadsheets are ideal for... erm... well... spreading sheet I guess.

Re: Ideal for data

Snapper

You spelt sheet wrong.

Pascal Monett

Yeah, but there might be kids around.

Or PC* nazis, which are the same intellectual level.

*) not the computer

John Robson

Seems reasonable to me - better than spaffing 20 billion on a unified web interface that won't be delivered until 2039, and then won't actually support dates past the 32 bit "issue".

GioCiampa

Assuming, of course, that there are enough rows for all the data...

https://www.theregister.com/2020/10/05/excel_england_coronavirus_contact_error/

Prst. V.Jeltz

just from memory without re reading your kindly supplied url ,

wasnt that because they were using Excel 1972 or something?

hopefully in their quest to hunt down unsupported software they've pushed the boat out installed office 2017 or similar and now can do more than 256 rows !

good to go!

Yet Another Anonymous coward

>wasnt that because they were using Excel 1972 or something?

No it was because they couldn't do the import properly so they ran out of columns

They managed to make a spreadsheet where each entry was a new column !

low_resolution_foxxes

I always laugh when IT consultants say something along the lines of "We could modernize these 3 simple spreadsheets that don't have any problems, replace them with a bespoke SAP-integrated cloud blockchain solution!".

Cue a project director, 3 months of contract haggling, endless training and the end product is just as shitty as the original .XLSX that at least mere mortals could open without 18x IT helpdesk requests.

Whenever there is an IT project like this, I always ask the group: "if this was your money, would you stick with a simple spreadsheet, or spend £100k replacing the simple thingy with a complicated thingy?

TRT

1. Depends how costly a mistake in those spreadsheets is and how likely it is that a mistake is made.

2. If the spreadsheets really are that simple, why do you even need a bespoke SAP integrated cloud blockchain solution which involves 3 months of contract haggling and endless training? Either do it in-house or the requirement has been over specified in the modernisation effort - like adding in blockchain for no readily apparent reason.

3. If the thing you do, question you ask, is as you say, then you aren't an IT consultant (or at least not one from a company that stands to gain from getting the contract to produce the solution). In my experience IT consultants like that are actually from sales.

Binraider

For all of the obvious foibles of open file exchange, any-user editing, weak input controls and audit trails... One can never underestimate the value of a good spreadsheet!

For the specific problems being addressed here a whopping great ERP system to merge all ERP systems is let's face it, a patent non starter

At least not until we can tell computers to go away and build something on their own - and figure out the often terrible scope and specifications one has to work with.

in line with agile delivery best practice

Howard Sway

Presumably this is the "build one to throw away" idea (which is from The Mythical Man Month, well before agile descended upon as the ultimate meaningless buzzword). This argues that you should build a quick-and-dirty prototype for any major system, in order to understand the requirements more fully, then throw it away and build it in a proper robust manner.

However, what they have misunderstood is that you don't build your prototype using a completely different technology (excel) to the one you plan to use to build the application with, as you don't learn anything about how it should be done that way.

Re: in line with agile delivery best practice

Tim99

Sometimes the "build one to throw away" becomes the "it works, we’ll keep it”. This will be used until it blows up because of problems of scale; lack of (referential) inegrity; not "one source of truth"; etc…

Re: in line with agile delivery best practice

TRT

Sometimes??

Most of the time.

Re: in line with agile delivery best practice

spireite

I've seen some shocking systems in my time that have sprung up from 'disposable' MVPs that weren't disposed of.

At that point the business is shafted because of stupidity lock-in

J.G.Harston

My version of Excel doesn't have a download function. I typically use Firefox for that. Is Office following the emacs paradigm? "Everything eventually becomes an email client."

Doctor Syntax

"Everything eventually becomes an email client."

And a web server.

katrinab

Click on the Data Tab

then "From Web"

enter the url of the file you would like to download

Do stuff in PowerQuery

Click "Close & Load"

then you have downloaded data using Excel

This has the benefit that if your remote datasource is changed, then the changes will update on your spreadsheet.

Oops…

cookieMonster

Er……

“ ; the dashboard or underlying data will not be shared outside government," the letter read.

According to the workbook seen by The Register”

Re: Oops…

Yet Another Anonymous coward

Conclusion - el'reg is part of the government.

Re: Oops…

AndrueC

That's a nasty thing to say on a Friday.

Straight out of Yes Minister

cookieMonster

"The current Excel-based data commission is being used to develop an early pilot of the Dashboard, ahead of moving to a more performant solution over time, in line with agile delivery best practice,"

Who makes this s$&t up???

heyrick

Proof that Excel can be used for everything...

...it isn't supposed to be used for.

Zippy´s Sausage Factory

Meanwhile, mine keeps crashing when I try to use it for the things it is supposed to be used for... sigh

And what's MS response? Do they fix the bugs? No, just another diet of ugly pills to make it look like macOS 9 - er, I mean Windows 11...

"please download the workbook in Microsoft Excel for the best user experience"

Pascal Monett

I have yet to have trouble opening an Excel file in LibreOffice.

It's a great user experience because I don't have Borkzilla's 365Eye watching everything I do while just looking over some numbers.

Prst. V.Jeltz

Observers might wonder why the team, supposedly the leaders of Whitehall's thrust towards digital modernisation, is using spreadsheets to share data, as well as preferring a method (download) whereby multiple copies of data may be created – making them inconsistent and insecure if shared via email.

well 7 billion will only get you so far ....

One thing guaranteed to make me break down in tears...

TRT

is when I've been called into some autopsy meeting because something bad has happened due to a mistake made in an administrative task based around Excel spreadsheets. Actually, that's not the thing that makes me cry... the thing is when I've spent a month or more converting that administrative process into a database backed web app with auditing, sanity checking, roll-back features, immutable backup to the cloud offsite, user input warnings, multi-user capability, record-locking etc, importing all the historic data kept in the excel spreadsheets, checking it, fixing it, double checking it, getting someone else to triple check it, testing it, getting the most IT illiterate I can think of to test it for UI/UX quality, THEN taking something I think is finally a complete package that would work well even if it became the final version because of the way these things tend to work out, presenting it to the administration team as a beta for feedback and further refinement etc. (I think they call it AGILE now, but it's really how I've always worked), and getting back comments that it's absolutely brilliant but lacking only one thing - the ability to filter the data and export it as an Excel file.

And then I spend the next week crying into my teacup as I tack on my pre-built Excel export interface code and tweak it to match the application, knowing full well that all they're going to do is open the exported file in Excel and start adding new data to it instead of using the web app because that's the way they've always done it and that's the process they are familiar with no matter how closely I've tried to match the Web Application to the way I've observed the process being done. I know from experience that even if I create the export file as read-only and password locked, they'll demand the password to unlock it and make it read/write.

Re: One thing guaranteed to make me break down in tears...

TRT

Actually, re-reading that, I'm being unfair to my wonderful colleagues in the administration team.

They usually ask for the ability to filter and export as Excel because they often have to communicate their activities to other administration teams in the wider organisation, and they only seem to use Excel judging by the over-elaborate, Macro-laden, looks-like-shit "Applications" that come from there.

The conversation usually goes something like... "Your summary looks great, but can you supply those figures as an Excel file instead of a PDF please? Makes it easier to transfer it into a spreadsheet when we produce the summary figures for the end-of-year report."

I said "Applications" earlier... because I don't know the word for what they actually are. "Web Apps" are just websites with additional interactivity and functionality like a traditional application... what I see from Central are "Excel files with additional interactivity and functionality"... and I don't know what to call these "Excel-based data capture arrangements"... "Excrements" perhaps?

Prst. V.Jeltz

Davinson is also hoping to launch a "tool" to track legacy applications in detail.

This'll be a filtered column on her spreadsheet.

maybe it'll even change the colour of some of the cells.

More Good Advice?

Anonymous Coward

I wonder how much more than £1,000 a day the consultant was charged at, and supplied by one on the usual suspects, no doubt, for

inventing this bit of nonsense. Probably the only It-related tool she/he even knows.

Re: More Good Advice?

TRT

If they produce their written report in landscape format, i.e. it's just a printout of a Powerpoint, then you probably have your answer.

Guess the

Boris the Cockroach

scammers are going to have a field day

From :HMGovernment.co.ru

To:Victim

Please open and complete this excel file detailing your legacy systems.

Please not do mind it scanning your system for errors , or the increace in network traffic as we use your computer as a spam relay

Please pass this file along to your friends/colleges as HMGovernmnet would wish for a full survay

'no clear plan'

Eclectic Man

!!! RANT ALERT !!!

It is unfair to consider the absence of a clear plan for dealing with 'legacy' IT equipment and systems a major failing, (and no, not because this government doesn't have any clear plan about anything), but because this is horrendously complicated. Any overarching 'clear plan' would be so simplistic as to be virtually meaningless, and any detailed plan so complicated that it would be incomprehensible to anyone without a first in Systems Engineering and a PhD in advanced cleverness from the university of clever.

It would have to deal both with innumerable PCs on versions of Windows all the way back to XP, the Cobol system that only 'old Ron' knows how to maintain, but is essential to keep the boiler running in a building that cannot be updated because it is grade 1 listed. It would have to cope with the ICL, Unisys, Amdahl and Prime computing systems used in seriously underground, former mines, oh and the Lotus Notes implementations still in use*, and, of course the outsourced systems that EDS runs on behalf of the department or agency and won't even tell you which site it is in because that was not in the original contract and they'll need a meeting of all the top brass to decide how much to charge for that information (and the meeting will cost you US$10,000 just to arrange, even though the customer won't be there).

So I don't actually blame anyone for not having a clear plan, because a lot of the time any government (Con or Lab) has had a clear plan about major IT infrastructure changes we've seen headlines all over the place about cost overruns, mission creep and failure. It is actually not a simple task, and like quantum mechanics, anyone who says they understand it, doesn't.**

!!! END RANT ALERT !!!

*I honestly have no idea if any of this is actually current, but I bet some of it is.

** R. P Feynman: "Anyone who says he understands quantum mechanics, does not understand quantum mechanics."

AndrueC

"The current Excel-based data commission is being used to develop an early pilot of the Dashboard, ahead of moving to a more performant solution over time, in line with agile delivery best practice," he said.

"The Dashboard metrics have been developed in collaboration with the cross-government Digital, Data and Technology (DDaT) community."

Anyone for a game of [1]buzzword bingo ?

[1] https://dilbert.com/strip/1994-02-22

3rd Law of Computing:
Anything that can go wr
fortune: Segmentation violation -- Core dumped