DARPA worried battlefield mixed reality vulnerable to 'cognitive attacks'
(2023/10/12)
- Reference: 1697121612
- News link: https://www.theregister.co.uk/2023/10/12/darpa_worried_battlefield_mixed_reality/
- Source link:
DARPA is launching a program to head off "cognitive attacks" for mixed reality headsets that could, in theory, cripple future warfighters when deployed.
The forthcoming Intrinsic Cognitive Security (ICS) program was [1]sent out to tender this week, along with a proposers' day on October 20. On that day, DARPA officials will let bidders know what exactly they want from an ICS system that protects against attacks targeting soldier senses.
Per DARPA's notice, cognitive attacks are defined as any adversarial action that "exploits the intimate connection between users and MR equipment." Such attacks have much in common with typical cyberattacks, like information flooding to force latency, the injection of virtual data, or disruptions of personal area networks.
[2]
Cognitive attacks go beyond just disrupting MR headsets and can also include actions like planting real-world objects to overwhelm displays, using physical objects to cause false alarms, and using eye trackers to assess what a wearer is doing. The end result, ultimately, is a soldier with a headset that's either sending them bad info or a piece of hardware that has become so laggy that it makes them nauseous and unable to function.
[3]
[4]
"The core technical hypothesis of the program is that formal methods can be extended with cognitive guarantees and models to protect mixed reality users from cognitive attacks," DARPA said in its tender announcement.
Formal methods "are rigorous, mathematics-based approaches to provide guarantees about computer-based systems," according to DARPA. To extend that further, NASA [5]notes that formal methods "provide a means to symbolically examine the entire state space of a digital design (whether hardware or software) and establish a correctness or safety property that is true for all possible inputs."
[6]
In other words, DARPA wants to mathematically represent cognitive models of "human perception, action, memory and reasoning" and figure out how to build some form of universal protection against cognitive attacks.
"The ICS program will extend formal methods by explicitly creating and analyzing cognitive and other models as part of MR system development to protect the warfighter from adversary attacks," the research agency said.
"Formal methods have not been widely used before to protect MR users, but the cognitive engineering field provides principles upon which models and guarantees can be formulated," a DARPA spokesperson told The Register .
Who needs attackers for mixed reality nausea?
DARPA's ICS cart is moving a bit faster than the Microsoft-derived horse it's tied to, with the US Army's 2022 tests of mixed reality HoloLens headsets finding that it took mere hours of wear for soldiers to report [7]headaches, eyestrain and nausea from the devices.
The Army has worked with Microsoft since 2021 to develop the Integrated Visual Augmentation System (IVAS) out of custom HoloLens hardware, but so far the project hasn't gone that well.
[8]
Tests in 2021 were delayed due to technical concerns, and an [9]audit by the DoD's Inspector General last year expressed concern that the whole thing would be a waste of nearly $22 billion because the Army didn't bother to define minimal user acceptance thresholds for fielding of the device.
In January of this year, Congress [10]killed funding for all but development of better IVAS headsets; the Army had asked for $400 million to buy another 6,900 of them, but representatives decided that it only got $40m, and all that had to go toward developing IVAS version 1.2.
[11]Microsoft's mixed reality dream meets harsh reality of job cuts
[12]US Army may be about to 'waste' up to $22b on Microsoft HoloLens
[13]How to shave years off the journey from military lab to real-world use
[14]Here's what the US Army picked for soldier-worn tactical USB hubs
According to the Army Times , prototypes of IVAS 1.2 were delivered to soldiers for testing in August, and by early September the Army [15]approved further development of the new headsets to make them more affordable and mass-producible, and to integrate the headsets with the military's tactical cloud systems.
Given it is still early days for DARPA's ICS program, soldiers testing IVAS and other mixed reality devices won't be able to rely on cognitive security features anytime soon. We asked DARPA when such technology could make it beyond the lab, and while it unsurprisingly wasn't able to provide a date, the agency seems confident it'll be able to get ICS work done before mixed reality sees widespread battlefield use.
"Methods for developing protected MR systems will be developed by the ICS program before MR systems lacking protections are pervasive and essential," we're told. ®
Get our [16]Tech Resources
[1] https://sam.gov/opp/fefac8c883e041528c48397e3da461ee/view
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://shemesh.larc.nasa.gov/fm/fm-what.html
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2022/10/13/us_army_report_microsoft_hololens/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.dodig.mil/reports.html/Article/3007502/audit-of-the-armys-integrated-visual-augmentation-system-dodig-2022-085/
[10] https://www.theregister.com/2023/01/12/congress_hololens_microsoft/
[11] https://www.theregister.com/2023/01/24/microsoft_mixed_reality_cuts/
[12] https://www.theregister.com/2022/04/26/army_microsoft_headset/
[13] https://www.theregister.com/2023/01/26/darpa_tech_incubator/
[14] https://www.theregister.com/2023/05/08/us_army_usb/
[15] https://www.armytimes.com/news/your-army/2023/09/07/army-approves-next-phase-for-augmented-reality-device/
[16] https://whitepapers.theregister.com/
The forthcoming Intrinsic Cognitive Security (ICS) program was [1]sent out to tender this week, along with a proposers' day on October 20. On that day, DARPA officials will let bidders know what exactly they want from an ICS system that protects against attacks targeting soldier senses.
Per DARPA's notice, cognitive attacks are defined as any adversarial action that "exploits the intimate connection between users and MR equipment." Such attacks have much in common with typical cyberattacks, like information flooding to force latency, the injection of virtual data, or disruptions of personal area networks.
[2]
Cognitive attacks go beyond just disrupting MR headsets and can also include actions like planting real-world objects to overwhelm displays, using physical objects to cause false alarms, and using eye trackers to assess what a wearer is doing. The end result, ultimately, is a soldier with a headset that's either sending them bad info or a piece of hardware that has become so laggy that it makes them nauseous and unable to function.
[3]
[4]
"The core technical hypothesis of the program is that formal methods can be extended with cognitive guarantees and models to protect mixed reality users from cognitive attacks," DARPA said in its tender announcement.
Formal methods "are rigorous, mathematics-based approaches to provide guarantees about computer-based systems," according to DARPA. To extend that further, NASA [5]notes that formal methods "provide a means to symbolically examine the entire state space of a digital design (whether hardware or software) and establish a correctness or safety property that is true for all possible inputs."
[6]
In other words, DARPA wants to mathematically represent cognitive models of "human perception, action, memory and reasoning" and figure out how to build some form of universal protection against cognitive attacks.
"The ICS program will extend formal methods by explicitly creating and analyzing cognitive and other models as part of MR system development to protect the warfighter from adversary attacks," the research agency said.
"Formal methods have not been widely used before to protect MR users, but the cognitive engineering field provides principles upon which models and guarantees can be formulated," a DARPA spokesperson told The Register .
Who needs attackers for mixed reality nausea?
DARPA's ICS cart is moving a bit faster than the Microsoft-derived horse it's tied to, with the US Army's 2022 tests of mixed reality HoloLens headsets finding that it took mere hours of wear for soldiers to report [7]headaches, eyestrain and nausea from the devices.
The Army has worked with Microsoft since 2021 to develop the Integrated Visual Augmentation System (IVAS) out of custom HoloLens hardware, but so far the project hasn't gone that well.
[8]
Tests in 2021 were delayed due to technical concerns, and an [9]audit by the DoD's Inspector General last year expressed concern that the whole thing would be a waste of nearly $22 billion because the Army didn't bother to define minimal user acceptance thresholds for fielding of the device.
In January of this year, Congress [10]killed funding for all but development of better IVAS headsets; the Army had asked for $400 million to buy another 6,900 of them, but representatives decided that it only got $40m, and all that had to go toward developing IVAS version 1.2.
[11]Microsoft's mixed reality dream meets harsh reality of job cuts
[12]US Army may be about to 'waste' up to $22b on Microsoft HoloLens
[13]How to shave years off the journey from military lab to real-world use
[14]Here's what the US Army picked for soldier-worn tactical USB hubs
According to the Army Times , prototypes of IVAS 1.2 were delivered to soldiers for testing in August, and by early September the Army [15]approved further development of the new headsets to make them more affordable and mass-producible, and to integrate the headsets with the military's tactical cloud systems.
Given it is still early days for DARPA's ICS program, soldiers testing IVAS and other mixed reality devices won't be able to rely on cognitive security features anytime soon. We asked DARPA when such technology could make it beyond the lab, and while it unsurprisingly wasn't able to provide a date, the agency seems confident it'll be able to get ICS work done before mixed reality sees widespread battlefield use.
"Methods for developing protected MR systems will be developed by the ICS program before MR systems lacking protections are pervasive and essential," we're told. ®
Get our [16]Tech Resources
[1] https://sam.gov/opp/fefac8c883e041528c48397e3da461ee/view
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://shemesh.larc.nasa.gov/fm/fm-what.html
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2022/10/13/us_army_report_microsoft_hololens/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/publicsector&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZSgYJMHTzXVSD71BBCvVVwAAAE8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.dodig.mil/reports.html/Article/3007502/audit-of-the-armys-integrated-visual-augmentation-system-dodig-2022-085/
[10] https://www.theregister.com/2023/01/12/congress_hololens_microsoft/
[11] https://www.theregister.com/2023/01/24/microsoft_mixed_reality_cuts/
[12] https://www.theregister.com/2022/04/26/army_microsoft_headset/
[13] https://www.theregister.com/2023/01/26/darpa_tech_incubator/
[14] https://www.theregister.com/2023/05/08/us_army_usb/
[15] https://www.armytimes.com/news/your-army/2023/09/07/army-approves-next-phase-for-augmented-reality-device/
[16] https://whitepapers.theregister.com/
So, we're on track for full electronic warfare
Reminds of a passage from Star Wars Volume 3: The Last Command (Timothy Zahn). I type the excerpt below :
"I'm Councilor Organa Solo," Leia identified herself. "This is Ghent, an expert slicer. Can you use him ?"
"I don't know," the colonel said, throwing the kid a speculative look. "Ever tackled an Imperial battle encrypt code, Ghent ?"
"Nope," Ghent said. "Never seen one. I've sliced a couple of their regular military encrypts, though."
"Which ones ?"
Ghent's eyes went a little foggy. "Well, there was one called a Lepido program. Oh, and there was something called the ILKO encrypt back when I was twelve. That was a tough one - took me almost two months to slice."
Someone whistled softly. "Is that good ?" Leia asked.
The colonel snorted. "I'd say so, yes. ILKO was one of the master encrypt codes the Empire used for the data transfer between Coruscant and the original Death Star construction facility at Horuz. It took us nearly a month to crack it." He beckoned. "Come over here, son - we've got a console for you right here. If you liked ILKO, you're going to love battle encrypts."