In the lab: Robotic AI-powered exoskeletons to help disabled people move freely without implants
(2021/03/18)
- Reference: 1616049187
- News link: https://www.theregister.co.uk/2021/03/18/robotic_exoskeleton_ai/
- Source link:
Canadian boffins are testing semi-autonomous exoskeletons that could help people with limited mobility walk again without the need for implanted sensors.
Researchers at the University of Waterloo, Ontario, are hard at work trying to combine modern deep-learning systems with robotic prostheses. They hope to give disabled patients who have suffered spinal cord injuries or strokes, or are inflicted with conditions including multiple sclerosis, spinal, cerebral palsy, and osteoarthritis, the ability to get back on their feet and move freely.
[1]
The project differs from other efforts for amputees that involve trying to control the movement of machines using electrodes implanted in nerves and muscles in the limbs and brain, [2]explained Brock Laschowski, a PhD student at the university who is leading the [3]ExoNet study . “Our control approach wouldn’t necessarily require human thought. Similar to autonomous cars that drive themselves, we’re designing autonomous exoskeletons that walk for themselves.”
[4]
The computer-powered exoskeleton gear ... Source: University of Waterloo
[5]
Like self-driving cars, the robotic limbs are kitted out with sensors and cameras that feed images taken from the surrounding environment to computer-vision algorithms. These are used by the exoskeleton's control systems to carry out specific actions – whether it’s walking, standing, sitting, or going up and down stairs – all while comprehending and navigating the environment as necessary. People strapped into these exoskeletons thus are able to move around, with the software handling the necessary movements.
Having said that, ExoNet is still in its infancy. Laschowski and his colleagues began by [6]collecting data to train the convolutional neural networks in the computer vision portion of the software. Cameras were strapped to participants' chests, waists, and calves, and they were instructed to walk around to gather information to teach the models.
Our environment recognition system, which uses wearable cameras and AI algorithms, is used to estimate upcoming locomotor activities and therefore allow robotic exoskeletons to predict and plan accordingly to different walking environments
Hours of footage was recorded and sorted into nearly a [7]million images that were then labelled to describe specific motions, including walking on level ground, walking up and down stairs, and meeting various objects, such as doors, walls, and seats.
“Data from wearable sensors are used to control robotic exoskeletons by inferring the user’s locomotor intent, for example, wanting to walk upstairs,” Laschowski told The Register . "Our environment recognition system, which uses wearable cameras and AI algorithms, is used to estimate upcoming locomotor activities and therefore allow robotic exoskeletons to predict and plan accordingly to different walking environments."
In other words, the system tries to figure out what to do from the situation the wearer finds themselves in.
If the algorithms detect something like stairs, the code sends this information to the exoskeleton’s control system to kick-start the series of commands to lift the knee and step up or down. If it sees a wide flat ground, it’ll be more likely to send instructions to the machine to activate a different set of controllers used for walking, or if it recognizes a door, the software should correctly guess the user is trying to open it and get the exoskeleton to slow down and stand still.
Exoskeletons-as-a-service offered as helping hand to warehouse workers exhausted by pandemic [8]READ MORE
Deep-learning systems have advantages over other traditional algorithms that have been used to control prosthetic limbs. In theory, they should be more robust since the software automatically learns features from common patterns in data without engineers having to handcraft them. But their effectiveness is dependent on being able to accurately recognize objects and perform the computation quickly in order for exoskleteon-wearers to move safely in real time.
“One of the biggest challenges to developing AI-powered lower-limb exoskeletons is control, having the legs move according to the user’s intent,” Laschowski added.
"Errors could result in performing inaccurate movements, for example, selecting a level-ground walking mode when actually the user wants to climb stairs which could potentially cause injury."
Disasters are prevented by including a kill switch. “To ensure safety, systems such as ours have human-controlled override buttons to disengage the automated controllers,” John McPhee, the Canada Research Chair in Biomechatronic System Dynamics at the University of Waterloo, told El Reg . “Furthermore, we use extensive simulation-based testing of our controllers prior to human testing.”
The team isn't quite ready to begin testing their exoskeletons on people with impaired movement. “We’re currently focusing on developing the environment recognition system, specifically improving the accuracy and real-time performance of the environment classification. This technical engineering development is essential to ensuring safe operation for future clinical testing with autonomous robotic exoskeletons,” said Lachowski.
[9]
Eventually, the researchers hope that robotic exoskeletons running their environment recognition system will be able to give people the freedom to sit, stand, walk, and go up and down stairs. ®
Get our [10]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://uwaterloo.ca/news/media/engineers-combine-ai-and-wearable-cameras-self-walking
[3] https://uwaterloo.ca/motion-research-group/publications/simulation-stand-sit-biomechanics-robotic-exoskeletons-and
[4] https://regmedia.co.uk/2021/03/17/handout_exoskeleton_waterloo.jpg
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.frontiersin.org/articles/10.3389/frobt.2020.562061/full
[7] https://ieee-dataport.org/open-access/exonet-database-wearable-camera-images-human-locomotion-environments
[8] https://www.theregister.com/2020/06/16/german_bionics_cray_x/
[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[10] https://whitepapers.theregister.com/
Researchers at the University of Waterloo, Ontario, are hard at work trying to combine modern deep-learning systems with robotic prostheses. They hope to give disabled patients who have suffered spinal cord injuries or strokes, or are inflicted with conditions including multiple sclerosis, spinal, cerebral palsy, and osteoarthritis, the ability to get back on their feet and move freely.
[1]
The project differs from other efforts for amputees that involve trying to control the movement of machines using electrodes implanted in nerves and muscles in the limbs and brain, [2]explained Brock Laschowski, a PhD student at the university who is leading the [3]ExoNet study . “Our control approach wouldn’t necessarily require human thought. Similar to autonomous cars that drive themselves, we’re designing autonomous exoskeletons that walk for themselves.”
[4]
The computer-powered exoskeleton gear ... Source: University of Waterloo
[5]
Like self-driving cars, the robotic limbs are kitted out with sensors and cameras that feed images taken from the surrounding environment to computer-vision algorithms. These are used by the exoskeleton's control systems to carry out specific actions – whether it’s walking, standing, sitting, or going up and down stairs – all while comprehending and navigating the environment as necessary. People strapped into these exoskeletons thus are able to move around, with the software handling the necessary movements.
Having said that, ExoNet is still in its infancy. Laschowski and his colleagues began by [6]collecting data to train the convolutional neural networks in the computer vision portion of the software. Cameras were strapped to participants' chests, waists, and calves, and they were instructed to walk around to gather information to teach the models.
Our environment recognition system, which uses wearable cameras and AI algorithms, is used to estimate upcoming locomotor activities and therefore allow robotic exoskeletons to predict and plan accordingly to different walking environments
Hours of footage was recorded and sorted into nearly a [7]million images that were then labelled to describe specific motions, including walking on level ground, walking up and down stairs, and meeting various objects, such as doors, walls, and seats.
“Data from wearable sensors are used to control robotic exoskeletons by inferring the user’s locomotor intent, for example, wanting to walk upstairs,” Laschowski told The Register . "Our environment recognition system, which uses wearable cameras and AI algorithms, is used to estimate upcoming locomotor activities and therefore allow robotic exoskeletons to predict and plan accordingly to different walking environments."
In other words, the system tries to figure out what to do from the situation the wearer finds themselves in.
If the algorithms detect something like stairs, the code sends this information to the exoskeleton’s control system to kick-start the series of commands to lift the knee and step up or down. If it sees a wide flat ground, it’ll be more likely to send instructions to the machine to activate a different set of controllers used for walking, or if it recognizes a door, the software should correctly guess the user is trying to open it and get the exoskeleton to slow down and stand still.
Exoskeletons-as-a-service offered as helping hand to warehouse workers exhausted by pandemic [8]READ MORE
Deep-learning systems have advantages over other traditional algorithms that have been used to control prosthetic limbs. In theory, they should be more robust since the software automatically learns features from common patterns in data without engineers having to handcraft them. But their effectiveness is dependent on being able to accurately recognize objects and perform the computation quickly in order for exoskleteon-wearers to move safely in real time.
“One of the biggest challenges to developing AI-powered lower-limb exoskeletons is control, having the legs move according to the user’s intent,” Laschowski added.
"Errors could result in performing inaccurate movements, for example, selecting a level-ground walking mode when actually the user wants to climb stairs which could potentially cause injury."
Disasters are prevented by including a kill switch. “To ensure safety, systems such as ours have human-controlled override buttons to disengage the automated controllers,” John McPhee, the Canada Research Chair in Biomechatronic System Dynamics at the University of Waterloo, told El Reg . “Furthermore, we use extensive simulation-based testing of our controllers prior to human testing.”
The team isn't quite ready to begin testing their exoskeletons on people with impaired movement. “We’re currently focusing on developing the environment recognition system, specifically improving the accuracy and real-time performance of the environment classification. This technical engineering development is essential to ensuring safe operation for future clinical testing with autonomous robotic exoskeletons,” said Lachowski.
[9]
Eventually, the researchers hope that robotic exoskeletons running their environment recognition system will be able to give people the freedom to sit, stand, walk, and go up and down stairs. ®
Get our [10]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://uwaterloo.ca/news/media/engineers-combine-ai-and-wearable-cameras-self-walking
[3] https://uwaterloo.ca/motion-research-group/publications/simulation-stand-sit-biomechanics-robotic-exoskeletons-and
[4] https://regmedia.co.uk/2021/03/17/handout_exoskeleton_waterloo.jpg
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.frontiersin.org/articles/10.3389/frobt.2020.562061/full
[7] https://ieee-dataport.org/open-access/exonet-database-wearable-camera-images-human-locomotion-environments
[8] https://www.theregister.com/2020/06/16/german_bionics_cray_x/
[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YFMyzKJfvcCmQxZVQCM5XgAAAEU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[10] https://whitepapers.theregister.com/
It's the wrong
don't you hate it when you lose your account
Trousers Grommet
Chris G
Invasive implants are not necessary, just look at Tilley Lockey and the arms she uses.
There may be a use for algorithmic interpretation to smooth out or generally improve the function of prostheses like Tilley's but depending on an AI to operate say a set of legs seems to be coming from the wrong direction.
" I'm sorry Dave, we're not going there!"
"human-controlled override buttons to disengage the automated controllers,”
Pascal Monett
Hmm. I wonder how well that will work when the user wants to go down the stairs and the machine wants to walk stright ahead.
I applaud anything that will advance our ability to improve the life of disabled, but this strikes me as rather dangerous.
I wish them luck, though.
Why walking ?
gitignore
There seems to be an obsession with walking for disabled people ; what in my experience is way more of a problem is not being able to use your hands, or not being able to sit. This invention requires good core control (which many people with cerebral palsy struggle with) and assumes you don't have contractures. For walking, for many (not all, obvs) situations, the wheelchair is an adequate tool. On the positives, getting yourself vertical has lots of benefits.
What could possibly go wrong?