果冻影院

XClose

Innovation & Enterprise

Home
Menu

果冻影院 and industry partners join forces to transform computer use for millions

果冻影院 MotionInput v3 could transform the way millions of people use their computers, thanks to an innovative project involving 果冻影院, Intel, Microsoft, IBM and the NHS.

Two people looking at a laptop, one is gesturing to the computer camera

23 September 2022

If people are using communal computers in places like hospitals and schools, what can be done to lower the COVID-19 transmission rates? And, alongside that, how can new technology help us make computer access more equitable for all, including people with physical disabilities?

That was the problem Professor Dean Mohamedally set for his students across several of his undergraduate and master鈥檚 Computer Science courses back in 2020.

Working with industry partners and 果冻影院 academics, including MotionInput Clinical Lead Sheena Visram and Honorary Lecturer Dr Atia Rafiq, the students went onto develop 果冻影院 MotionInput v3.

This revolutionary piece of software allows people to use their computer without touching a keyboard or mouse. Instead, they can control what鈥檚 happening on screen using their own combination choice of voice commands, facial expressions or physical gestures captured by their webcam. For example, by moving their hands and pinching in the air. Although other systems have enabled some of these options, MotionInput v3 is the first to combine all of them into a single system.

As well as minimising the spread of COVID-19, the technology has huge potential for people with conditions like Motor Neurone Disease (MND).

A team approach to solving problems

Chair of IXN for Good, and PhD candidate at the 果冻影院 Interaction Centre, Sheena Visram was Clinical Lead on the project. She explains that 果冻影院 MotionInput was all about working with industry partners to solve real problems.

鈥淲e wanted to bring academic and industry expertise together to create something that could make a real difference to people鈥檚 lives with this. And, at the same time, give our students skills they could take with them into their careers by giving them a tangible problem to solve with the latest innovations in artificial intelligence and computer vision.

鈥淣ot being able to use a computer easily is an issue that affects many people globally, and we鈥檙e incredibly proud of what our students have achieved, working with colleagues in industry. The software is still in its infancy but the potential it could have is huge. To be able to have that impact is really exciting for us, our partners and our students.鈥

The potential to change the lives of millions

The 果冻影院 MotionInput software was developed initially in response to the COVID-19 pandemic as a way to support NHS frontline staff. Two Computer Science students, Sinead Tattan and Carmen Meinson, headed up the 54 果冻影院 students who worked on developing 果冻影院 MotionInput version 3.

鈥淲e wanted to help prevent the spread of viruses and other bugs by enabling medical staff to use communal computers without touching their keyboard or mouse. But the applications of what the team has come up with are much further reaching than that,鈥 explained NHS GP, trainer and 果冻影院 Honorary Lecturer in Computer Science Dr Atia Rafiq.

果冻影院 MotionInput v3 is unique in that it can be used on most Windows PCs and doesn鈥檛 require any equipment other than a webcam and microphone. As most laptops already have these, there are very few barriers to access. It also doesn鈥檛 require cloud access and it does all processing on each user鈥檚 own device, an important consideration for privacy.

As well as its clinical uses and for those with mobility issues, the software can be used for teaching and presenting, and by people playing computer games.

Working with partners

果冻影院鈥檚 partnerships with global tech firms, including Intel, Microsoft and IBM, meant the team was able to draw on specialist technical expertise to help develop the software.

果冻影院 MotionInput v3 combines the latest open-source machine learning, natural language processing and computer vision software in a way that hasn鈥檛 been done before.

For the firms and partners involved, it鈥檚 been an opportunity to tap into, and contribute to, globally-significant innovation being shaped at 果冻影院.

Phillippa Chick from Intel said: 鈥淲e鈥檝e been involved as mentors to the students as they鈥檝e been developing the different modes of use in 果冻影院 MotionInput v3. It鈥檚 been hugely rewarding to see them progress, and working with partners like 果冻影院 and the NHS means we鈥檝e been able to try out new ideas like 鈥楩acial Navigation鈥 and 鈥楶seudo-VR鈥 that haven鈥檛 been used on PCs and laptops before.鈥

Making a difference to people鈥檚 lives

果冻影院 MotionInput v3 is freely available to download for users. The team hope to see it widely rolled out across NHS sites as well as schools, other industries and user groups, to drive and support the next generation of Equitable Computing access for all.

Former elite gymnast Paris Baker, who won medals for Great Britain at the European and World Championships, was diagnosed with MND at the age of just 26. Now 31 and living with the disease, she said 鈥渢he potential for 果冻影院 MotionInput v3 to change lives is limitless,鈥 after becoming one of the first users of the new technology.

Watch a video about MotionInput

YouTube Widget Placeholder

Links

Find out more about:


Photo听漏听Chester Cham听

(facebook button)