Google Launches Accessibility-Focused Project Gameface on Android to Offer Hands-Free Navigation


Google has expanded its Project Gameface, an open-source project aimed at making tech devices more accessible, to Android, and now it can be used to control the smartphone interface. The project was first introduced during Google I/O 2023 as a hands-free gaming mouse that can be controlled using head movements and facial expressions. These were designed for those who suffer from physical disabilities and cannot use their hands or voice to control devices. Keeping the functioning same, the Android version adds a virtual cursor to allow users to control their device without touching it.

In an announcement made on its developer-focused blog post, Google said, “We’re open-sourcing more code for Project Gameface to help developers build Android applications to make every Android device more accessible. Through the device’s camera, it seamlessly tracks facial expressions and head movements, translating them into intuitive and personalised control.” Further, the company asked developers to use the tools to add accessibility features to their apps as well.

Project Gameface collaborated with the Indian organisation Incluzza which supports people with disability. Using the collaboration, the project learned how its technologies can be expanded to different use cases such as typing a message, looking for jobs, and more. It used MediaPipe’s Face Landmarks Detection API and Android’s accessibility service to create a new virtual cursor for Android devices. The cursor moves following the user’s head movement after tracking it using the front camera.

The API recognises 52 facial gestures including raising an eyebrow, opening the mouth, moving the lips, and more. These 52 movements are used to control and map a wide range of functions on the Android device. One interesting feature is dragging. Users can use this to swipe the home screen. To create a drag effect, users will have to define a start and end point. It can be something like opening the mouth and moving the head, and once the endpoint is reached, closing the mouth again.

Notably, while this technology has been made available on GitHub, it is now up to developers to build apps using this option to make it more accessible to users. Apple also recently introduced a new feature that uses eye-tracking to control the iPhone.


Affiliate links may be automatically generated – see our ethics statement for details.

Source link

Related Posts

Dogecoin Developer Issues Important Warning to Investors as Market Turns Volatile

The crypto sector, after seeing a massive upswing in March this year, has found itself rather stagnated for over a month now. In light of the current volatile market conditions,…

Read more

Samsung Galaxy S24 FE Leaked in Renders; Suggests 6.65-Inch Display, Triple Rear Cameras

Samsung is expected to announce the Galaxy S24 FE later this year as a successor to the Galaxy S23 FE. A set of leaked renders have now given us the first…

Read more

Samsung Galaxy Tab S10+ Listed on Geekbench With MediaTek Dimensity Chipset

Samsung Galaxy Tab S10+ may launch later this year as a successor to the Galaxy Tab S9+. The latter was unveiled in July 2023 alongside a base Galaxy Tab S9…

Read more

LinkedIn Introduces New AI-Powered Features to Assist Professionals in Job Search

LinkedIn is rolling out several new artificial intelligence (AI) features that will assist users in job search and personalised learning on the platform. Announced on Thursday, these AI-powered features include…

Read more

Google’s Magic Editor Reportedly Available on Samsung Phones; Magic Eraser, More Become Free-to-Use

Google’s AI-powered photo-editing feature – Magic Editor – is now arriving on Samsung smartphones and older Pixel devices. The feature was first introduced with the company’s Pixel 8 lineup of…

Read more

Poco F6 Review: Excellent Performance, Mid-Range Cameras

The F-series is an important lineup for Poco, as the Poco F1 was the first phone from the brand to launch in India. A friend of mine still has the…

Read more

Leave a Reply