Move the PC mouse by turning your face or open various applications with facial gestures. It’s not a project that aims to be futuristic, but rather Google’s Project Gameface, which focuses mainly on accessibility. One of the biggest advantages of this project is that there is no need for an external webcam on the computer: our mobile phone will be responsible for everything.

Project Gameface was born in 2023 at last year’s I/O. However, we have not yet shown how Google works. In fact, if Android Studio is installed, we can start testing with it. We will tell you how it works, what it can do and who it is focused on.

This open source project aims to allow people to control the computer cursor using head movement and facial movements. Simply raise your eyebrows to click or drag an item on the screen, and open your mouth to move the cursor. This not only allows you to control computer actions in simple applications, but also allows you to play any game using your face.

The same thing happens when we use Android mobile phones. Using facial gestures we can control a cursor that allows us to touch, swipe on the screen and, as a result, fully control the phone. This is an evolution of the Keys Accessibility functionality we already find on Android phones.

Within the API, Google states that there are a total of 52 values ​​representing the expressive power of 52 facial movements. These are used to map different functions of the system so that a full level of customization can be achieved.

Gameface is available on Google’s GitHub, but there is no app for Windows or Android yet. It is expected to arrive in the future, although no specific date has been announced at this time.

Image | Google

in Xataka | Apple announced new accessibility features for iPhone and iPad. There’s one that even reduces motion sickness while driving.