Researchers at Google AI recently developed a technology called IconNet that enables Android users to have hands-free control over their mobile devices using voice access.
What is IconNet?
IconNet is an emerging system based on the internet architecture CenterNet that automatically detects icons on the screen in correspondence to the underlying structure of the app. It has been developed as a part of the recently launched Voice Access system. Currently, IconNet can detect 31 different icon types, but in the near future, the number is expected to go up to 70. Running at 9FPS on a Pixel 3A, IconNet has a precision of about 94.2% that aims to give the users a perfect and consistent experience.