Google Unveils On-Device AI Capabilities and More Android Apps Using Gemini Nano

Google Unveils On-Device AI Capabilities and More Android Apps Using Gemini Nano

Table of content

On-device AI is a major priority for Android going forward, and Google shared more developer resources at the I/O 2024 conference.

The I/O 2024 session “On-Device AI for Android” presented good use cases for on-device generative AI:

  • Consumption: Providing summaries or overviews of text.
  • Creation: Suggesting replies in messaging apps or creating/rephrasing text.
  • Classification: Detecting emotions/moods in conversations or text messages.

Overall, the benefits include secure local processing, offline availability, reduced latency, and no additional (cloud) costs.

The limitations involve a smaller parameter size of 2-3 billion, which is “approximately smaller than cloud-based counterparts.”

There’s also a smaller context window and less generalization of the model. Thus, “fine-tuning is crucial for achieving good accuracy.”

Gemini Nano is the “preferred foundational model for on-device GenAI creation” for Android, but you can also run Gemma and other open models.

So far, only Google apps—Summarize in Pixel Recorder, Magic Compose in Google Messages, and Gboard Smart Response—leverage this feature. However, Google has been “actively collaborating with developers who have compelling on-device Gemini use cases” through an early access program, with launches expected in 2024.

Meanwhile, Google will soon use Gemini Nano for TalkBack captions, dynamic Gemini suggestions, and spam alerts, with a Multimodality update later this year “starting with Pixel.”

Google also highlighted the state of on-device AI a year ago and the improvements made since then, such as hardware acceleration.

Google Unveils On-Device AI Capabilities and More Android Apps Using Gemini Nano

Source

Related Posts

Older Galaxy Watches Can Now Join One UI 6 Watch Beta

Older Galaxy Watches Can Now Join One UI 6 Watch Beta

Reading Time: 0:59 min

Samsung is gearing up for the Galaxy Unpacked event scheduled for July 10th in Paris, where the company is expected to unveil its new Galaxy Watch 7 series. Alongside the…

View post
YouTube

YouTube May Soon Allow You to Upload Custom Thumbnails for Your Playlists

Reading Time: 1:31 min

Google might introduce a new feature on YouTube that allows users to upload custom thumbnails for their video playlists. This update was discovered through code analysis in the latest beta…

View post
iPhone Price Cuts Help Maintain Growth in the World's Largest Smartphone Market

iPhone Price Cuts Help Maintain Growth in the World’s Largest Smartphone Market

Reading Time: 1:36 min

IPhone shipments recovered in the world’s largest smartphone market from the previous month. During the first week of 2024, phone sales fell by 30% year-on-year due to issues with damp…

View post

Leave the first comment