Google has taken a significant step toward democratizing on-device AI with the unannounced release of AI Edge Gallery, a groundbreaking Android application that runs sophisticated AI models locally without requiring an internet connection. First spotted by TechCrunch and Economic Times, this experimental app represents Google’s most ambitious push yet into offline AI capabilities for consumer devices.
The application offers three core functionalities that showcase the versatility of modern mobile AI:
- Conversational AI for multi-turn dialogues with AI assistants
- Image Understanding that analyzes uploaded photos and answers visual queries
- Prompt Lab for single-turn tasks like summarization, coding, and content rewriting
What sets AI Edge Gallery apart is its support for multiple open-source models including Google’s own Gemma 3 series and Alibaba’s Qwen 2.5 models, available in sizes ranging from 500MB to 4GB to accommodate different device capabilities. Performance benchmarks are impressive—the app achieves a 1.3-second response time when running the 2-billion parameter Gemma model on a Pixel 8 Pro, thanks to Google’s proprietary LiteRT runtime that optimizes performance across Android hardware.
Privacy emerges as a key advantage, with all processing occurring locally on the device. This addresses growing concerns about cloud-based AI services while enabling functionality in connectivity-challenged environments. Advanced users can even import custom LiteRT-format models, making the app a sandbox for developers exploring on-device AI possibilities.
Currently available as an alpha release through Google’s GitHub under an Apache 2.0 license, the app requires Android 10+ devices with at least 6GB RAM. While positioned as a reference implementation for developers, its polished interface and practical features suggest Google sees broader potential for offline AI in consumer applications. An iOS version is reportedly in development as the tech giant continues to expand the boundaries of what smartphones can do without cloud dependence.
Your First 10 AI Skills
10 practical AI skills, copy-paste prompts and a 7-day plan to start using AI with confidence.
Download the guide →