- digitalSamaritan AI School
- Posts
- đ§ How to use AI privately on your computer(run it locally)
đ§ How to use AI privately on your computer(run it locally)
Step-by-step guide to running AI Models offline
đ Hey there!
Quick question: Ever wish you could run powerful AI without sending your data to the cloud?
If that sounds like you, you're in for something exciting.
Google's new AI Edge Gallery lets you run advanced AI models entirely offline, right from your Windows PC.
Fast. Private. On your own device. No middlemen involved.
And the best part? You can set it all up in under 20 minutes.
Let's get started. đ
â The AI Edge Gallery Setup
đŠ Step 1: Download the AI Edge Gallery APK
Head to GitHub and grab the latest APK from the AI Edge Gallery releases page.
Youâll need to sideload it since itâs not available on Google Play yet.
â ïž Important: Always be careful to only sideload APKs from trusted sources like official GitHub repos.
đ„ïž Step 2: Set Up an Android Environment on Windows
Since AI Edge Gallery is an Android app, you need an Android environment to run it on your PC. The easiest way is using an Android emulator like BlueStacks or Nox Player.
How to install the APK:
Open your emulator and drag & drop the APK file into it, or
Use ADB (Android Debug Bridge), a command-line tool that lets your PC communicate with the emulator:
Download and install the Android SDK Platform Tools from the official Android developer site (this includes ADB).
Open Command Prompt or PowerShell on your PC.
Use the
cd
command to navigate to the folder where the APK file is saved.Make sure your emulator is running.
Run this command
adb install ai-edge-gallery.apk
Wait for the success message â this means the app is installed.
setting the emulator
đŹ Important Notes:
Only download emulators and SDK tools from official sources to avoid security risks.
Emulators can be resource-heavy â make sure your PC has enough CPU, RAM, and storage for smooth performance.
Windows Subsystem for Android (WSA) has been discontinued, so emulators like BlueStacks or Nox are the best options right now.
Running apps via emulators may be slower than on native Android devices.
đ Step 3: Allow âUnknown Sourcesâ & Launch the App
Because youâre installing the AI Edge Gallery APK outside of the Google Play Store, Android treats it as an âunknown source.â That means you need to explicitly allow your emulator to install apps from sources other than official app stores.
How to do this:
When you first try to install the APK, Android will show a warning popup saying something like âInstall blockedâ or âFor your security, your phone is set to block installation of apps from unknown sources.â
Click on the Settings or Allow button on that popup (wording may vary depending on emulator or Android version).
Youâll be taken to a settings screen where you can enable the option to allow installation from âUnknown Sourcesâ or âInstall unknown apps.â
Turn this permission ON for the emulator or file manager app that youâre using to install the APK.
Go back and retry installing the APK â it should now proceed without blocking.
Once installed, open the AI Edge Gallery app from the emulatorâs app list.
đ§© Step 4: Pick a Model & Run It Locally
Choose a Feature:
After launching the AI Edge Gallery app and selecting a feature (like AI Chat or Ask Image), youâll be prompted to pick an AI model to use.Browse Available Models:
Youâll see a list of preloaded AI models hosted on Hugging Face, such as:Gemma â A compact and efficient AI model
Qwen â A more advanced, larger AI model
And others...
Import Your Own Models (Optional):
If you want, you can also import your own AI models by loading files manually.Download Models on First Use:
Most models are large files, ranging from about 500MB to 4.4GB. When you select a model for the first time, the app will download it to your device.Run Models Fully Offline:
Once downloaded, the models run completely offline on your PC, so you donât need an internet connection for AI processing.
đĄ Quick Tips:
â Make sure you have enough free storage space before downloading big models.
â Downloading may take some time depending on your internet speed.
â After the initial download, the models will open instantly and work offline.
đ ïž Step 5: Use AI Features Without Internet
Hereâs what you can do offline:
đŹ AI Chat
Type your prompt â get responses from your selected model
(No servers, no tracking)
đŒïž Image Analysis
Upload a picture â ask, âWhatâs this?â or âDescribe it.â
The AI will analyze locally and answer in seconds.
âïž Prompt Lab
Choose tasks like Summarize, Code, or Rewrite
Perfect for generating offline text results privately.
Google confirms: âAll processing happens directly on your device.â
Your prompts, images, and chats? They never leave your PC.
đ Why this Matters: Privacy + Speed
Local AI isnât just a privacy winâitâs more reliable, and future-forward.
⥠TL;DR:
Grab the APK from GitHub and sideload it (since itâs not on Play Store).
Install an Android emulator (like BlueStacks or Nox) on Windows to run the APK.
Enable "Unknown Sources" inside the emulator to allow installation.
Launch the app, pick an AI model (like Gemma or Qwen), and download it once.
Use powerful AI toolsâchat, image analysis, prompt lab, fully offline!
đ Note:
The AI Edge Portal is currently in Private Preview.
Clicking the link will take you to a short access request form. Access is granted through an allowlisting process for selected testers.
đ§ Bonus Tip:
Not a Windows user?
No problem â youâve still got options!
đ„ïž Mac users: Try Ollama â a free, offline AI runner that lets you download and chat with models like LLaMA, Gemma, or Qwen straight from your terminal. It's fast, private, and works natively on macOS.
đ§ Linux users: Ollama works here too â just run it from the CLI and start experimenting locally. You can also explore open-source runners like LM Studio, or use Docker + Hugging Face libraries for full control.
đȘ Windows users: Youâre covered with the AI Edge Gallery via Android emulators. But if you want more power, Ollama also supports Windows if youâd prefer a desktop-native approach over emulators.
đ Across all platforms, these tools keep everything offline and private â perfect for secure experiments and no internet dependence.
đ ICYMI
Must-Read AI Workflows
From 200K context windows to best-in-class code generation, Claude Opus 4 is redefining what AI can do for developers.
Discover five innovative AI video tools that can transform your marketing; animating images, creating virtual brand spokespersons, and dubbing videos into multiple languages effortlessly.
AI Roundup
DeepSeek's latest update democratizes coding by letting anyone build games, dashboards and interactive sites with no setup or paywall.
đ Meet the Darwin Gödel Machine: AI that evolves by rewriting its own code
A breakthrough system that autonomously iterates on its own softwareâboosting its coding skills from 20% to 50% on SWEâbench by evolving like natural selection.
Did you learn something new? |
đ Weâd Love Your Feedback
Got 30 seconds? Tell us what you liked (or didnât).
Until next time,
Team DigitalSamaritan
Reply