Repository navigation
on-device-ml
- Website
- Wikipedia
On device AI inference in minutes—now for MLX & GGUF, with Android, iOS and NPU backends coming soon.
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android
This is a web demo for camera-based PPG sensing (rPPG).
Embeddings from sentence-transformers in Android! Supports all-MiniLM-L6-V2, bge-small-en, snowflake-arctic, model2vec models and more
An Android app running inference on Depth-Anything and Depth-Anything-V2
Object detection inference with Roboflow Train models on NVIDIA Jetson devices.
[NeurIPS'24] DEX: Data Channel Extension for Efficient CNN Inference on Tiny AI Accelerators
Approach to implementing distributed training of an ML model: server/device training for iOS.
On-Device Static Sentence Embeddings in Swift/iOS/macOS apps
Control your computer using hand gestures with AI, using Google's MediaPipe and OAK-D Lite camera.
End-to-end on-device federated learning, "An On-Device Federated Learning System for SMS Spam Classification", IEEE MIT URTC 2022
Mindful Coffee ☕️ – Smartly track caffeine intake, visualize its decay, predict sleep impact & get reminders. Built with SwiftUI, SwiftData, HealthKit & on-device machine learning.
SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.
Privacy-first personal health journal with experimental AI features. Track medications, journal symptoms, and explore on-device ML (for educational purposes)
Instant offline audio transcription using OpenAI's Whisper AI at the power of your fingers! I recommend the "stable" branch.
A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.
An Android app where users draw a number and machine learning does the rest
