TrackHands is a cross-platform desktop app that detects when your fingers are near your mouth and reminds you to stop.

Download the latest release for your platform from the Releases page.

Since the app is not signed with an Apple Developer certificate, macOS may show a warning that the app "is damaged and can't be opened." To fix this, run the following command in Terminal after installing:

xattr -cr /Applications/TrackHands.app

1. Clone the repository:

   git clone https://github.com/cacoos/trackhands.git
   cd trackhands

2. Install dependencies:

3. Run in development mode:

4. Build for production:

The built application will be in src-tauri/target/release/bundle/.

• Real-time hand and face detection using MediaPipe
• Unobtrusive system tray app
• Warning overlay when hands are detected near mouth
• Camera preview with detection visualization
• Adjustable detection frequency
• Configurable camera resolution
• Screenshot capture of detected incidents
• Privacy-focused — all processing done locally

• macOS 11+, Windows 10+, or Linux
• Built-in camera or compatible webcam
• Camera permissions enabled

TrackHands runs in your system tray and uses your camera to:

1. Detect your face and mouth position using MediaPipe Face Mesh
2. Track your hand and finger positions using MediaPipe Hands
3. Show a warning overlay when fingers are detected near your mouth
4. Capture a screenshot of the incident to help build awareness

• All processing is done locally on your device
• No data is collected or transmitted
• Camera access is required but footage never leaves your computer

• Detection Speed: Adjust how frequently detection runs (Slow/Medium/Fast)
• Resolution: Configure camera resolution (Low/Medium/High)

trackhands/
├── src/                     # React frontend (desktop app)
│   ├── components/          # UI components
│   ├── hooks/               # Custom hooks (detection)
│   └── stores/              # State management
├── src-tauri/               # Rust backend
│   ├── src/                 # Tauri commands
│   └── icons/               # App icons
├── site/                    # Landing page website
│   ├── src/components/      # Page sections (hero, features, etc.)
│   └── src/lib/             # Detection utilities for demo
└── public/                  # Static assets

cd site
pnpm install
pnpm dev

• Frontend: React, TypeScript, Vite, Tailwind CSS
• Backend: Rust, Tauri 2.0
• Detection: MediaPipe (Face Mesh + Hand Landmarks)
• State: Zustand

If you're having issues with detection:

1. Ensure good lighting on your face
2. Try quitting and reopening the app
3. Check camera permissions in System Settings
4. Try a different camera resolution setting

Contributions are welcome! Please feel free to submit a Pull Request.

MIT License

Joaquin Ossandon (@cacoos)