FoodSense: Real-Time Nutrition Tracking Through AI Vision

Next.jsExpress.js, WebSockets

Sunday, September 22, 2024

The Problem

Tracking nutrition for homemade meals is time-consuming and often inaccurate. Traditional methods require weighing ingredients and manual calculations—impractical for busy lifestyles and home cooks.

The Solution

FoodSense is a web app that uses AI vision to instantly analyze your food through your camera, providing real-time macronutrient breakdowns and calorie counts. No more guessing portions or manual calculations.

How It Works

Built with Next.js and WebSocket technology, FoodSense captures your device's video stream and processes frames through OpenAI's Vision Model. The AI analyzes your food and returns detailed nutritional information in real-time, complete with an AI coach for personalized guidance.

Technical Highlights

  • Real-time video streaming via WebSocket connections
  • AI-powered food recognition using OpenAI Vision Model
  • Cross-platform compatibility as a progressive web app
  • Parallel processing for optimal performance

Impact

FoodSense transforms nutrition tracking from a tedious chore into an effortless experience. Perfect for fitness enthusiasts, home cooks, and anyone wanting to make informed dietary choices without disrupting their routine.

Link to project
Devpost Link
Github