Off The Menu

Project Overview

Off the Menu, a unique web application that reimagines the traditional menu. The platform leverages Augmented Reality to provide diners with a visual preview of dishes before they order. These food models are crafted through the conversion of multiple images into 3D representations using advanced LiDAR technology. Built using React and model-viewer, it's best experienced on mobile devices for an immersive dining selection adventure.

The Challenge

In the restaurant industry, menu descriptions often fail to fully convey the visual appeal and portion sizes of dishes, leading to customer uncertainty and potential dissatisfaction. Traditional menus, even those with photos, can't provide an accurate, three-dimensional representation of meals. This gap in communication can result in misaligned expectations, slower ordering processes, and decreased customer satisfaction. Additionally, for people with dietary restrictions or allergies, it can be difficult to fully understand the composition of a dish from a written description alone.

The Solution

Off The Menu addresses these challenges through innovative use of Augmented Reality technology: 1. AR Dish Preview: Allows diners to see a 3D representation of each dish in real-world context before ordering. 2. LiDAR-Based 3D Modeling: Utilizes LiDAR technology to create accurate 3D models of dishes from multiple images. 3. Web-Based AR: Built using React and model-viewer, making it accessible through web browsers without the need for app installation. 4. Mobile Optimization: Designed for optimal performance on mobile devices, leveraging built-in AR capabilities. 5. Detailed Visual Information: Provides a 360-degree view of dishes, allowing diners to see portion sizes, ingredients, and presentation clearly. 6. Interactive Experience: Users can rotate and zoom in on dish models for a detailed examination. 7. Accessibility Features: Includes options for ingredient highlighting and allergen identification in the 3D models. By providing this immersive and informative dining selection experience, Off The Menu aims to enhance customer satisfaction, streamline the ordering process, and reduce food waste due to unmet expectations.

Results

Off The Menu has been well-received in initial trials at select restaurants. Early feedback indicates increased customer engagement with the menu, with users spending an average of 20% more time exploring dishes. Restaurants report a noticeable reduction in dish returns and customer queries about meal compositions. While comprehensive data is still being collected, preliminary results suggest a positive impact on order accuracy and customer satisfaction. The application continues to be refined based on user feedback, with ongoing improvements in model fidelity and the addition of more interactive features.

Technologies Used

• React
• model-viewer
• LiDAR
• WebXR
• Three.js