FoodChangeLens: CNN-based Food Transformation on HoloLens

In this demonstration, we implemented food category transformation in mixed reality using both image generation and HoloLens. Our system overlays transformed food images to food objects in the AR space, so that it is possible to convertin consideration of real shape. This system has the potential to make meals more enjoyable. In this work, we use the Conditional CycleGAN learned with a large-scale food image data collected from the Twitter Stream for food category transformation which can transform among ten kinds of foods mutually keeping the shape of a given food. We show the virtual meal experience that food category transformation among ten kinds of typical Japanese foods: ramen noodle, curry rice, fried rice, beef ricebowl, chilled noodle, spaghetti with meat source, white rice, eelbowl, and fried noodle.