Introduction

We created an Augmented Reality prototype which aimed to visualize energy consumption and data use of appliances and devices in households through an engaging interface.

What did we learn?

This experiment was an opportunity for us to explore the conceptual and technical possibilities of machine learning and object recognition technologies on a deeper level. We also learned more about using Augmented Reality as a tool to reveal and present data flows.

Ambitions

The prototype opens up the possibility for further expanding with Apple's machine learning library CoreML, and Google's machine learning platform TensorFlow Mobile for object recognition capabilities. This would be an exciting contribution to the developing field of smart home technologies. One interesting technical problem to solve is to project data flows onto real world surfaces.