Where is Design?
Experiment mix reality interaction with tangible input to improve the user experience.
Mixed Reality Prototype
Mixed Reality Prototype, Physical Computing,
Microsoft Hololens, Unity/C#, Arduino, Illustrator
How it works
Design the input
There are several iterations of the input device. The ideal one would be the one using AR to reveal the function of the input. However, due to the viewing angle issue, if you see the button to display the AR, you don't see text on the front. As a result, I used the shape of the object as a metaphor to imply functionality.
Construct the system
I choose Particle Photon, an Arduino board which provides built-in web service, for tangible input. When there is an event trigger, Photon will send it to its cloud server. What Hololens should do is to keep listening to that web server for event triggered.
A short presentation and Demo were held in the last class. Most people found the project interesting. Gesture control of Hololens is intuitive but not quite handy yet. We are still physical being and prefer to have something touchable to control things in mixed reality.