THAW: Hybrid Interactions with Phones on Computer Screens

We present a novel interaction system that allows collocated screen devices to work together. The system tracks the position of a smartphone placed on a host computer screen. As a result, the smartphone can interact directly with data displayed on the host computer, which opens up a novel interaction space. We believe that the space on and above the computer screen will open up huge possibilities for new types of interactions. What makes this technology especially interesting is today’s ubiquity of smartphones and the fact that we can achieve the tracking solely through installing additional software on potentially any phone or computer.