Title: A Toolkit for Prototyping Tabletop-Centric Cross-Device Interaction
Abstract: Different types of devices are used in our daily lives, and each type has its own advantages and disadvantages. Cross-device interaction that involves multiple devices can potentially overcome each device's inherent disadvantages. Without a toolkit, it is time consuming to develop cross-device interaction. Focusing on a horizontal large display (called a tabletop), this paper proposes a generic toolkit for prototyping tabletop-centric cross-device applications that involve a large display and multiple smartphones. In our toolkit, a user uses a smartphone as a look-through lens for browsing and selecting objects on a tabletop, and remotely manipulates the selected object with multimodal feedback. Based on the above interaction style, our toolkit formalizes the development of cross-device interaction as defining a mobile interface on each tabletop interface object. Since our toolkit encapsulates the interface distribution and synchronization through message passing, interface developers can focus on developing cross-device interaction by designing a mobile interface in response to a selected tabletop interface object. In order to demonstrate the versatility and design space of our toolkit, six design issues, i.e., data transfer, personalization, user interface composition, authentication, localized & private feedback, and input expressiveness, were discussed through a set of sample applications.
Publication Year: 2019
Publication Date: 2019-09-12
Language: en
Type: article
Indexed In: ['crossref']
Access and Citation
Cited By Count: 3
AI Researcher Chatbot
Get quick answers to your questions about the article from our AI researcher chatbot