v Abstract This dissertation describes an exploration of digital tabletop interaction styles, wit... more v Abstract This dissertation describes an exploration of digital tabletop interaction styles, with the ultimate goal of informing the design of a new model for tabletop interaction. In the context of this thesis the term digital tabletop refers to an emerging class of devices that afford many novel ways of interaction with the digital. Allowing users to directly touch information presented on large, horizontal displays. Being a relatively young field, many developments are in flux; hardware and software change at a fast pace and many interesting alternative approaches are available at the same time. In our research we are especially interested in systems that are capable of sensing multiple contacts (e.g., fingers) and richer information such as the outline of whole hands or other physical objects. New sensor hardware enable new ways to interact with the digital. When embarking into the research for this thesis, the question which interaction styles could be appropriate for this new class of devices was a open question, with many equally promising answers.
In this paper we discuss design issues for a domestic table-top display application supporting co... more In this paper we discuss design issues for a domestic table-top display application supporting co-located collaboration. We present an application scenario dealing with manipulation of picture collections and illustrate some preliminary ideas.
This paper describes a field study of an interactive surface deployed in three family homes. The ... more This paper describes a field study of an interactive surface deployed in three family homes. The tabletop technology provides a central place where digital content, such as photos, can be easily archived, managed and viewed. The tabletop affords multi-touch input, allowing digital content to be sorted, triaged and interacted with using one or two-handed interactions. A physics-based simulation adds dynamics to digital content, providing users with rich ways of interacting that borrows from the real-world. The field study is one of the first of a surface computer within a domestic environment. Our goal is to uncover people's inter-actions, appropriations, perceptions and experiences with such technologies, exploring the potential barriers to use. Given these devices provide such a revolutionary shift in interaction, will people be able to engage with them in everyday life in the ways we intend? In answering this question, we hope to deepen our understanding of the design of such ...
Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, 2014
. We present a novel mechanical keyboard combining motion gestures on and directly above the keys... more . We present a novel mechanical keyboard combining motion gestures on and directly above the keys with regular tactile typing. A lowresolution but high-speed sensor (A) is embedded into an off-the-shelf keyboard (B). IR proximity sensors are interspersed between the keycaps (C). This results in a low-resolution raw intensity image when hands are interacting above (D). A sequence of these images are accumulated into proximity (E) and motion (F) history images. Together these form a motion signature (E+F) which can be used to robustly recognize a number of dynamic on-keyboard (G) and hover gestures (H) using a machine learning-based classifier.
Development of a Mixed Reality Tangible Rapid Prototyping Environment to Explore Novel Human Computer Interaction Concepts for Car Drivers
Mobile computers and mobile environments, such as cars, require novel human-computer interaction ... more Mobile computers and mobile environments, such as cars, require novel human-computer interaction con- cepts. Currently, the use of heads-up displays to present three-dimensional virtual objects and icons as a function of sensor input is a much discussed topic. This paper presents a rapid prototyping en- vironment within which design teams can use mixed reality and tangible metaphors to act out
Tangible and modular input device for character articulation
ACM SIGGRAPH 2014 Emerging Technologies on - SIGGRAPH '14, 2014
ABSTRACT Interactively articulating virtual 3D characters lies at the heart of computer animation... more ABSTRACT Interactively articulating virtual 3D characters lies at the heart of computer animation and geometric modeling. Expressive articulation requires control over many degrees of freedom: most often the joint angles of an internal skeleton. We introduce a physical input device assembled on the fly to control any character's skeleton directly. With traditional mouse and keyboard input, animators must rely on indirect methods such as inverse kinematics or decompose complex and integrated motions into smaller sequential manipulations---for example, iteratively positioning each bone of a skeleton hierarchy. While direct manipulation mouse and touch interfaces are successful in 2D [Shneiderman 1997], 3D interactions with 2D input are ill-posed and thus more challenging. Successful commercial products with 2D interfaces, e.g. Autodesk's Maya, have notoriously steep learning curves and require interface-specific training.
In this position paper we report initial findings from our experiences with developing photo shar... more In this position paper we report initial findings from our experiences with developing photo sharing applications surrounding interactive tabletop displays. Especially the support for casual browsing, sidetracking and storytelling emerge as key challenges in order to foster communication around photo collections. Furthermore we discuss implications of our findings for the future development of such systems.
Uploads
Papers by Otmar Hilliges