6 CHAPTER 1 Introduction
to skilled practitioners. This approach involves more than being “natural” or intui-
tive. It means that the domain of use and the requirements of context are care-
fully assessed. It also means that the conventions of the GUI should be studiously
ignored. It requires careful design and rigorous research. We give some guidance on
how to do those things and how to re-conceptualize the NUI.
We offer a number of essays on the NUI and on methods that can be utilized to
achieve it, written from the perspective of two journeyman user experience experts
who have had the opportunity to immerse themselves in the nitty-gritty of design-
ing, engineering, building, testing, researching, and shipping multiple products
that have come to define the category. Overall, the essays are intended to provide a
nuanced set of perspectives on NUI systems. These perspectives range from specific
descriptions of the syntax and semantics of the NUI to broad analyses of the NUI
in terms of the history of computing. Each essay is composed of the same essential
elements. Each concludes with specific, concrete design guidelines meant to help
take words into action. Those guidelines are divided into three types: must, those
that we believe are necessary conditions to achieving a natural-feeling experience;
should, those elements that, while nonessential, have been found to add greatly to
achieving such an experience; and could, those guidelines that may apply only to
certain contexts or situations.
To frame our collection, we offer a framework that we have evolved for the
general process of the creation of a gesture-based natural user interface. The sec-
tions of this book reflect the phases of this process, and individual chapters provide
thoughts, tools, and methods for implementing it. This framework is an evolution
of classic methods for designing interactive systems, with the addition of elements
unique to the creation of a fundamentally new way of interacting (Figure 1.1).
Different elements of this book will appeal to different pieces of team build-
ing a touch- and gesture-based product. Chapters 2 and 3 will best be consumed
by planners and business managers. Chapters 4–11 will feel most familiar to design-
ers, who think broad thoughts early and whittle toward the final product. Chapters
12–15 might seem most approachable by program managers, who seek quickly to
understand where they are, where they need to be, and the pitfalls along the way.
Chapters 16–21 may seem best suited to software developers and testers, who seek
to carefully define goals and test cases. Chapters 22–26 might, at first glance, be tar-
geted to hardware engineers, who are seeking to find the uses for different sensing
capabilities in the hardware. And Chapters 27–29 might be seen as targeting user
researchers, who seek methods for guiding the design process and goals.
Approaching this text with such a discipline-centric viewpoint, however, would
be a missed opportunity. This book has been lovingly composed by a philosopher-
researcher and a computer scientist-designer who had the opportunity to work
together closely in multidisciplinary teams to create something special. We highly
encourage all members of a team creating a NUI application to deeply engage with
this material, to understand fully our vision for natural user interfaces and our guid-
ance for how to achieve them.
www.WereBook.com