42 research outputs found
A Model-Based Approach for Gesture Interfaces
The description of a gesture requires temporal analysis of values generated by input sensors, and it does not fit well the observer pattern traditionally used by frameworks to handle the user’s input. The current solution is to embed particular gesture-based interactions into frameworks by notifying when a gesture is detected completely. This approach suffers from a lack of flexibility, unless the programmer performs explicit temporal analysis of raw sensors data.
This thesis proposes a compositional, declarative meta-model for gestures definition based on Petri Nets. Basic traits are used as building blocks for defining gestures; each one notifies the change of a feature value. A complex gesture is defined by the composition of other sub-gestures using a set of operators. The user interface behaviour can be associated to the recognition of the whole gesture or to any other sub-component, addressing the problem of granularity for the notification of events.
The meta-model can be instantiated for different gesture recognition supports and its definition has been validated through a proof of concept library. Sample applications have been developed for supporting multi-touch gestures in iOS and full body gestures with Microsoft Kinect.
In addition to the solution for the event granularity problem, this thesis discusses how to separate the definition of the gesture from the user interface behaviour using the proposed compositional approach.
The gesture description meta-model has been integrated into MARIA, a model-based user interface description language, extending it with the description of full-body gesture interfaces
Engineering the authoring of usable service front ends
This paper presents a method and the associated authoring tool for supporting the development of interactive
applications able to access multiple Web Services, even from different types of interactive devices.
We show how model-based descriptions are useful for this purpose and describe the associated automatic
support along with the underlying rules. The proposed environment is able to aid in the design
of new interactive applications that access pre-existing Web Services, which may contain annotations
supporting the user interface development. This is achieved through the use of task models as a starting
point for the design and development of the corresponding implementations. We also provide an example
to better illustrate the features of the approach, and report on two evaluations conducted to assess
the support tool
Improving support for visual task modelling
ConcurTaskTrees (CTT) and its supporting environment (CTTE)
have been widely used for a significant period of time. However, users have
expressed various concerns regarding their usability. In this paper, we present
the modifications made so as to provide more effective support. In particular,
the environment has been enhanced in order to make it more suitable for
designing real-world applications, including improved support for task model
editing and early prototype generation. We also report on two evaluation tests
that provided useful feedback in order to decide how to improve the
environment
New sub-barrier nuclear fusion cross sections as a possible solution to the solar neutrino problem
Exploiting web services and model-based user interfaces for multi-device access to home applications
This paper presents a method, and the corresponding software architecture
and prototype implementation to generate multi-device user interfaces in
the home domain. The approach is based on Web services and model-based
user interface generation. In particular, it focuses on multi-device interfaces obtained
starting with XML descriptions of home Web services, which are then
mapped onto user interface logical descriptions, from which it is possible to
then generate user interfaces adapted to the target devices. During use, the generated
interfaces are able to communicate with the home Web services and can
be dynamically updated to reflect changes in domestic appliances available and
the associated state
