Author Archives: admin

multimodal_interaction_visualization_2.001 © 2015 admin. All rights reserved.

Multimodal Interaction Visualization

A paper presented on the Turn-Taking and Coordination in Human-Machine Interaction symposium (2015 AAAI Spring Symposia, Stanford University, March 23-25, 2015, Palo Alto, California). Long worked on how to visualize multimodal interaction. After several attempts, got a solution that found to be … Continue reading

Expense_tracker_design_v6 © 2015 admin. All rights reserved.

Hackathon: expenses visualized and classified

On a recent hackathon we chose to implement a simple tool for visualizing expenses, e.g. from a business trip, and classifying those expenses with appropriate labels into pre-defined classes like food, transport, hotel, etc. The hackathon lasted 1.5 days and in that time … Continue reading

experience_design_workshop.001 © 2015 admin. All rights reserved.

Experience Design & User Experience workshops

Now and then I give lectures and conduct workshops on best practices in Experience Design and User Experience. Two regular venues are BootUp Academy (Menlo Park, CA) and the Nordic Innovation House in Palo Alto, CA. The participants are aspiring … Continue reading

visual-voice-memo-pics.001 © 2014 admin. All rights reserved.

Visual Voice Memo

  A small scale project for a local startup. The work included user research (to set the cultural context), interaction and experience design. The final delivery included an interactive prototype, based on origami-inspired folding interaction principles, the interaction flow, visual elements and … Continue reading

seabirds_deployment_one_year © 2013 admin. All rights reserved.

Acoustic data visualization

This project for a non-profit organization was about environmental sensing. The goal was to visualize data, acoustic recordings, coming in from remote sensing stations on the California coast and on Hawaii. List of implemented functionalities: annual overview of all the … Continue reading

ChallengeClock4 © 2013 admin. All rights reserved.

ChallengeClock: visualizing progress of challenges

The outcome of a recent hackathon. The clock displays challenges and their temporal progress with the number of teams participating to the competition (the size of the circles). The times left and already spent are shown in absolute and relative … Continue reading

multimodal_dialogue_visualization © 2012 admin. All rights reserved.

Visualization of multimodal interaction

Continuation to an earlier project. The goal was to discover how different modality channels contribute to the overall success of a dialogue (i.e. system-user interaction). The implementation takes an EMMA-like XML-based description of the dialogue and analyses within each dialogues for each … Continue reading

multimodal_integration_v2 © 2012 admin. All rights reserved.

Contextual multimodal integration

Multimodal integration is an essential part of any multimodal system. By multimodal input we refer to any explicit input modalities like speech, gesture, touch, etc. and implicit modalities like sensor inputs, contextual information and even bio signals. While multimodal interaction … Continue reading