Contributor Demo · János Márta

AI Robot Gesture System

An embedded HMI experiment that gives listening, thinking and speaking states their own robot gestures, with transitions controlled through draggable nodes on the touch display.

Published Work23.8 sec demo

What this demo shows

The robot has three visible interaction states: listening, thinking and speaking. Each state is represented by a different gesture. Rather than using fixed buttons, the HMI exposes the transition logic as draggable nodes that can be moved on the screen to control the state flow.

Robot HMIState InteractionTouch UI
Listening · Thinking · SpeakingGesture-based state feedbackDraggable transition nodesPhysical embedded display
This is presented as a contributor experiment and interaction reference. It demonstrates the UI concept and state-control behavior on hardware; it is not presented as a complete robot control framework.
Why it is interesting

Make AI state visible, not hidden.

For an AI-enabled product, listening, processing and responding are system states the user needs to understand. This experiment turns those invisible states into explicit visual and physical behavior, while keeping the transitions inspectable on the HMI.

Discuss a Similar Interaction →
Contributor

János Márta

This is János's second published OpenHMI contributor demo, following OrbitMenu. The work highlights embedded UI prototyping, touch interaction and state-driven interface concepts.