Using Gestures to Empower Your Video Players

What is it about?

Our goal is to enable users to control video playback simply by their gestures in the air, without the need to use a mouse or keyboard, especially when it is not convenient to do so. Ultimately, we hope to expand our understanding of gesture-based interaction by understanding the inclusiveness of designing the hand as an interactive interface, and further broaden the state of semantic gestures in an interactive environment through computational interaction methods.

Featured Image

Photo by Sam Moghadam Khamseh on Unsplash

Photo by Sam Moghadam Khamseh on Unsplash

Why is it important?

Hand-based interaction is one of the most commonly used interaction methods in human-computer interaction (HCI) and intelligent interactive systems. Currently, most of the AR and VR head-mounted displays also implement the function of mid-air gesture interaction for more natural interaction. In addition, semantic gestures are being explored to understand the underlying gestural behavior during user interactions in order to design and propose more intuitive ways of interaction. To fully investigate the importance of semantic gestures, Adam Kendon has summarized how the gestured component contributes to the meaning or expression of the utterance. However, gestures are more than just an input to the process of interaction, but also instructions based on changes and activities of the body (especially the fingers). In the process of moving our fingers, we often overlook the expressive interface that is part of the body and the vehicle of gesture: the hand itself. Thus most gestures are designed to please the movement itself, which does improve the experience of interaction to some extent, but ignores the independence of the hand as an interface. Therefore, we introduce GesPlayer, a gesture-based empowered video player that explores how users can experience their hands as an interface through gestures. We provide three semantic gestures based on the camera of a computer or other smart device to detect and adjust the progress of video playback, volume, and screen brightness, respectively.

Perspectives