STARK OS – Gesture Controlled Interface (Experimental) banner

STARK OS – Gesture Controlled Interface (Experimental)

1 devlog
0s

This project is an experimental web-based gesture control system built using HTML, JavaScript, and MediaPipe. It uses a laptop’s built-in camera to track hand movements in real time and allows users to interact with on-screen windows without touch…

This project is an experimental web-based gesture control system built using HTML, JavaScript, and MediaPipe. It uses a laptop’s built-in camera to track hand movements in real time and allows users to interact with on-screen windows without touching the keyboard or mouse. The position of the index finger is mapped to a virtual cursor, while a pinch gesture between the thumb and index finger is used to grab and move floating interface panels. The interface is designed as a futuristic operating environment with draggable holographic modules. Since the system relies on real-time computer vision, it is currently in an experimental stage and may have bugs, tracking errors, or performance limitations depending on lighting and hardware. However, it successfully demonstrates the potential of hands-free human-computer interaction using only a web browser and a webcam.