Hand Tracking and Gesture Control  banner

Hand Tracking and Gesture Control

2 devlogs
1h 18m 54s

Using a cam on a downwords angle and creating a hand detector from scartch and using it certain controls

This project uses AI

Used Chatgpt and Gemini to debug

shlokraval1410

Using the previous largest contour found - in my case, the hand. Finding the midpoint of the countour that being the top of the palm. This was done using moments, specifically 0th power moments, which, when used, gave the center of the contour. This approach required it to be centered within the frame,e and so I switched to using Central Moments that were not reliant on the x and y position of the contour. Effectively creating a palm detector. After some testing, I realized it would not be effective when the hand is upside down ( palm facing down) or sideways. The palm detector approach would be obsolete unless I used a setup previous to it. Instead, I pivoted the approach to using CNN.

Attachment
1

Comments

Jahaan
Jahaan 2 days ago

Oh, very coool.

shlokraval1410

Set up virtual enviroment
got hand tracking and contour dectection working
overlay of hand on black screen + noise reduction and general post processing

Attachment
1

Comments

Jahaan
Jahaan 2 days ago

Ohhhhh, very Cooool, I support this. I like the vision.