HoloHand banner

HoloHand

5 devlogs
37h 2m 16s

Gesture Interface Art System (GIAS)

This project uses AI

Used GPT for debugging and used gemini for the api as well as layout ideas.

Demo Repository

Loading README...

shouryamishra011

After locking in for so long, I present to you, HoloHand. Everything is functional, now time for you all to review it and test it!

Attachment
0
shouryamishra011

So while I was trying to integrate the hand sensing and optimize it for slower computers, I realized that when on a faster computer, it wont use that computers GPU at all. SOOO I did a lot of research on how to work around this, I updated the model, I had to hard code some of the functions for the hand sensing using mediapipe and I had to learn all of mediapipes docs so that I’m able to continue with this. Now after doing all that I went back and started to code it, while I was coding it I decided to also add more blocks and shapes as there were only so many at the time. The updated version is almost ready for production, there is still a lot of work to be done but it should be done by tomorrow or the day after.

Also don’t mind the pic, it’s not supposed to look like that, it should resize depending on how big the users screen is but at the moment I haven’t fully implemented that feature. I have it only for the menu.

Attachment
0
shouryamishra011

I locked the flip in and got a whole buncha stuff done.
So lets go over it:

  • The UI/UX is fully done, might make a couple changes here and there
  • The hand sensing is working (finally)
  • Optimized it for slower computers as well
  • Made it work so that you can use both hands
  • Increased the awareness of the recognition system
  • Increased menu sensitivity
  • Added the grab, pinch features
    and there was a couple more things I did but those are less important. Overall HoloHand is almost done and ready for production soon.

I swapped devices (I’m working on it in school) and the menu is all messed up, so now I’m gonna have it resize based on the users screen.

Attachment
0
shouryamishra011

I worked on the main UI features, I now almost have a functional app. Just need to get the menu functions working along side the actual tracking system.

Attachment
0
shouryamishra011

Got the tutorial done! Now we’re gonna move onto the main UI.

Attachment
Attachment
Attachment
Attachment
Attachment
0