A 3D model interaction tool which uses the power of Computer Vision to track your hand and interact with 3D models.
A 3D model interaction tool which uses the power of Computer Vision to track your hand and interact with 3D models.
Okay just a sample devlog bcz I Had to resubmit.
The use of Python3.11 is stricty required as its the most stable version mediapipe runs on please use python3.11
Log in to leave a comment
Last time I got rejected because my demo url was not quite correct bcz it just told you to install all the libraries and run my code. But this time, I hosted my project on pypi. https://pypi.org/project/hand3d/
pip install hand3d
You can run it using
import hands
hands.hands()
I packaged this project as a pip now…
pip install hand3d
You can install the package and run the code block below to run my project and all set!
import hands
hands.hands()
Log in to leave a comment
Alrightyy, Big work done in the past few hours. Added the drag system and refined it. Added a grid floor so that motion of the cube(drag) can be perceived(motion is relative folks) + its better with the grid. Changed the cube color to blue as white was kinda looking odd with the white grids. New drag gestures are: DRAG XY: Just close your fist and move your hand DRAG Z/Depth: Pinch(thumb and index finger) and move hand up to pull the cube towards you. Down to push it away from you… That’s pretty much it as of now…
There is more to come but for testing purposes, I added a 3D cube and then added 3D model interaction and zoom logic for the 3D model. Now I can zoom perfectly and also I added rotate…
Log in to leave a comment
As of now I’ve added a textbox kinda thing where you can view what action is being done. As of now I only have two actions… Drag and Rotate. Rotation can be done by only showing your index finger. Drag can be done by keeping your hand in the dragging position…
Log in to leave a comment
Okay the stepping stone of my project, installed mediapipe, set up my coding environment(I had some issues with my hackatime on MacOS so I have literally change my OS now. I’m using Zorin OS). But anyways. Now its all set, everything smooth. I tinkered a lot with mediapipe to get to know about all its features(basically learnt it a bit by documentation and a bit using Claude) and now im done learning mp. I’ve implemented tracking for both the hands with a green tip to the index finger because the index finger would be used a lot! Like a Lot in the future features and that’s pretty much it!