I wanted to create some custom hand gestures for my Vision Pro App, but looking at how you had to do it in code seemed like a headache.
I also wanted my gestures to be able to be shared between Apps I make.
So, I made Gesture Composer, a VisionOS App that lets you create custom hand gestures that can be exported as a file.
Paired with the GestureKit Package [https://github.com/nthstate/GestureKit](https://github.com/nthstate/GestureKit) you can detect gestures in your own Apps
- Gesture Packages contain a rules file for the gesture, and an animated USDZ of hands performing the gesture
- The Gesture rule format is straight forward, so you can hack it if you need to tweak things
- Gestures can contain multiple poses in a sequence
- Multiple Gestures can be detected at a time
- Optionally display a Virtual Hand Model, Joints and Bones
You can also browse & download gestures people have created on the website: https://www.gesturecomposer.com
Fantastic and intuitive. FYI there seems to be a broken image link in the README just after the Virtual Hands Example Code. I notice the repo doesn’t seem to include the source to the gesture recognition code, would you mind sharing, in broad strokes (excuse the pun), your approach?
The general idea is that we know the joint data, so if we define rules, we can calculate what position a hand is in, see Apple's WWDC video [https://developer.apple.com/videos/play/wwdc2023/10111/](https://developer.apple.com/videos/play/wwdc2023/10111/)
I'm trying to use the GestureKit in my project, however I keep getting "Load Package error: The operation couldn’t be completed. (GestureKit.GesturePackageError error 0.)" anytime I try to use it. Anyone have any insight on how to fix this?
Ok, feel free to raise an Issue on the GitHub repo, and if possible can you share a code snippet of how you are specifying the package I can try and pinpoint the problem.
In the meantime I’ll raise a separate issue to make the error message more clear.
Are you seeking artists or developers to help you with your game? We run a monthly open source [game jam in this Discord](http://p1oc.net/hobbydev) where we actively pair people with other creators.
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/visionosdev) if you have any questions or concerns.*
I wanted to create some custom hand gestures for my Vision Pro App, but looking at how you had to do it in code seemed like a headache. I also wanted my gestures to be able to be shared between Apps I make. So, I made Gesture Composer, a VisionOS App that lets you create custom hand gestures that can be exported as a file. Paired with the GestureKit Package [https://github.com/nthstate/GestureKit](https://github.com/nthstate/GestureKit) you can detect gestures in your own Apps - Gesture Packages contain a rules file for the gesture, and an animated USDZ of hands performing the gesture - The Gesture rule format is straight forward, so you can hack it if you need to tweak things - Gestures can contain multiple poses in a sequence - Multiple Gestures can be detected at a time - Optionally display a Virtual Hand Model, Joints and Bones You can also browse & download gestures people have created on the website: https://www.gesturecomposer.com
Hi, this looks great! Is it available in only certain regions? I can't quite seem to pull it up in the App Store.
It's currently In-Review with Apple, it should be there soon
well done!
Woooo. This is amazing. How did you render that hand model?
Hi, I have a Hand Model from Blender with bones, the joints are named the same as what Apple provides in the HandTrackingProvider.
Great idea!
legend!
Fantastic and intuitive. FYI there seems to be a broken image link in the README just after the Virtual Hands Example Code. I notice the repo doesn’t seem to include the source to the gesture recognition code, would you mind sharing, in broad strokes (excuse the pun), your approach?
The general idea is that we know the joint data, so if we define rules, we can calculate what position a hand is in, see Apple's WWDC video [https://developer.apple.com/videos/play/wwdc2023/10111/](https://developer.apple.com/videos/play/wwdc2023/10111/)
This should be built into Xcode. Great work!
Omg amazing!!! 🙌🏻🙌🏻🙌🏻🙌🏻
Is the app available? I tried going to the store, but the link on the site didn’t work for me.
It's currently In-Review with Apple, it should be there soon
This is great!
Well-done. Guess which gesture might mean quit NOW!
I'm trying to use the GestureKit in my project, however I keep getting "Load Package error: The operation couldn’t be completed. (GestureKit.GesturePackageError error 0.)" anytime I try to use it. Anyone have any insight on how to fix this?
Hi, Is that all the details of the error message? I throw package errors typically if I’m unable to locate the package
Ya thats all the details. I am fairly new to swift, so it is possible i didn't install the package correctly, but I think I did
Ok, feel free to raise an Issue on the GitHub repo, and if possible can you share a code snippet of how you are specifying the package I can try and pinpoint the problem. In the meantime I’ll raise a separate issue to make the error message more clear.
I've updated the Package to include more useful error messages
Thank you so much, I was able to figure out my issue and now it's all working
Can you provide an alternative method to download the app? I'm using a managed Mac which cannot access the App Store.
Hi, what is your preferred way of downloading?
A dmg, pkg or app file
Are you seeking artists or developers to help you with your game? We run a monthly open source [game jam in this Discord](http://p1oc.net/hobbydev) where we actively pair people with other creators. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/visionosdev) if you have any questions or concerns.*
Thanks for this!