If you develop your app to look for specific gestures to trigger a photo capture, you can create an experience like the one my colleague Xiaoxia Sun has done here. The Vision framework can now help with hand pose estimation. Perhaps your mission as a developer is to rid the world of selfie sticks. Let's go through a few examples of what can be done with hand pose.
Look at how well it's working on this video of a child playing the ukulele. I hope you will agree and find amazing ways to take advantage of it.
Hand pose has so many exciting possible applications. We will be providing hand pose and we will be providing human body pose from Vision framework.
Last year we started giving you a new, richer set of landmarks that infer pupil locations.Īlso new last year is human torso detection.Īnd now I'm excited to show you what's new in the People theme for Vision framework this year. One of the major themes of the Vision framework is how it can be used to help you understand people in your visual data.īack when Vision framework was first introduced, it came with a new face detector that was based on deep learning technology.Īnd since that time, it had been improved upon with a second revision that could detect upside down faces.Īlso arriving with the debut of Vision was face landmark detection, which has also seen improvements with new revisions. Let's hear all about how to obtain body and hand pose using the Vision framework. Let's continue your journey and talk about some new API's in Vision this year. Have a question? Ask with tag wwdc20-10653īrett Keating: Hello everyone.And to learn more about other great features in Vision, check out the "Explore Computer Vision APIs" session. To understand more about how you might apply body pose for Action Classification, be sure to also watch the "Build an Action Classifier with Create ML" and "Explore the Action & Vision app" sessions. And we'll show you how you can bring gesture recognition into your app through hand pose, delivering a whole new form of interaction. With pose detection, your app can analyze the poses, movements, and gestures of people to offer new video editing possibilities, or to perform action classification when paired with an action classifier built in Create ML. Explore how the Vision framework can help your app detect body and hand poses in photos and video.
0 kommentar(er)
