With the rise of artificial intelligence oriented apps popping up in the app store, we can't help but want to dive deeper into how they actually work.
An example of these apps that has recently rose to fame is Sway: Magic Dance by Humen Inc., an app that uses "AI-powered motion filters to let you visualize yourself doing amazing dances with just a few taps". The results are surprisingly well done. In the blink of an eye, anyone can gather seamless video footage of themselves nailing complex dance moves.
This app was actually built by one of the co-authors of the Computer Vision paper, "Everybody Dance Now", in which a group of UC Berkeley researchers investigated a way of "do as I do" motion transfer, that synthesized realistic dance moves from an original source video.
The entirety of their research is documented here.
Can we remove the need for stunt doubles in the film industry? Can anyone become a TikTok star with the help of this app? The compelling results from their research nails the element of delight. But what else can this research be applied to?