Smart Gesture Recognition in iOS 11 with Core ML and TensorFlow

In part 1, I showed how one can use deep learning to recognize complex gestures like heart shapes, check marks or happy faces on mobile devices. I also explained how apps might benefit from using such gestures, and went a little bit into the UX side of things. This time around I’ll be walking you through […]

A New Approach to Touch-Based Mobile Interaction

A decade since touch screens became ubiquitous in phones, we still generally interact with mobile apps using only minor variations of a few gestures: tapping, panning, zooming and rotating. Recently, I explored a highly underutilized class of gestures. The approach I took to detecting them in-app has several important advantages over the state-of-the-art techniques. The idea originally came to […]