At the heart of the Grisons Children's World is the Machine Learning based scan function, which enables a seamless transition from book to platform. Using Deep Learning, scanned or photographed children's book pages (or excerpts thereof) are recognised and users are then guided to the corresponding animated book scene.
The decision for a Progressive Web App and against a native, mobile app was a conscious one: Users can use the highly compressed app offline and place it on their personal home screen. Despite the challenge of lacking support for PWA functionality on iOS, we managed to offer users an equivalent app experience thanks to clever user guidance.
The technical challenges we have faced in classifying images with TensorFlow are described in detail in this blog entry .