GIORGIO CAM

Check out https://g.co/aiexperiments to learn more. This is an experiment built with machine learning that lets you make music with the computer just by taking a picture. It uses image recognition to label what it sees, then it turns those labels into lyrics of a song.

I helped to create Giorgio Cam during my time at Google Creative Lab in 2016. You take pictures of things around you, and it makes up song lyrics about them. It uses Google's Cloud Vision API to identify thousands of object categories (like beard, shoe, flower, etc). A speech synthesis server generates the words which are then run through audio effects and mixed with music by the legendary Giorgio Moroder.

Try it here (it works on laptops and android phones).