Soon it’s going to be very difficult to find an industry not overpowered by robots and machine learning, not even the music industry. Researchers from the University of Toronto have developed an AI system that can create and then sings Christmas carols from a single image.
Melody and drums
To create the AI, researchers used a pair of neural networks. They trained the first network by feeding it a hundred hours of music, letting it generate a basic 120 BPM melody, complete with drums and instruments. Then they showed the second network a picture of a Christmas tree, allowing it to analyze the picture and create the lyrics and finally sing the song.
“We are used to thinking about AI for robotics and things like that. The question now is what can AI do for us?” said Raquel Urtasun, associate professor in machine learning and computer vision at Toronto’s computer science lab.
“You can imagine having an AI channel on Pandora or Spotify that generates music, or takes people’s pictures and sings about them,” adds Sanja Fidler, a colleague of Raquel Urtasun. “It’s about what can deep learning do these days to make life more fun?”
Well, it was rather horrific than fun. First of all the AI isn’t well trained to know that no one actually decorates the Christmas trees with flowers, and definitely, doesn’t sing “I swear it’s Christmas Eve.” And it’s not the blessings we seek during Christmas, it’s the gift. However, it’s just the beginning. Hopefully, they will train their neural networks to create something more meaningful in future. Whatever it is, surely not more horrific than the Christmas greetings Boston Dynamics gave us last year.