The video already has over a million views.
Sia appeared on Sesame Street to perform "S is for Songs," a song about her love of songs.