The collection covers b-side and rare material spanning Whip It On, Chain Gang of Love, Pretty in Black and Lust Lust Lust. The release was limited to 500 CD and 500 double 180 gram LP. Rarities/B-Sides marks the first time the 2003 single The Christmas Song has been available on an album, as the song was absent from the 2008 Christmas EP Wishing You a Rave Christmas. Despite the song never being included on an album singer Sune Rose Wagner stated "it has since become our biggest selling song ever with appearances in countless movies, commercials, etc."  Covers released as b-sides or bonus tracks from the period this compilation spans are not included. Specifically Eddie Cochran's C'mon Everybody, Hank Williams' I'm So Lonesome I Could Cry, and Buddy Holly's Everyday.  The album art contains various photographs and a poster by contemporary artist and photographer Todd Hido. Hido previously worked with The Raveonettes when he directed the video for the Raven in the Grave single Apparitions.