On Oct. 28’s edition of The Late Show with Stephen Colbert, Stephen Colbert hosted who he called his “favorite rock artist of all time,” Elvis Costello.

During his appearance, Costello spoke with Colbert about his reaction to the initial cancelation of his tour due to the pandemic, his consistent music-making throughout his career and more. Costello then collaborated with Batiste on a remote performance of “Hey Clockface,” the title track from his new record, which drops tomorrow.

In addition, Costello and Batiste also collaborated on an online-exclusive performance of “Party Girl” from Costello’s classic record Armed Forces (1979).

Watch both performances below!