Yes, this is the house from the album covers.

Eminem's Childhood Home Has Been Damaged by Fire