Quincy Brown is making big moves, but starring on Empire was one he decided against, much to dismay of his fans. The eldest son of Diddy…