According to a new book, Simon Cowell had a secret affair with British X Factor judge Dannii Minogue. Supposedly, the TV mogul confessed they were lovers when they worked on the show. He admitted: "I had a crush. It was genuine...Continue