In 2004, he published his autobiography, Close Up, in which he wrote frankly about his gay life (albeit occasionally inaccurately regarding some third party details) and friendships. In the book, Fraser wrote that actor Laurence Harvey was gay and that his long-term lover was his manager James Woolf. According to Fraser, "As a teenager, [Harvey] started out living with Hermione Baddeley (the two appeared together in the acclaimed film Room at the Top), a blowsy star of intimate revue more than twice his age. Then he married Margaret Leighton, old enough to be his mother (actually Leighton was only six years older than Harvey) but a woman of style. When this marriage was over, he married Joan Cohn, the widow of Harry Cohn, managing director of Columbia Pictures. Throughout all these career marriages, he still managed to string Jimmy Woolf along." Of Dirk Bogarde, Fraser wrote, "Dirk's life with Forwood had been so respectable, their love for each other so profound and so enduring, it would have been a glorious day for the pursuit of understanding and the promotion of tolerance if he had screwed up the courage ... to make one dignified allusion to his true nature. Self-love is no substitute for self-respect."