Anders Björler, the guitarist, described With Fear I Kiss the Burning Darkness as At the Gates' "darkest album", and deemed the album's production as "heavier" than the group's previous work.
Tomas Lindberg, the vocalist, said of the album cover: "The cover [...] is probably my favorite. It is a piece of art made by Swedish author/artist/composer Åke Hodell. The piece is called 220 Volt Buddha. Åke approved for us to use it for free, after inquiring about the music of the band and our approach, as soon as he understood that we were a non-commercial act. He has composed several pieces of abstract music, written radio plays and novels. You could consider him a modernist along the lines of Vladimir Mayakovsky. It was an honour for me to work with him and I think the blue tone matches the abstract music on the album perfectly. Åke died in 2000. He is greatly missed."