I understand where you're coming from. Fans of Ultravox I know are pretty split on the song. It's either their favorite or something they find too repetitive to really care for. I'm with the former camp, though--I love the song.
I don't think the song "Hymn" is actually religious, though. I read the lyrics closely and the use of personal pronouns seems to be mocking of the use of organized religion for profit, if anything. That together with the Freemasonry imagery on the cover art for the single. But it could just be me and my irreligious tendencies.