I think only the boss needs it, so that would still be helpful. What would you need to give up to swap it in? Between Iron Silence and an Invisibility Sphere from Cypher, the group might be able to bypass a golem or two. We might be able to manage that with fewer spell slots with some simple trickery though.