Ok, updates, since we've been kbitzing on the Discord.
First off, while I'm sad the GM is sticking with his ruling, it's his game and he can run it as he likes. If he starts to be to be too unfair or arbitrary then we the players are more than happy to leave. For now, we've had a lot of so far...