Seems to have resolved itself (for the moment) for me. Getting fast turnarounds at the end of PvP matches now.

Given the behaviour, this seems like a resource leak or similar, where it starts fast, but as the leaked resource builds up over time, things get slower and slower till it's at the point that things time out and eventually never respond in time to be useful.