The rendezvous server introduces two peers to each other and then gets out of the way. What it holds is short-lived: the sessions peers are signaling through, and the relay routes carrying datagrams for the pairs that could not punch a direct path.