Voice chat not working on dedicated server?

Title says it all. When anyone joins my dedicated server they cant use voice chat or hear my voice chat. When anyone uses voice chat, including me, they can see there icon as if they are using voice chat and using voice_loopback 1 allows me to hear my own voice. Just other people cant hear my own voice.