They make display racks for martial arts belts, that might be one way to go.
Alternately, you could try making some sort of rack with hooks for you belts to rest on. That or something pole like, even just two thin posts set apart from each other, to loop your belts around.