To distress patches, I've roughed them up with a hole saw-based shredder tool, then added some black wash, then rubbed some light dirt into them, and then spray with clear matte spray paint. I think the spray paint does a lot because I prefer the matte look over the shiny polyester fibers.