Katana: (Optional)
For doing The Governor's look from Season 4, it wouldn't be complete without the katana!
Now i'll have to get back to you on that, as I'm currently looking for one myself (rubber or carboard) however most efficient way to do this is to make it yourself.
Belt(s) :
You'll need 2 belts, pants belt (aka a everyday belt) and a utility belt. Thr everyday belt will be for the pants, so they don't fall off, and the utility belt is for the knife sheathe and gun holster.
For the pants belt, go with a regular worn belt, and size that can go around the clutches of your pants top. Easy to find at yard sales, flea markets, goodwill, etc.
Utility belt, on the other hand, is far more expensive. Ranging from $15 to $40. So if you find one that fits you and is cheap, pick it up!
Utility belt 1 (cheap):
http://www.officersclub.com/mens-brown-distressed-belt-p18638
Utility Belt 2 (more authentic look):
Will update later.
Holster: