What paint did you use? Most spray paints are enamels and can take weeks or even months to fully dry, and even then they can still be delicate. If you're in the USA try Duplicolor Universal Flat Black, it's an acrylic lacquer that dries well enough to handle in an hour but let it set overnight before putting it to use. Outside the US any other auto paint brand should have something equivalent.