Not in my experience, not with regular glue anyway. I tried to glue silicone to something years ago, and found out that really, nothing sticks to silicone. It simply peeled away from the glue.
I know smooth on sells a special glue for repairing silicone molds, I don't know if it would also stick to latex. Might be worth dropping them a line to ask.