Hm! Tricky. You might be able to get away with using a wire frame that you can hide in your hair built around the headband maybe, with bobby pins to help anchor it, or maybe try some "invisible" elastic (either the net kind or the clear silicone/plastic kind) which you can help blend in with elastic.