Adding a patch to a TN cover without making it permanent

[quietnotebook]

I'm thinking about adding a small fabric patch to my Traveler's Notebook cover, but I'd rather not put glue straight on the leather in case I change my mind. Has anyone found a way to keep a patch in place through everyday use without making it difficult to remove?