Reading your post made me think you should turn Lucius the Wanderer into a character for another regency romance. Wandering man stops by inn, meets and likes male inkeeper, leaves, but then keeps coming back, year after year - something keeps drawing him back- love perhaps?, and of course, he eventually stays.

Just an idea :)