I think they heard Husband's French accent (he is easy to understand but he does have a bit of a French accent) and assumed we were from Quebec... and he'd had problems understanding people with Quebec accents in the past. And I have to say he was not that understandable to me, either so maybe our respective accents are just incompatible? :D
no subject