Don't think I would without asking.

Would you ever go back home from work because you realized you had mis-matched socks?