Cut off anyone who leaves you questioning your worth, who leaves you as an option, a maybe, a possibility, because they do not see you worthy of being anything more. 

Your self-esteem is far more important than someones comfort and convenience.