Not related to asexuality, but related to self – esteem. It can be hard. And it can also be hard when you fear rejection. This song comes to mind. As it says in the chorus:
You’ve got nothing to lose/ you don’t lose when you lose fake friends.