Out of complete selfish desire to see more of your face, maybe a try a 2nd channel for more personal stuff? Less haters on a channel specifically for the people that wanted to subscribe twice?
If I make a channel for personal stuff, it would have to be private to just people I know. It's not just the hater comments. It's just a matter of learning to keep private things private for my own sanity.