For example it is terribly difficult to self host email, and very few people actually do it.
I read this a bunch of times and put off trying it because it sounded like such a hassle. Eventually I did and… it wasn’t bad at all. I just had to add a few extra DNS entries. I haven’t had any delivery problems.
It’s on a VPS. Whether that’s really self-hosted may depend on how much of a purist you are, but it’s fully self-managed, not SAAS.
It’s recommended to have a PTR record mapping your IP address to your domain, which you wouldn’t be able to do with a residential connection from a typical ISP. I do send mail from multiple domains though and I haven’t had issues with deliverability. What I do not send is any kind of high-volume mail, which would likely attract a different kind of scrutiny.