I think most of us who wear them for fun / pleasure (and not because we really need them) go through this at some point. I know that in my case, all through my teenage years I felt horribly guilty about it. Also, as this was in the pre-internet 1970s, I also thought that I HAD to be the only person in the world who loved diapers and therefore, there must be something wrong with me. It wasn't until I was over 21, after months of going to porn shops looking for something--anything--relating to diapers, that I finally found a small ad for Amber Enterprises (small newsletter published by Mommy Florence for adult babies) that I realized I wasn't the only one.
Still, I went through the usual "binge and purge" cycle. Usually it was: Meet a girl. Fall in love. Then I'd decide "I'm done with diapers!" and throw away all of my diapers, plastic pants, ABDL stuff. After a few months, I'd start getting "diaper horny" (usually after something set me off, like visiting someone with kids and seeing a big full diaper pail or a pile of wet diapers on the floor in the bathroom and smelling that wonderful smell, or any other sort of "trigger"). This would build and over time just drive me crazy. Then I'd have a big argument with or break up with the girl, leave her house, slam the door, get in my car, and leave. Then the little "light bulb" would go off over my head and on the way home I'd stop at the store, buy a big box of toddler-sized Pampers (in the purple boxes) or a package of the largest sized (usually 24x24) prefold cloth diapers that they had, pins, baby oil, Baby Magic lotion, etc. I'd then drive home with a raging hard-on and as soon as I got there, I was right back into diapers again, loving every minute of it, and thinking "Finally, I'M ME AGAIN!"
During this era I had one girlfriend who--for a while--let me wear diapers. For the first two years of our relationship she would not let me into her pants. But she did let me wear my diapers. Finally she agreed to have sex with me, and as soon as she did it was "Now that you have this, you no longer need THOSE." Of course I didn't see it this way and this was one of many things that led to us fighting and eventually breaking up. Then it was back to the same old "cycle" again.
Around the time that I turned 25, after many rounds of the "binge and purge", I finally decided "This is ridiculous, I love my diapers and I'm never going to give them up. So I might as well stop throwing my stuff away just so that two months later I can buy it all again, accept that I am who I am and make peace with it." At the time, I just assumed that this meant that--while I'd still have relationships with girls--I'd probably never get married because I'd never marry a girl who didn't accept my diapers, and I'd probably never meet a girl who did.
This meant that, any time I dated a girl and the relationship started getting serious, I'd out of necessity just tell her about my diapers. If she didn't accept it, fine, I'm no worse off than when the relationship started. Then, believe it or not, I started dating a girl and after a few months, when it started getting serious, I told her my secret. And she was just fine with it! In fact, she realized that putting me in and seeing me in my diapers actually made her horny. A match made in heaven! That's why I married her.
Morals of the story: Be yourself and don't feel guilty about it, we aren't hurting anyone else in any way by wearing and loving our diapers. Be honest with those you have relationships with, maybe not at first, but, after you get to know each other and it starts getting serious, tell them and give them a chance to accept you for who you are, or not. Either way, at least you know and that way there are no secrets. If they don't accept you, move on and try again. As I used to say, "Girls come and girls go but you ALWAYS have your diapers."
If you keep trying, eventually you will find somebody who will accept the ABDL side of you. Lots of women (especially once we get into our 30s and 40s) seem to enjoy taking care of a "baby" and, in lots of cases (like mine) they know that as long as they let you wear your diapers, you'll be very faithful to them and love them appropriately in return!