I just wanted to post to let you know that you are not weird for feeling this way. My DH has azoospermia (no sperm). We didn't necessarily stop having sex, but we were definitely shell-shocked for about the first month or so. In some ways, the first 12 months of TTC were harder for us, because of timing sex, etc.
We decided we needed to find the silver lining in all of this...sex never has to be about making babies for us, it's about our closeness as two people in love with each other. And just think, every little baby we do end up having will be one that we wanted when we had it, not one that was a "Whoops"...and once our families are complete we can just do it whenever...in some ways IF is kind of liberating. I know, I know...right now this seems like kind of a hollow victory, any one of us would love to have a "Whoops" baby right now, and we'd all love to have babies the old-fashioned way, but this is my way of having one up on the fertiles
Trust me, things will get better as you get further from your diagnosis...and just remember sex can be all about fun and loving on your DH now instead of about baby-making.