Sex problems. What should I do?

My husband and I have just celebrated out 1st anniversary. I love my husband more than anything and we still have a ton of fun together. But out sex life seems to be a problem since we got married. On our honeymoon I wanted to do it A LOT, and was a little upset that he would fall asleep when I was wearing lingerie in front of him. He said it was because we were doing so many activities he was tired. For the first couple months when we got back that is how it was too. Just a couple times a week. I was sad and let down. I didn't feel like he wanted me and got comfortable in the 1 time a week routine. BUT NOW he wants it all the time. If I don't want to do it he gets all peeved and acts like im holding out on him. I am content with 1-2 times a week now that I work part time and am in charge of all the housework/cooking. Also HATE it when he guilt's me and makes me feel bad for not wanting to all the time. He never tries to make it romantic. Its always just right before bed and he just shoves his hand down my pants. Honestly when it starts to feel like my duty and not a romantic thing it turns me off even more. I don't know what to do. I want to keep him happy, and im horrified by the saying "if hes not getting it from you he will get it somewhere else". But I don't want to just give give give just because its my job. How can I fix this dilemma? I have tried talking to him and he doesnt seem to understand where im coming from. He just throws himself a pity party because im not putting out. So frustrating!