I feel bad taking my husband away from his church?

I am a newlywed. My husband has been going to his church with his parents for decades (he is 40). However, I have come to realize that I really don't like the thought of going to his church for the rest of our marriage. It doesn't make me feel spiritually satisfied. I would like to attend the church I am used to going to or find a third church together that we both can agree with. The problem with this is I feel like I will be taking him away from his weekly time with his family if this happens. What should I do?