Things are going downhill for my husband and I?? (don't know that to do)?

Things went downhill before they even got UPhill, which is pretty grim! It doesn't sound as if either of you were ready for a permanent relationship to be honest, especially your husband. If you really feel that there is anything here worth fighting for, then get him to go to Marriage Counselling with you. Other wise I think you need to cut your losses and get out of each others lives.