His cheating was my fault?

people are telling me my husbands cheating is my fault. he recently confessed to cheating 4 times during the months of nov-jan. he said it was nothin but and will never happen again. i was unaware of his cheating. he says it happened cause he and i had been like a month with no and before that only doing it like once every other week. people are saying its my fault, that i basically sent him into the arms of another woman by not having with him after he repeatedly was saying he wanted/needed more and that i was too nice to him letting him go anywhere anytime and never questioning his whereabouts or checking up on him. i feel its not all my fault cause baby sleeps with us so what could i do? plus i told him pay a sitter and get a hotel and he wouldnt. yet now i found out he brought some old (40)ugly ***** we know to a hotel. im 26 hes 25. now that we do it everyday and im trying to spice things up he says he is the happiest man on earth and will never stray again.