My downstair neighbor say am to loud?

my neighbors keep saying am to loud but am not its just me and my husband and my 10 month old baby .they came to knock o my door saying to take off my hills and now one in my apt was even wearing hills so am thinking it was my baby because she is learning how to crawl and how can i tell my 10 month old baby to not crawl and not be loud but i just let it go so then 3 weeks past by and i was cleaning and my baby was in her walker and the were banging on the celling really loud with a broom or something and i just let it go then 2 weeks past buy and i was having family over for dinner there wa 4 kids but one of them was a sleep and the other ones were on my bed watching tv and they weren't being loud at all and the stupid guy comes and tell me to keep it loud and i told him how do you want me to tell a 10 month old baby and 2 year old to be quit and he said he didn't now and i told him when ever i can hear you guys i don't say any thing and he said well come tell use so i just slammed the door on his face and now my family DNT want to come to my house what should i do can i talk to the landlord to let me move out with not charging me any thing