How do I cut down the rate of visits from my husband's people

Good day, mamalettes, pls how do I cut down the rate of visits from my husband's people,not like there re related or bear same surname, my husband is a person that helps people alot, am not against him helping people but I want them to be at length while he helps them, one came and stayed with us for almost 3yrs,before my husband worked his Visa and he travelled now another one has come,since 2months and I know that he wants to travel out that why he's come. Even before now I have had many of them, they come stay months before they live.some who are still in school,ll come for holiday ñ goes. I'm not comfortable with it, we re just married for 4yrs and everytime and being surrounded by boys, my hubby has one Boy who stays in the shop for him, and his brother who's staying with us I don't have problems with that but my problem is these people that kept on coming after another. My hubby doesn't see it as problem while I see it as one. Am in school (Uni)with my 2 children and a maid and ll be graduating this Nov, I ll traveling soon for holiday but am thinking how I ll cope with 4 grown men, including my maid ñ children, for the maid I planned to send her back home as I ll be graduating cos I only needed help in school. One mind told me to start giving them attitude so they ll stay at length,because am not the type that talks easily.Things re really difficult and my husband is building a duplex which is at finishing level, am just thinking they come in ñ out of our house as we re living in a flat, what of when we finish the house that we ll gave more rooms. Pls how can I limit their visits. Mamas Pls advice.