I do not know if your question in this post is destined to women only. Anyway, I would like to comment it, please. But before, I have two things to consider.
First, I am sorry for your poor conditions! I hope that you your financial situation become better and also I wish good things in your life.
Second, I did not understand something: in your profile, it is written that a flat or an apartment is in your property, while in relation to the question where you live, you answered that you do not have your own place. It would be good to clarify that info to have more adequate answer to attend your question. As I have that doubt, I will comment considering what is written in this post.
Well, it is normal to feel like you described, principally when involving someone strange. I can notice that you are not totally comfortable with him yet. However, the more two people communicate between themselves, more they get acquaintance with each other and then have more intimacy. It is up to you decide the degree of familiarity with a man whom you have interest.
You can avoid him to go your home now, because you feel ashamed of the condition there, or for matter of privacy, or anything else. But at determined moment, when the relationship of both is going further, some things will need to be shared or known by the couple. It is not possible to keep everything hidden from your partner, despite everyone can have the own secrets.
Many men do not matter to visit and know a poor residence of his be loved. If he will visit you and if you can do that, I just recommend to clear and organize your home, trying to give a better impression of the local. Dirt is not healthy and desorganization may leave the ambient less comfortable. Anyway, I guess that is ok for you, as it is mentioned in your profile that you keep your space always clean for company.