All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger. We ask Allaah to exalt his mention as well as that of his family and all his companions.
If your husband's situation is as you mentioned; neglecting his wife and family, surely he has misbehaved, breached the trust that is imposed on him by Allaah and relinquished the characteristics of a caretaker. He should know that his wife and family's rights are not limited to providing food, drink, clothes, etc., rather there are many other immaterial rights, such as taking care of them, guiding them to virtue, teaching them their religion and raising them according to Islam, which are more significant than food, clothes and the like. Allaah will question him about his negligence of all these rights.
We advise you to be patient; patience is the key of a happy end, and being patient during trials expiates ones sins. The Prophet said: "A Muslim (male or female), remains subject to trials (in this world) in respect of self, children and property till he (or she) faces Allaah, (on the Day of Judgment) in a state in which all his (or her) sins have been remitted." [At-Tirmithi] You have to implore Allaah to correct your husband, for this purpose, you may seek the help of pious people like the Imaam of the mosque who may deliver the Friday sermons about the mutual rights of spouses and that the wife and the family have rights on the husband as the Prophet said: "Your wife has a right on you, your Lord has a right on you, and your guest has a right on you, so, give every one's right to him." [Al- Bukhari and Muslim]
As you know that a wife can play a great role in influencing her husband through her nice and pleasing characters, taking care of her physical appearance and with good management of household matters. So, we entrust you to give great importance to the above matters. Your husband's misbehavior should not incite you to fall in the trap of Satan and disobey him. If the relations are stained much with no room left to continue married life and divorce is the only solution, then you may ask for divorce even by paying something to get the divorce.
You have the right to demand your money that you had lend to your husband if he can pay it. However, you should choose a suitable time for this demand since it may have adverse affects on the efforts of reconciling. If you think that asking money will force him to correct himself then you may do so at any time. If he corrects himself and you can give up your loan then it is advisable to strengthen the marital relations.
Allaah Knows best.