All perfect praise be to Allaah, The Lord of the worlds. I testify that there is none worthy of worship except Allaah and that Muhammad is His slave and Messenger.
This question should be addressed to Islamic institutions in your country or to the scholars who are familiar with the circumstances of those communities, the reason why they asked you for the money in question, and whether or not they have the right to ask for it. It is only those who know the reality of the situation and have a clear understanding of it who can issue a ruling about it.
In any case, if they prevent you from going to Hajj, then you are not sinful and are not required to do anything because of having the intention of Hajj while being unable to travel due to that reason or any other reasons.
As for what you can do, then you may consult experienced and competent people in this field about alternatives or solutions and so on.
Allaah knows best.