All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ʻalayhi wa sallam, is His slave and Messenger.
Each of the parents has a right to dutifulness, kindness, and obedience in what is good. Please refer to Fataawa 87019 and 84942.
However, if your father prevents you from visiting your mother, you are not obliged to obey him because he is not commanding you to do something good and permissible; rather, this constitutes cooperation in severing ties of kinship on his part. So you should show dutifulness to your mother and visit her in her house as she requests. Try to do so without your father knowing so he doesn't get angry with you, and you would thereby be achieving two aspects of the general good.
Allaah Knows best.