Did I Jump The Gun This Time?

My husband of 5 years has been hiding the fact his ex-wife has been asking him for money. Now understand that this money is rightfully due to her for old child support. Their kids are grown (26/29) but a few years ago the state started garnishing his pay check. In turn he quit his job.
Will it just so happen that I gave him a call one night (he drives truck over the road). Now my husband has opened an account for me so that I could have money when his not around if we come up short on something.
Now his ex-wife as far as working not sure. The last I heard she was fired from her job. Yes, I have my own money and a good job as well. Anyway, as I was saying I called him one night while I was at work. I asked if he had called? He said.
“I had to take 100.00 dollars from that account,” is what he said. Will I asked why because he and I both get paid on the same day. He said because with his visa debit card he had taken out his limit and that his ex-wife had been on him about money. In the back ground I could hear what sounded like a casino. Which was ot unsual for he or myself.
Will I had no idea that this was going on (him giving him money). SO I blew up on the phone. I REALLY said a LOT OF CHOICE words and SAID I WOULD HURT him for doing this to me. Man was I ANGERY. I could not believe that he could have been so secretive. Not to mention that he is buying me a house, will I’m helping as well. He doesn’t want me to work any longer. Now here she comes again.
But this time he brought her in under the radior.
I really didn’t give him a chance to say much over the phone, and I told him to stay where he was and not to come back home. I had had enough. I spoke with his son who told that, “yes mom has been being a b….tch about money. That still didn’t satisfy my anger.
Everyone that I spoke with said that they understand my being upset about him taking the money from the account without speaking to me. What they didn’t understand is that I have two phones and that he had texted me on the phone I left at home. He knows not to call me at work. I didn’t see that text until I arrived home that money.
I check the transactions of that day and I could see where he was in her home town (she lives out of state but kind of on his route for delivery like and two off track route to get to her home). I failed to memtion that she is very…very bi-polar as well. Her husband left her because of it as well. He moved to another state and now she is trying to move where he is. She gained a lot of weight as well and had gastric-by-pass surgery. My husband said that she lost the weight to get back with her ex but he now has a girlfriend.
Everytime he and I get one foot in front of the other there is something or someone getting in the way. Him driving over the road had been a hardship for both of us. Not seeing each other as we would like to. I guess I had reached my limit. It’s just that I have a lot of medical bills right now and neither one of us have health insurance. So the bills are really expensive. I just needy some clarity and honesty in my life right now. I didn’t need keeping this from me. Letting me find out this way. Did I jump the gun with telling him to leave etc,.?