Joint Custody and moving

Ok here’s the scoop…Ex and I have Joint Legal and Physical Custody. Ex has had them a majority of the time since November 2007 because of circumstances I couldn’t control. We never changed the original custody agreement.
Now I’m getting my kids half the time again and Ex has just moved 2 hours away within the last 2 weeks. She’s moved in with a boyfriend(mind you that’s against the court order also) It’s becoming a hardship getting the kids back and forth. Can I make Ex move back closer???