Moving out of state

I am currently legally separated and the agreement now states that neither party can move 50 miles from the others residence with the children. Our two minor children live with me, but I want to be able to have the option to move back to NJ where our entire family is once we are legally divorced. We moved to NC b/c of my ex’s job and have no family/support down here.
Can I receive approval in the final divorce agreement to be able to move to NJ with the boys or can my ex block that? Will he have final say whether I can ever move out of state or not? Am I able to petition the court to allow me the ability to move back to NJ?

If your ex does not consent to you moving out of state with the children, you may file suit for custody and seek permission to move with the children.