Refusal of visitation

Would an attorney advise his/her client to withhold visitation?

Unless the attorney has any reason to believe you are a danger to the child, or present a risk of fleeing with the child I cannot imagine why they would advise their client to withhold visitation.
You should contact the attorney and ask to set a time for visitation.