Dissatisfied with attorney

We currently have an attorney but have not been happy with him for quite some time. Are we legally and/or ethically allowed to have a consultation with other lawyers before we “let him go”? We don’t want to be without a lawyer in between while finding a new one.
Thanks!

Of course, you can certainly have consultation with other attorneys even though you are already represented.