Otoharo!
Your description of anxiety is a perfect description of one of ego's patterns. I learned to in meditation or in ordinary consciousness, tell the ego, "no!". It is to go to its room and count beans. (ego is superb at counting and will be mollified) then procede. If at any time, panic or anxiety in any form threatens, take charge of ego immediately. Do not allow its interference.
finality