It looks like no, you can’t change it to a pen, at least not with a simple setting. You probably could with a script.
Annotations in Object mode displays as a pen, but sculpt mode displays as a brush. Personally I think the annotations should display as a pen in all modes.
