He could have.. Mushashi would have removed it.. then damaged. Invisibility/Invincibility mean nothing to Musashi.