I've no idea why a hat is relevant here, but I'd like to point out that males take hats off when going indoors (military is exempt, as are men-Jews in synagoges).
Personally I know too little to comment, but FWIW there is a thread on AH-com about "Lincoln directed reconstruction".