It wasn't completely a given, though -- signs were there to tell a peasant what that business did, for example, since a lot of them couldn't read.
For a blacksmith, it was an anvil; for pawnbrokers, scales.
Incidentally, that's where surnames came from; Hooper if you made barrels, Smith if you...