To my recollection, Samurai, even relatively poor and powerless ones, were the only people authorized to carry weapons in pre-Meiji Japan.
I think the point you're missing, is that both unlanded Knights, and unlanded Samurai were afforded special rights and privileges not granted to common...