I think talking of "refuting" the concept of human rights misses the point. It wasn't some statement of abstract moral philosophy, it was a reaction against the horrors of WWII.
"How's about we make a rule that governments aren't allowed to treat people like that?" sort of thing.
And yes...