The "paper" you speak of has traditionally merely represented ownership of goods or real estate. "Shuffling it" does have a purpose, one of making market prices adjust to economic trends quickly and accurately. There certainly is some value in that.A producer-centric economy is intrinsically better than one based around high finance, because it results in products that people can actually use, instead of just shuffling paper.
Of course for there to be value in that there have to be loads of actual goods being produced to be traded and priced in this manner, so for a wealthy economy, both are absolutely necessary.
Ask not why a society is poor, ask why some societies are wealthy, because historically, the former is the natural default. For most of history most people anywhere in the world were some sort of very production centered hunter gatherers or subsistence farmers and they were all incredibly poor by modern first world standards, and more often than not had to pay taxes to the lord in his castle too.The idea that people can be rewarded a pittance in wages for producing all the goods and services needed by society, while watching people sitting around in wing-backed chairs collecting billions of dollars for doing absolutely fuck-all, is maddening on the face of it. People wage-slave for years and years and have nothing to show for it, only to be demoralized by the wealth and power of indolent robber-barons. This is a social ill.
The only exceptions to that are fairly recent, no more than 3 centuries ago and usually less, and usually revolve around societies that had something to do with the meme "wild capitalism" of not so long ago.
Well that's an argument to not have these things decided by labyrinthine rules that require weeks or months for a staff of many differently specialized lawyers to read and understand.Not to mention, in a plutocracy, the latter group will inevitably have more political power and representation than the former, which means they’ll be able to warp rules and regulations to funnel even more of society’s value into their pockets.
Why should the people who contribute the least labor to the economy have an overwhelming say in how that economy is run and for whose benefit? Every time these sons of bitches lose a gamble, they simply have the Fed print more money, deface our currency through inflation, and keep lining their pockets. Who does this benefit, really? If you have this much wealth inequality, where people can’t even afford to buy homes or start families, then society will break down.
Those who gamble should gamble with their own money, and those who are "too big to fail" should not be allowed to gamble, for gambling involves a possibility of failure.
In societies that claimed to have the economy run by workers, it was even worse, but hey, at least even their barons had to fear about keeping their wealth and lives. Not that thinking it (because saying it loudly was also dangerous) helped much when they had to worry not about affording houses and families, but about getting a state coupon for a house and whether they will get any bread for the family after standing in line at the store for hours.