I'm genuinely curious about the software behind this. I know Eleven Labs, but they say they won't do proper voice cloning unless you own the voices e.g. it's your voice. I'm pretty sure cloning those voices is illegal (not that we care, but the company would).
I really want to make new EVA sound alerts for some projects I'm working on.
For example, I want the cadence and more human-like voice of the C&C3/TT GDI EVA's with the TS GDI EVA voice.
I love the TS EVA's voice. It sounds much better for a GDI EVA.
I also want to replicate the EVA voices for Dune 2000...
No, they definitely will. The voice cloning feature is very simple, and it lets you upload sample audio and start producing synthesized audio based on the sample pretty much right away. I don’t think they’re actively screening for people using voices without permission or anything right now, but they claim to be working on methods to put “audio watermarks” in generated audio so it can be traced back to you if someone sees something you generated and complains about it.
It works better with characters with unemotive, deadpan voices than with really bombastic voices. It supports speech-to-speech, and you can use a recording of your own voice to get the intonation and intensity, but it isn’t always going to sound right (it’s non-deterministic, though, so if you don’t like how it sounds, you can just have it regenerate it and try again). People have used Elevenlabs for Master Chief and Dagoth Ur’s voices, and it’s great for that, but doing a convincing Twilight Sparkle is very, very hard. It doesn’t help that Tara Strong’s voice as Twilight is full of idiosyncrasies unique to the character, like how her pitch is up and down and all over the place, or how she trails off sentences with a soft vocal fry.
15.ai are down right now, but even though their synthesizer produced tinnier and more metallic results than Elevenlabs, it was way, way more accurate to how Twilight Sparkle (and the rest) actually sounds, to the point where people used it to make a whole animatic “episode”: