Would nylon strings on a baritone guitar sound good?

I've been told that nylon strings on a baritone guitar would sound bad - they'd rattle around. Is that true or just a fabrication from the minds of lazy luthiers? I'm kidding, but it seems to me like it wouldn't be that bad.