Yup. That's probably the sensible answer.
But I do like the idea of scaling the Signer - or adding multiple sign languages after the fact. If you have X spoken languages and Y sign languages, you could end up with a large number of permutations.
As I said, just a little experiment to see if it would work.