Creation of Collator for Chinese locals fails

Created by: pgammans

Creating a Collator and rebuilding from its rules fails for Chinese Collator's

The following code works if you change the locale to Locale("en", "US", "") , Locale("da", "DK", "") and a few others but not Locale("zh", "hant", "TW") , Locale("zh", "hans", "CN") , Locale("zh", "CN")

import icu
zh_TWCollator= icu.Collator.createInstance(icu.Locale("zh", "TW"))
zh_TWRules = zh_TWCollator.getRules();
newCollator = icu.RuleBasedCollator(zh_TWRules)

Traceback (most recent call last): File "", line 1, in ICUError: Character conversion: Unmappable input sequence. In other APIs: Invalid character., error code: 10

ie this line fails.

icu.Collator.createInstance(icu.Locale("zh", "TW"))

Traceback (most recent call last): File "", line 1, in UnicodeEncodeError: 'ascii' codec can't encode character u'\u0101' in position 34: ordinal not in range(128)