What web server are you using please?
There was a similar topic and server time settings were most likely responsible for the issue - Chinese Letters using Text & Clock Module (v.1.7.8)
as for the CMS regional settings, you might want to use ‘en_GB’ in language.
Also are you using clock or text module?