mojimoji

A Cython-based fast converter between Japanese hankaku and zenkaku characters.

Installation

$ pip install mojimoji

Examples

Zenkaku to Hankaku

>>> import mojimoji
>>> print(mojimoji.zen_to_han('アイウａｂｃ０１２'))
ｱｲｳabc012
>>> print(mojimoji.zen_to_han('アイウａｂｃ０１２', kana=False))
アイウabc012
>>> print(mojimoji.zen_to_han('アイウａｂｃ０１２', digit=False))
ｱｲｳabc０１２
>>> print(mojimoji.zen_to_han('アイウａｂｃ０１２', ascii=False))
ｱｲｳａｂｃ012

Hankaku to Zenkaku

>>> import mojimoji
>>> print(mojimoji.han_to_zen('ｱｲｳabc012'))
アイウａｂｃ０１２
>>> print(mojimoji.han_to_zen('ｱｲｳabc012', kana=False))
ｱｲｳａｂｃ０１２
>>> print(mojimoji.han_to_zen('ｱｲｳabc012', digit=False))
アイウａｂｃ012
>>> print(mojimoji.han_to_zen('ｱｲｳabc012', ascii=False))
アイウabc０１２

Benchmarks

Library versions

• mojimoji: 0.0.1
• zenhan: 0.4
• unicodedata: Bundled with Python 2.7.3

Results

In [19]: s = 'ＡＢＣＤＥＦＧ０１２３４５' * 10

In [20]: %time for n in range(1000000): mojimoji.zen_to_han(s)
CPU times: user 2.86 s, sys: 0.10 s, total: 2.97 s
Wall time: 2.88 s

In [21]: %time for n in range(1000000): unicodedata.normalize('NFKC', s)
CPU times: user 5.43 s, sys: 0.12 s, total: 5.55 s
Wall time: 5.44 s

In [22]: %time for n in range(1000000): zenhan.z2h(s)
CPU times: user 69.18 s, sys: 0.11 s, total: 69.29 s
Wall time: 69.48 s

Links

• mojimoji-rs: The Rust implementation of mojimoji
• gomojimoji: The Go implementation of mojimoji