TinySegmenter Demo

A compact Japanese tokenizer, running entirely in your browser. Source: kampersanda/tiny-segmenter

Input

Options

joinNumericSequences Keep consecutive numerals in a single segment.

userWords Keep the specified words from being split. Separate words with spaces or commas.

Segments