Word Break - Single Quote

Unicode Version 18.0

Single Quote is a character that acts as a punctuation mark used to indicate possession, contractions, or quotations, but in the context of word segmentation, it behaves uniquely by preventing breaks between itself and adjacent letters. Specifically, it binds tightly to preceding and following alphanumeric characters, so sequences like "don't" or "James'" are treated as a single word unit, while it does not initiate a break on its own. However, if a Single Quote appears between two spaces or at the start of a line, it may allow a break, and it also interacts with adjacent quotes to form clusters that resist splitting. This behavior ensures that apostrophe-like usage does not fragment text into unintended separate tokens, aiding natural language processing tasks.

1-1 of 1 results

U+0027
'
Apostrophe