aboutsummaryrefslogtreecommitdiffstats
path: root/text/text.h
Commit message (Collapse)AuthorAgeFilesLines
* Break text into lines, graphemes, words and sentences as Unicode's tests requireeunhhu2026-09-281-0/+44
| | | | | | | | | UAX #14 line breaking (LB1-LB31, numbers tailored as Unicode's tests are) and UAX #29's grapheme cluster, word and sentence boundaries, each from generated property tables, the rules taken in order, in linear time. They pass all of Unicode 15.1's LineBreakTest (10,274 cases), GraphemeBreakTest (1,187), WordBreakTest (1,826) and SentenceBreakTest (512).
* Generate the Unicode properties shaping needseunhhu2026-09-281-0/+32
| | | | | | Joining types, general categories and scripts (with their ISO 15924 codes) as two-stage tables, canonical decompositions one step at a time, and Extended_Pictographic, from the UCD by text/unicode.py.
* Normalize text to NFD and NFC, passing all of Unicode's normalization testseunhhu2026-09-281-0/+11
|
* Resolve bidirectional text as UAX #9 does, passing all of Unicode's bidi testseunhhu2026-09-281-0/+37