aboutsummaryrefslogtreecommitdiffstats
path: root/tests
diff options
context:
space:
mode:
authoreunhhu <[email protected]>2026-09-28 12:57:44 +0100
committereunhhu <[email protected]>2026-09-28 12:57:44 +0100
commit0d2e04f1c9d05a598deb443ba067ef61e0b9cab3 (patch)
tree8074f9e8a6aadc5220e390b414cf3e339b640bfa /tests
parentc38380464d29c4502c98d996236ccf890392fe86 (diff)
downloadvega-0d2e04f1c9d05a598deb443ba067ef61e0b9cab3.tar.gz
vega-0d2e04f1c9d05a598deb443ba067ef61e0b9cab3.zip
Break text into lines, graphemes, words and sentences as Unicode's tests require
UAX #14 line breaking (LB1-LB31, numbers tailored as Unicode's tests are) and UAX #29's grapheme cluster, word and sentence boundaries, each from generated property tables, the rules taken in order, in linear time. They pass all of Unicode 15.1's LineBreakTest (10,274 cases), GraphemeBreakTest (1,187), WordBreakTest (1,826) and SentenceBreakTest (512).
Diffstat (limited to 'tests')
0 files changed, 0 insertions, 0 deletions