fix: when merging punctuation into tokens to prevent line breaks, acc…#1812

Merged

ggurdin merged 1 commit intomainfrom preceding-newline-punctuation

Feb 17, 2025

Commits on Feb 17, 2025

fix: when merging punctuation into tokens to prevent line breaks, account for punctuation preceding tokens
ggurdin
committed