Break numeric tokens on word boundary #103

Open
opened 2025-05-16 22:03:10 +02:00 by belka · 0 comments
Owner

123abc is tokenized as 2 tokens, 123 and abc. But it should be an error.

`123abc` is tokenized as 2 tokens, `123` and `abc`. But it should be an error.
belka added the
self-hosted
label 2025-05-16 22:03:10 +02:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: belka/elna#103
No description provided.