tokenize - How to stop . being treated as a separator in SQLite FTS4 -
i want able search numbers 2.3 using fts4 in sqlite, . being treated token boundary. short of writing full bespoke tokenizer there other way of excluding . list of token boundary characters?
being able search decimal numbers seems common use case, can't find relevant on / google. best solution @ present replace . chars in text known (long) string of letters , substitute accordingly on each search...
peter
the tokenizer defines tokens are, indeed need write own.
you search phrase "2 3"
, find numbers 2 , 3 separator.
Comments
Post a Comment