/ File History
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of ext/fts5/test/fts5tokenizer.test

2018-12-03
16:14
Add the "remove_diacritics=2" option to the unicode61 tokenizer in both FTS5 and FTS3/4. file: [ac3c9112] check-in: [06177f3f] user: dan branch: trunk, size: 9124
2017-07-07
19:43
Change the error message text for SQLITE_ERROR to omit the part about "missing database" as that meaning is now obsolete (since approx SQLite 2.0). file: [6aeb5e80] check-in: [732f90d6] user: drh branch: trunk, size: 9124
2017-01-23
07:06
Fix a problem preventing FTS5 from correctly passing the FTS5_TOKENIZE_PREFIX flag to custom tokenizer implementations. file: [f64ab5fe] check-in: [03c60134] user: dan branch: trunk, size: 9125
2015-07-31
14:43
Fix a bug in the fts5 porter tokenizer preventing it from passing xCreate() arguments through to its parent tokenizer. file: [ea4df698] check-in: [c3c672af] user: dan branch: trunk, size: 7991
2015-06-25
20:36
Fix Makefile.in to account for recent changes. Update fts5 test scripts so that they do not run if SQLITE_ENABLE_FTS5 is not defined. file: [83e7e01a] check-in: [31752207] user: dan branch: fts5, size: 7540
2015-05-20
09:27
Improve test coverage of fts5_tokenize.c. file: [668747fc] check-in: [0e91a6a5] user: dan branch: fts5, size: 7444
2015-05-19
19:37
Add tests for fts5 tokenizers. file: [f54bbbff] check-in: [4f90ba20] user: dan branch: fts5, size: 6439
11:32
Fix a memory leak that could follow an OOM condition in fts5. file: [45cc6522] check-in: [de9f8ef6] user: dan branch: fts5, size: 4119
2015-04-29
20:54
Improve fts5 tests. file: [bbcde2a7] check-in: [c1f07a3a] user: dan branch: fts5, size: 3074
2015-04-24
19:41
Add the "unindexed" column option to fts5. file: [7a6ee24d] check-in: [86309961] user: dan branch: fts5, size: 2820
2015-01-12
17:58
Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the default tokenizer. Change the name of the simple tokenizer to "ascii". file: [b34ae592] check-in: [f22dbcca] user: dan branch: fts5, size: 2811
2015-01-06
19:08
Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. file: [f951bb9b] check-in: [65f0262f] user: dan branch: fts5, size: 2813
2014-12-29
15:59
Move all fts5 test files to new directory "ext/fts5/test". file: [a1f3128e] check-in: [7f148edb] user: dan branch: fts5, size: 2206 Renamed from ext/fts5/fts5tokenizer.test