/ File History
Login
SQLite training in Houston TX on 2019-11-05 (details)
Part of the 2019 Tcl Conference

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of ext/fts3/fts3_tokenizer.c

2019-04-13
04:38
Use the 64-bit memory allocator interfaces in extensions, whenever possible. file: [8034a560] check-in: [07ee06fd] user: drh branch: trunk, size: 14593
2019-03-29
17:26
Change the fts3_tokenizer() function to always return the pointer as a BLOB as long as the first argument is a bound parameter, regardless of the SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER setting. file: [24a51bda] check-in: [27160df7] user: drh branch: value_frombind, size: 14581
11:39
The two-argument version of fts3_tokenizer() works regardless of the value of SQLITE_DBCONFIG_ENABLE_FT3_TOKENIZER as long as the second argument is a bind parameter. file: [edadbd11] check-in: [ab76e3a9] user: drh branch: value_frombind, size: 14546
2019-03-01
21:33
The fts3_tokenizer() function returns NULL if the SQLITE_DBCONFIG_ENABLE_FTS_TOKENIZER setting is disabled, which is is by default. file: [ee670e9e] check-in: [f5732f4c] user: drh branch: trunk, size: 14511
2016-07-28
14:37
Allow the 'testfixture.exe' target to be compiled with the __stdcall calling convention. file: [a22bf311] check-in: [e8be3dfe] user: mistachkin branch: callbackConv, size: 14466
2016-02-26
15:38
Provide the new SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER option to sqlite3_db_config() that can be used to activate the two-argument version of fts3_tokenizer() for a specific database connection at run-time. file: [3cf21cd2] check-in: [374b5108] user: drh branch: trunk, size: 14391
2016-02-08
20:06
Fix a compiler warning when compiling without SQLITE_ENABLE_FTS3_TOKENIZER. file: [4bd72f76] check-in: [6926f28c] user: drh branch: trunk, size: 14099
19:40
Disable the two-argument form of the fts3_tokenizer() SQL function unless the library is built with -DSQLITE_ENABLE_FTS3_TOKENIZER. file: [0d3a77bb] check-in: [e0eb217a] user: dan branch: trunk, size: 14020
2015-05-01
14:07
Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, and to ensure that error messages are not overwritten and thus leaked. file: [50e7a69a] check-in: [605347e0] user: drh branch: trunk, size: 13750
2015-04-19
21:43
Fix harmless compiler warnings seen with MSVC 2015. file: [9afd223b] check-in: [d05becd8] user: mistachkin branch: vsix2015, size: 13750
2015-03-21
19:35
Avoid a segfault if NULL is passed as the first argument to SQL scalar function fts3_tokenizer(). file: [b7e586ba] check-in: [6d098969] user: dan branch: trunk, size: 13747
2015-03-19
16:25
Fix an FTS3/4 problem with handling empty tokenizer declarations (e.g. "CREATE VIRTUAL TABLE t(tokenize=);"). file: [0f9e6e01] check-in: [26d2def8] user: dan branch: trunk, size: 13710
2013-03-21
21:20
Many spelling fixes in comments. No changes to code. file: [bbdc731b] check-in: [6f6e2d50] user: mistachkin branch: trunk, size: 13657
2012-10-17
20:15
Initialize variables used as outputs of custom tokenizer method calls in fts4. file: [3664bb88] check-in: [514505a8] user: dan branch: trunk, size: 13657
2012-06-07
15:53
Add the "tokenchars=" and "separators=" options, for customizing the set of characters considered to be token separators, to the unicode61 tokenizer. file: [e94a8b90] check-in: [e56fb462] user: dan branch: trunk, size: 13641
2012-03-03
18:46
Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. file: [3da7254a] check-in: [f8e9c445] user: dan branch: fts4-languageid, size: 13693
2011-06-28
07:15
Changes to allow FTS to be compiled as a loadable module again. file: [9ff7ec66] check-in: [29e69f38] user: dan branch: trunk, size: 13718
2011-06-20
17:24
Fix various harmless compiler warnings in FTS3 and RTREE. file: [6089986e] check-in: [fe62179e] user: drh branch: trunk, size: 13795
2011-06-16
00:54
Changes to #ifdefs so that the build goes correctly if the only FTS macro defined is SQLITE_ENABLE_FTS4. file: [90ba6cdd] check-in: [a0b43a32] user: drh branch: trunk, size: 13791
2010-11-26
16:49
Fix various compiler warnings. file: [055f3dc7] check-in: [c412f612] user: drh branch: trunk, size: 13791
2010-11-02
17:41
Changes to allow FTS4 tables to be created without the underlying %_docsize table (in order to save space). file: [1301b0ee] check-in: [31989b18] user: dan branch: trunk, size: 13752
2010-08-06
19:00
Remove all vestiges of ctype.h from FTS3. This addresses ticket [991789d9f3136a] among other bug reports. file: [b4f2d01c] check-in: [b8b465ed] user: drh branch: trunk, size: 14030
2009-12-10
21:11
Avoid declaring and freeing test variables if SQLITE_TEST not defined. file: [1a49ee3d] check-in: [c2d22960] user: shaneh branch: trunk, size: 14049
2009-12-08
19:05
Add tests to improve coverage of fts3. Associated bugfixes. file: [3dc76eae] check-in: [f0eac417] user: dan branch: trunk, size: 14021
2009-12-07
16:26
Remove a redundant line from fts3. file: [52112e7b] check-in: [cd50acf3] user: dan branch: trunk, size: 14042
16:18
Move some SQLITE_TEST code down to avoid mixing code and variable declarations. Fix a test for high-order bit handling in sqlite3Fts3InitTokenizer(). file: [3607b104] check-in: [fad43d29] user: shaneh branch: trunk, size: 14086
2009-12-03
06:26
Updates to FTS3 to correct compiler warnings under MSVC. file: [73a4e0e0] check-in: [37495b55] user: shaneh branch: trunk, size: 14085
2009-12-02
20:25
Change an error message in FTS3 to avoid using an uninitialized variable. file: [17335e98] check-in: [620a8a2b] user: drh branch: trunk, size: 13927
2009-11-19
15:25
Fix some fts3 related issues with the autoconf and amalgamation build systems. file: [36f78d1a] check-in: [3b179247] user: dan branch: fts3-refactor, size: 13934
2009-11-13
17:36
Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). file: [185a2126] check-in: [30a92f11] user: dan branch: fts3-refactor, size: 14001
2008-02-01
15:34
Minor fixes to FTS3 so that it works better when appended to the end of the amalgamation. (CVS 4769) file: [fcc8fdb5] check-in: [62ede669] user: drh branch: trunk, size: 10629
2007-11-24
00:41
The FTS3 amalgamation can now be appended to the SQLite amalgamation to generate a single source file that contains both components. (CVS 4558) file: [d777c079] check-in: [0fc61f99] user: drh branch: trunk, size: 10600
2007-08-20
17:37
Copy fts2 to fts3, renaming, and replacing references to fts2 with fts3, including capitalization variants. (CVS 4249) file: [81e76045] check-in: [216c91d2] user: shess branch: trunk, size: 10622 Added