Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
History of file ext/fts3/fts3_tokenizer.c at check-in trunk
|
2020-01-17
| ||
| 14:18 | [3a9c6a25] part of check-in [cbcbb1e5] Import all FTS3/4 enhancements and fixes that exist on the latest trunk (3.31.0-beta) that do not require extensive change to the SQLite core into the 3.22 branch. Basically, the 3.31.0 FTS3 sources are copied into 3.22.0, with minor changes to work around core enhancements that are not available in 3.22.0. (check-in: [cbcbb1e5] user: drh branch: branch-3.22, size: 15002) | |
|
2020-01-09
| ||
| 20:33 | [6d8fc150] part of check-in [966964af] Only register the fts3_tokenizer() function using a single text encoding. (check-in: [966964af] user: drh branch: trunk, size: 14668) | |
|
2019-12-31
| ||
| 18:12 | [4a36573c] part of check-in [f3171dc2] Set the SQLITE_DIRECTONLY flag on the fts3_tokenizer() function of FTS3, thus preventing that function from being called from within a trigger or view. (check-in: [f3171dc2] user: drh branch: trunk, size: 14667) | |
|
2019-11-18
| ||
| 14:04 | [a1ca0ab7] part of check-in [6b67eba5] Improvements to detection of corruption in the %_stat shadow table of FTS4. (check-in: [6b67eba5] user: drh branch: trunk, size: 14649) | |
|
2019-04-13
| ||
| 04:38 | [8034a560] part of check-in [07ee06fd] Use the 64-bit memory allocator interfaces in extensions, whenever possible. (check-in: [07ee06fd] user: drh branch: trunk, size: 14593) | |
|
2019-03-29
| ||
| 17:26 | [24a51bda] part of check-in [27160df7] Change the fts3_tokenizer() function to always return the pointer as a BLOB as long as the first argument is a bound parameter, regardless of the SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER setting. (check-in: [27160df7] user: drh branch: value_frombind, size: 14581) | |
| 11:39 | [edadbd11] part of check-in [ab76e3a9] The two-argument version of fts3_tokenizer() works regardless of the value of SQLITE_DBCONFIG_ENABLE_FT3_TOKENIZER as long as the second argument is a bind parameter. (check-in: [ab76e3a9] user: drh branch: value_frombind, size: 14546) | |
|
2019-03-01
| ||
| 21:33 | [ee670e9e] part of check-in [f5732f4c] The fts3_tokenizer() function returns NULL if the SQLITE_DBCONFIG_ENABLE_FTS_TOKENIZER setting is disabled, which is is by default. (check-in: [f5732f4c] user: drh branch: trunk, size: 14511) | |
|
2016-07-28
| ||
| 14:37 | [a22bf311] part of check-in [e8be3dfe] Allow the 'testfixture.exe' target to be compiled with the __stdcall calling convention. (check-in: [e8be3dfe] user: mistachkin branch: callbackConv, size: 14466) | |
|
2016-02-26
| ||
| 15:38 | [3cf21cd2] part of check-in [374b5108] Provide the new SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER option to sqlite3_db_config() that can be used to activate the two-argument version of fts3_tokenizer() for a specific database connection at run-time. (check-in: [374b5108] user: drh branch: trunk, size: 14391) | |
|
2016-02-08
| ||
| 20:06 | [4bd72f76] part of check-in [6926f28c] Fix a compiler warning when compiling without SQLITE_ENABLE_FTS3_TOKENIZER. (check-in: [6926f28c] user: drh branch: trunk, size: 14099) | |
| 19:40 | [0d3a77bb] part of check-in [e0eb217a] Disable the two-argument form of the fts3_tokenizer() SQL function unless the library is built with -DSQLITE_ENABLE_FTS3_TOKENIZER. (check-in: [e0eb217a] user: dan branch: trunk, size: 14020) | |
|
2015-05-01
| ||
| 14:07 | [50e7a69a] part of check-in [605347e0] Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, and to ensure that error messages are not overwritten and thus leaked. (check-in: [605347e0] user: drh branch: trunk, size: 13750) | |
|
2015-04-19
| ||
| 21:43 | [9afd223b] part of check-in [d05becd8] Fix harmless compiler warnings seen with MSVC 2015. (check-in: [d05becd8] user: mistachkin branch: vsix2015, size: 13750) | |
|
2015-03-21
| ||
| 19:35 | [b7e586ba] part of check-in [6d098969] Avoid a segfault if NULL is passed as the first argument to SQL scalar function fts3_tokenizer(). (check-in: [6d098969] user: dan branch: trunk, size: 13747) | |
|
2015-03-19
| ||
| 16:25 | [0f9e6e01] part of check-in [26d2def8] Fix an FTS3/4 problem with handling empty tokenizer declarations (e.g. "CREATE VIRTUAL TABLE t(tokenize=);"). (check-in: [26d2def8] user: dan branch: trunk, size: 13710) | |
|
2013-03-21
| ||
| 21:20 | [bbdc731b] part of check-in [6f6e2d50] Many spelling fixes in comments. No changes to code. (check-in: [6f6e2d50] user: mistachkin branch: trunk, size: 13657) | |
|
2012-10-17
| ||
| 20:15 | [3664bb88] part of check-in [514505a8] Initialize variables used as outputs of custom tokenizer method calls in fts4. (check-in: [514505a8] user: dan branch: trunk, size: 13657) | |
|
2012-06-07
| ||
| 15:53 | [e94a8b90] part of check-in [e56fb462] Add the "tokenchars=" and "separators=" options, for customizing the set of characters considered to be token separators, to the unicode61 tokenizer. (check-in: [e56fb462] user: dan branch: trunk, size: 13641) | |
|
2012-03-03
| ||
| 18:46 | [3da7254a] part of check-in [f8e9c445] Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. (check-in: [f8e9c445] user: dan branch: fts4-languageid, size: 13693) | |
|
2011-06-28
| ||
| 07:15 | [9ff7ec66] part of check-in [29e69f38] Changes to allow FTS to be compiled as a loadable module again. (check-in: [29e69f38] user: dan branch: trunk, size: 13718) | |
|
2011-06-20
| ||
| 17:24 | [6089986e] part of check-in [fe62179e] Fix various harmless compiler warnings in FTS3 and RTREE. (check-in: [fe62179e] user: drh branch: trunk, size: 13795) | |
|
2011-06-16
| ||
| 00:54 | [90ba6cdd] part of check-in [a0b43a32] Changes to #ifdefs so that the build goes correctly if the only FTS macro defined is SQLITE_ENABLE_FTS4. (check-in: [a0b43a32] user: drh branch: trunk, size: 13791) | |
|
2010-11-26
| ||
| 16:49 | [055f3dc7] part of check-in [c412f612] Fix various compiler warnings. (check-in: [c412f612] user: drh branch: trunk, size: 13791) | |
|
2010-11-02
| ||
| 17:41 | [1301b0ee] part of check-in [31989b18] Changes to allow FTS4 tables to be created without the underlying %_docsize table (in order to save space). (check-in: [31989b18] user: dan branch: trunk, size: 13752) | |
|
2010-08-06
| ||
| 19:00 | [b4f2d01c] part of check-in [b8b465ed] Remove all vestiges of ctype.h from FTS3. This addresses ticket [991789d9f3136a] among other bug reports. (check-in: [b8b465ed] user: drh branch: trunk, size: 14030) | |
|
2009-12-10
| ||
| 21:11 | [1a49ee3d] part of check-in [c2d22960] Avoid declaring and freeing test variables if SQLITE_TEST not defined. (check-in: [c2d22960] user: shaneh branch: trunk, size: 14049) | |
|
2009-12-08
| ||
| 19:05 | [3dc76eae] part of check-in [f0eac417] Add tests to improve coverage of fts3. Associated bugfixes. (check-in: [f0eac417] user: dan branch: trunk, size: 14021) | |
|
2009-12-07
| ||
| 16:26 | [52112e7b] part of check-in [cd50acf3] Remove a redundant line from fts3. (check-in: [cd50acf3] user: dan branch: trunk, size: 14042) | |
| 16:18 | [3607b104] part of check-in [fad43d29] Move some SQLITE_TEST code down to avoid mixing code and variable declarations. Fix a test for high-order bit handling in sqlite3Fts3InitTokenizer(). (check-in: [fad43d29] user: shaneh branch: trunk, size: 14086) | |
|
2009-12-03
| ||
| 06:26 | [73a4e0e0] part of check-in [37495b55] Updates to FTS3 to correct compiler warnings under MSVC. (check-in: [37495b55] user: shaneh branch: trunk, size: 14085) | |
|
2009-12-02
| ||
| 20:25 | [17335e98] part of check-in [620a8a2b] Change an error message in FTS3 to avoid using an uninitialized variable. (check-in: [620a8a2b] user: drh branch: trunk, size: 13927) | |
|
2009-11-19
| ||
| 15:25 | [36f78d1a] part of check-in [3b179247] Fix some fts3 related issues with the autoconf and amalgamation build systems. (check-in: [3b179247] user: dan branch: fts3-refactor, size: 13934) | |
|
2009-11-13
| ||
| 17:36 | [185a2126] part of check-in [30a92f11] Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). (check-in: [30a92f11] user: dan branch: fts3-refactor, size: 14001) | |
|
2008-02-01
| ||
| 15:34 | [fcc8fdb5] part of check-in [62ede669] Minor fixes to FTS3 so that it works better when appended to the end of the amalgamation. (CVS 4769) (check-in: [62ede669] user: drh branch: trunk, size: 10629) | |
|
2007-11-24
| ||
| 00:41 | [d777c079] part of check-in [0fc61f99] The FTS3 amalgamation can now be appended to the SQLite amalgamation to generate a single source file that contains both components. (CVS 4558) (check-in: [0fc61f99] user: drh branch: trunk, size: 10600) | |
|
2007-08-20
| ||
| 17:37 | Added: [81e76045] part of check-in [216c91d2] Copy fts2 to fts3, renaming, and replacing references to fts2 with fts3, including capitalization variants. (CVS 4249) (check-in: [216c91d2] user: shess branch: trunk, size: 10622) | |