Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
History for ext/fts5/fts5_config.c
|
2024-11-02
| ||
| 19:10 | [e7d8dd062b] part of check-in [46929ae92b] Allow an fts5 table or query to be configured to collect xInstToken data for any prefix terms as part of the first parse of the main index, if any. (check-in: [46929ae92b] user: dan branch: fts5-tokendata-prefix, size: 31011) | |
|
2024-09-13
| ||
| 16:30 | [a6633d8859] part of check-in [c51dc2a5e7] Require that the contentless_unindexed=1 option be specified before storing the values of fts5 UNINDEXED column belonging to contentless tables. (check-in: [c51dc2a5e7] user: dan branch: fts5-contentless-unindexed, size: 30724) | |
| 15:37 | [700d7accca] part of check-in [d2f0d19936] Merge latest trunk changes, including the changes to the fts5 locale=1 feature, into this branch. (check-in: [d2f0d19936] user: dan branch: fts5-contentless-unindexed, size: 30046) | |
|
2024-09-10
| ||
| 16:19 | [da21548ddb] part of check-in [55c5c119a0] Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. (check-in: [55c5c119a0] user: dan branch: fts5-locale-alternate, size: 29531) | |
|
2024-09-03
| ||
| 18:55 | [8dba11620a] part of check-in [dcacb1a8ef] Store the values of any UNINDEXED columns of a contentless fts5 table persistently in the database. Warning: This currently creates a (technically) incompatible file-format for contentless fts5 tables that have UNINDEXED columns. (check-in: [dcacb1a8ef] user: dan branch: fts5-contentless-unindexed, size: 29771) | |
|
2024-08-16
| ||
| 19:05 | [353d2a0d12] part of check-in [9d971b31df] Add tests to restore coverage of fts5_config.c. (check-in: [9d971b31df] user: dan branch: fts5-locale, size: 29256) | |
|
2024-08-10
| ||
| 18:59 | [187f7ffa5e] part of check-in [03e63ed24e] Update the fts5_tokenizer_v2 API so that the locale is passed as parameter to xTokenize(), instead of via a separate call to xSetLocale(). (check-in: [03e63ed24e] user: dan branch: fts5-locale, size: 29338) | |
|
2024-08-02
| ||
| 21:06 | [b7924194b5] part of check-in [c98ccc1216] Change things so that locale=1 is required to write fts5_locale() values to an fts5 table, and so that blobs may not be stored in indexed (i.e. not UNINDEXED) columns of these tables. (check-in: [c98ccc1216] user: dan branch: fts5-locale, size: 29024) | |
|
2024-07-31
| ||
| 20:49 | [31267fc68f] part of check-in [8bd4ae7e95] Fix various problems with the code on this branch. (check-in: [8bd4ae7e95] user: dan branch: fts5-locale, size: 29267) | |
|
2024-07-26
| ||
| 20:50 | [0c96490fba] part of check-in [8839ef7cfb] Add the fts5_locale() function, and begin adding the related functionality to fts5. (check-in: [8839ef7cfb] user: dan branch: fts5-locale, size: 28938) | |
|
2024-06-05
| ||
| 20:50 | [68cb87a492] part of check-in [816d474938] Fix harmless compilation issues seen with MSVC. (check-in: [816d474938] user: mistachkin branch: trunk, size: 28193) | |
|
2024-05-29
| ||
| 15:16 | [1ae512e737] part of check-in [c08dd245f7] Remove an unused parameter from fts5ConfigParseSpecial(). Compiler-warning fix only - no functional changes. (check-in: [c08dd245f7] user: drh branch: trunk, size: 28186) | |
|
2024-05-13
| ||
| 20:06 | [74093394dc] part of check-in [69ef47eeee] Allow existing fts5 tables to be dropped even if the associated tokenizer is not available. (check-in: [69ef47eeee] user: dan branch: fts5-delay-tokenizer, size: 28218) | |
|
2024-04-17
| ||
| 19:48 | [fe565c6a12] part of check-in [6a640ea4d8] Prevent tokenize-blobs from being used with non-contentless tables. Fix some other issues with the new code on this branch. (check-in: [6a640ea4d8] user: dan branch: fts5-tokenize-blob, size: 29584) | |
|
2024-04-15
| ||
| 20:24 | [777bfe8e71] part of check-in [6c51c9c6a8] Add experimental way to specify an alternative tokenizer when writing to or querying an fts5 table. (check-in: [6c51c9c6a8] user: dan branch: fts5-tokenize-blob, size: 29067) | |
|
2023-10-11
| ||
| 21:08 | [8072a20703] part of check-in [122935182a] Add the tokendata=1 option to ignore trailing token-data when querying an fts5 table. (check-in: [122935182a] user: dan branch: fts5-token-data, size: 28751) | |
|
2023-07-25
| ||
| 15:48 | [0543595435] part of check-in [1079300db2] Change the name of the fts5 'delete-automerge' option to 'deletemerge'. And add tests for it. (check-in: [1079300db2] user: dan branch: fts5-contentless-delete, size: 28463) | |
|
2023-07-24
| ||
| 19:13 | [c35f343358] part of check-in [b314be66b9] Add the fts5 'delete-automerge' integer option. A level is eligible for auto-merging if it has a greater than or equal percentage of its entries deleted by tombstones than the 'delete-automerge' option. Default value is 10. (check-in: [b314be66b9] user: dan branch: fts5-contentless-delete, size: 28476) | |
|
2023-07-10
| ||
| 20:44 | [010fabcc0a] part of check-in [e513bea84d] Begin adding support for deleting rows from contentless fts5 tables. (check-in: [e513bea84d] user: dan branch: fts5-contentless-delete, size: 28009) | |
|
2023-05-03
| ||
| 13:57 | [051056a905] part of check-in [fe9c207657] Add an assert() to fts5_config to ensure that a potential OOM is being handled correctly. (check-in: [fe9c207657] user: dan branch: trunk, size: 27051) | |
|
2023-04-12
| ||
| 17:40 | [46af0b3c3c] part of check-in [4240fd09b7] Add the 'secure-delete' option to fts5. Used to configure fts5 to aggressively remove old full-text-index entries belonging to deleted or updated rows. (check-in: [4240fd09b7] user: dan branch: fts5-secure-delete, size: 26986) | |
|
2021-10-05
| ||
| 17:41 | [501e7d3566] part of check-in [36177a62fe] Fixes for harmless static-analyzer warnings. This also makes the code easier for humans to understand. (check-in: [36177a62fe] user: drh branch: trunk, size: 26557) | |
|
2021-04-12
| ||
| 18:32 | [8336d0ff6d] part of check-in [1cfcd9dceb] Avoid taking the address of a NULL pointer following an OOM in FTS5. Doing so is harmless in actual practice, but it technically UB so we want to avoid it. (check-in: [1cfcd9dceb] user: drh branch: trunk, size: 26468) | |
|
2020-09-30
| ||
| 20:35 | [be54f44fca] part of check-in [0d7810c1ae] Add experimental unicode-aware trigram tokenizer to fts5. And support for LIKE and GLOB optimizations for fts5 tables that use said tokenizer. (check-in: [0d7810c1ae] user: dan branch: fts5-trigram, size: 26450) | |
|
2019-12-10
| ||
| 03:40 | [b447948f35] part of check-in [355afd77df] Avoid a buffer overread in fts5 that could occur when parsing corrupt configuration records. (check-in: [355afd77df] user: dan branch: trunk, size: 26512) | |
|
2019-10-09
| ||
| 18:36 | [aab6117f8f] part of check-in [86e4972092] Do not allow users to effectively disable fts5 crisismerge operations by setting the crisismerge threshold to higher than the maximum allowable segment b-trees on a single level. Fix for [d392017c]. (check-in: [86e4972092] user: dan branch: trunk, size: 26520) | |
| 15:26 | [e26c5e2dcb] part of check-in [75775c5ab4] Disallow fts5 page sizes greater than 65536 bytes - as there are 16-bit offsets used in the page header. Fix for [81a7f7b9]. (check-in: [75775c5ab4] user: dan branch: trunk, size: 26442) | |
|
2019-10-07
| ||
| 20:36 | [2a5a00516d] part of check-in [8ab0aebdb3] Disallow page-sizes smaller than 32 bytes in fts5. Also ensure the fts5 integrity-check works even when "PRAGMA reverse_unordered_selects" is true. Fix for [265e935b26]. (check-in: [8ab0aebdb3] user: dan branch: trunk, size: 26443) | |
|
2019-09-12
| ||
| 19:38 | [606a29f296] part of check-in [9d418a7a49] Allow fts5 to filter on multiple MATCH clauses in a single scan. (check-in: [9d418a7a49] user: dan branch: trunk, size: 26443) | |
|
2019-03-20
| ||
| 05:45 | [d7523cba5e] part of check-in [1c0fe5b576] Fix various harmless compiler warnings seen with MSVC. (check-in: [1c0fe5b576] user: mistachkin branch: noWarnings, size: 26444) | |
|
2019-01-08
| ||
| 20:02 | [eeec97cb02] part of check-in [ca67f2ec0e] Use 64-bit math to compute the sizes of memory allocations in extensions. (check-in: [ca67f2ec0e] user: drh branch: trunk, size: 26429) | |
|
2016-03-12
| ||
| 16:32 | [5af9c360e9] part of check-in [72b3ff0f0d] Fix handling of strings that contain zero tokens in fts5. And other problems found by fuzzing. (check-in: [72b3ff0f0d] user: dan branch: trunk, size: 26407) | |
|
2016-03-09
| ||
| 20:54 | [abd3ae1107] part of check-in [556671444c] Add an incremental optimize capability to fts5. Make the 'merge' command independent of the 'automerge' settings. (check-in: [556671444c] user: dan branch: trunk, size: 26379) | |
|
2016-02-11
| ||
| 15:37 | [35c5173cae] part of check-in [cfe2eb88b5] Add JSON1 and FTS5 to the set of extensions subject to close compiler warning analysis. Fix some warnings in each. More (harmless) warnings still exist in FTS5. (check-in: [cfe2eb88b5] user: drh branch: trunk, size: 25982) | |
|
2016-01-16
| ||
| 18:58 | [0c384ebdd2] part of check-in [de77d6026e] Add further tests for fts5. Fix some problems with detail=col mode and auxiliary functions. (check-in: [de77d6026e] user: dan branch: trunk, size: 25978) | |
|
2016-01-14
| ||
| 14:15 | [9c243d04ac] part of check-in [5a343cc033] Fix compiler warnings in fts5. (check-in: [5a343cc033] user: dan branch: trunk, size: 25997) | |
|
2015-12-28
| ||
| 19:55 | [b0ed7b0ddd] part of check-in [228b4d10e3] Change the name of the offsets=0 option to "detail=column". Have the xInst, xPhraseFirst and other API functions work by parsing the original text for detail=column tables. (check-in: [228b4d10e3] user: dan branch: fts5-offsets, size: 25995) | |
|
2015-12-17
| ||
| 20:36 | [ba5248a05c] part of check-in [40b5bbf02a] Add the "offsets=0" option to fts5, to create a smaller index without term offset information. A few things are currently broken on this branch. (check-in: [40b5bbf02a] user: dan branch: fts5-offsets, size: 25404) | |
|
2015-11-25
| ||
| 11:56 | [0ee6618860] part of check-in [11eb8e877e] Fix the fts5 "prefix=" option to match the documentation (space separated list, multiple prefix= options supported). The undocumented comma-separated format (compatible with fts4) still works. (check-in: [11eb8e877e] user: dan branch: trunk, size: 25101) | |
|
2015-11-06
| ||
| 12:50 | [6fc92c0b1b] part of check-in [33e6606f5e] Have fts5 load its configuration from the xConnect() method is invoked. This ensures that the very first query run uses the correct value of the 'rank' option. (check-in: [33e6606f5e] user: dan branch: trunk, size: 24763) | |
|
2015-11-05
| ||
| 18:09 | [81ec07cb64] part of check-in [445480095e] Add the 'hashsize' configuration option to fts5, for configuring the amount of memory allocated to the in-memory hash table while writing. (check-in: [445480095e] user: dan branch: trunk, size: 24657) | |
|
2015-10-14
| ||
| 20:34 | [88a77f5d5e] part of check-in [1c46c194a2] Fix harmless compiler warnings. (check-in: [1c46c194a2] user: mistachkin branch: trunk, size: 24277) | |
|
2015-09-08
| ||
| 19:55 | [57ee5fe715] part of check-in [00d990061d] Remove the 0x00 terminators from the end of fts5 doclists stored on disk. (check-in: [00d990061d] user: dan branch: fts5-incompatible, size: 24262) | |
|
2015-08-29
| ||
| 15:44 | [80b61fd2c6] part of check-in [fc71868496] Another change to the fts5 tokenizer API. (check-in: [fc71868496] user: dan branch: fts5-incompatible, size: 24209) | |
|
2015-08-28
| ||
| 19:56 | [ab81c8ccff] part of check-in [90b85b42f2] Change the fts5 tokenizer API to allow more than one token to occupy a single position within a document. (check-in: [90b85b42f2] user: dan branch: fts5-incompatible, size: 24209) | |
|
2015-07-15
| ||
| 19:46 | [fdfa63ae8e] part of check-in [862418e350] Use a WITHOUT ROWID table to index fts5 btree leaves. This is faster to query and only slightly larger than storing btree nodes within an intkey table. (check-in: [862418e350] user: dan branch: fts5-btree-index, size: 24125) | |
|
2015-07-02
| ||
| 15:52 | [b2456e9625] part of check-in [7819002ed8] Remove "#ifdef SQLITE_ENABLE_FTS5" from individual fts5 source files. Add a single "#if !defined(SQLITE_CORE) || defined(SQLITE_ENABLE_FTS5)" to fts5.c. (check-in: [7819002ed8] user: dan branch: trunk, size: 24125) | |
|
2015-06-26
| ||
| 20:08 | [7d19f4516c] part of check-in [713239b8cf] Fix a segfault that could follow an OOM error in fts5. (check-in: [713239b8cf] user: dan branch: fts5, size: 24183) | |
| 04:34 | [d40da53f5e] part of check-in [ef2052f81e] Initial changes to get FTS5 working with MSVC. (check-in: [ef2052f81e] user: mistachkin branch: fts5Msvc, size: 24148) | |
|
2015-06-23
| ||
| 18:47 | [c232d181d6] part of check-in [df5ccea80e] Improve test coverage of fts5. (check-in: [df5ccea80e] user: dan branch: fts5, size: 24162) | |
|
2015-06-09
| ||
| 20:58 | [6ae691e36f] part of check-in [aa12f9d9b7] Add the "columnsize=" option to fts5, similar to fts4's "matchinfo=fts3". (check-in: [aa12f9d9b7] user: dan branch: fts5, size: 24270) | |
|
2015-05-18
| ||
| 17:50 | [11f969ed71] part of check-in [47dbfadb99] Improve test coverage of fts5_config.c. (check-in: [47dbfadb99] user: dan branch: fts5, size: 23982) | |
|
2015-05-08
| ||
| 09:21 | [05811f0bd8] part of check-in [f369caec14] Improve the error message returned by FTS5 if it encounters an unknown file format. (check-in: [f369caec14] user: dan branch: fts5, size: 24591) | |
|
2015-05-07
| ||
| 19:29 | [7a8b466523] part of check-in [a684b5e2d9] Change to storing all keys in a single merge-tree structure instead of one main structure and a separate one for each prefix index. This is a file-format change. Also introduce a mechanism for managing file-format changes. (check-in: [a684b5e2d9] user: dan branch: fts5, size: 24353) | |
|
2015-05-02
| ||
| 20:35 | [4e0de8bea4] part of check-in [c4456dc5f5] Reorganize some of the fts5 expression parsing code. Improve test coverage of the same. (check-in: [c4456dc5f5] user: dan branch: fts5, size: 24729) | |
|
2015-04-29
| ||
| 20:54 | [ecbbd51637] part of check-in [c1f07a3aa9] Improve fts5 tests. (check-in: [c1f07a3aa9] user: dan branch: fts5, size: 25025) | |
|
2015-04-27
| ||
| 16:21 | [f344ffa24d] part of check-in [e38e2bb637] Change the fts5 content= option so that it matches fts5 columns with the underlying table columns by name, not by their position within the CREATE TABLE statement. (check-in: [e38e2bb637] user: dan branch: fts5, size: 25108) | |
|
2015-04-24
| ||
| 20:18 | [43fcf838d3] part of check-in [1c78d8920f] Merge latest trunk changes with this branch. (check-in: [1c78d8920f] user: dan branch: fts5, size: 24314) | |
| 19:41 | [adf7110b0e] part of check-in [8630996134] Add the "unindexed" column option to fts5. (check-in: [8630996134] user: dan branch: fts5, size: 24085) | |
|
2015-03-04
| ||
| 08:29 | [0847facc89] part of check-in [a5d5468c05] Fix a couple of build problems. (check-in: [a5d5468c05] user: dan branch: fts5, size: 21952) | |
|
2015-01-23
| ||
| 06:50 | [e3421a76c2] part of check-in [939b7a5de2] Remove some redundant code from fts5. (check-in: [939b7a5de2] user: dan branch: fts5, size: 21892) | |
|
2015-01-06
| ||
| 19:08 | [33534ca251] part of check-in [65f0262fb8] Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. (check-in: [65f0262fb8] user: dan branch: fts5, size: 21412) | |
| 14:38 | [ecd2f2efca] part of check-in [ce6a899baf] Further fixes and test cases related to external content tables. (check-in: [ce6a899baf] user: dan branch: fts5, size: 21412) | |
|
2015-01-05
| ||
| 20:41 | [630f92bb0a] part of check-in [047aaf830d] Tests and fixes for fts5 external content tables. (check-in: [047aaf830d] user: dan branch: fts5, size: 21394) | |
|
2015-01-03
| ||
| 20:44 | [16d647c7bf] part of check-in [17ef5b59f7] Add support for external content tables to fts5. (check-in: [17ef5b59f7] user: dan branch: fts5, size: 21134) | |
|
2015-01-02
| ||
| 14:55 | [74a860e10c] part of check-in [1cd15a1759] Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause. (check-in: [1cd15a1759] user: dan branch: fts5, size: 19318) | |
|
2014-12-29
| ||
| 11:24 | [73774e37a9] part of check-in [b33fe0dd89] Fixes to built-in tokenizers. (check-in: [b33fe0dd89] user: dan branch: fts5, size: 19311) | |
|
2014-12-18
| ||
| 18:25 | [5caeb4e776] part of check-in [e358c3de5c] Fix various problems in fts5 revealed by fault-injection tests. (check-in: [e358c3de5c] user: dan branch: fts5, size: 16622) | |
|
2014-12-03
| ||
| 17:27 | [17986112dc] part of check-in [2037dba62f] Begin testing fts5 OOM and IO error handling. (check-in: [2037dba62f] user: dan branch: fts5, size: 16522) | |
|
2014-12-02
| ||
| 20:18 | [664fdc8519] part of check-in [b5f5971283] Add a configuration option to remap the "rank" column to an auxiliary fts5 function. (check-in: [b5f5971283] user: dan branch: fts5, size: 16417) | |
|
2014-12-01
| ||
| 20:05 | [bb87c2b915] part of check-in [9c1697a2aa] Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5. (check-in: [9c1697a2aa] user: dan branch: fts5, size: 16353) | |
|
2014-11-28
| ||
| 20:01 | [c95d89bd3e] part of check-in [bb4a37b53d] Add a cookie mechanism to ensure that the %_config table is re-read as required. (check-in: [bb4a37b53d] user: dan branch: fts5, size: 11644) | |
|
2014-11-27
| ||
| 20:03 | [aae1470ca0] part of check-in [83491c5666] Add a %_config table to fts5. (check-in: [83491c5666] user: dan branch: fts5, size: 11005) | |
|
2014-11-15
| ||
| 20:07 | [a292fe7386] part of check-in [fba0b5fc7e] Fix the customization interfaces so that they match the documentation. (check-in: [fba0b5fc7e] user: dan branch: fts5, size: 9481) | |
|
2014-07-30
| ||
| 19:41 | [f4ebf143e1] part of check-in [4cc048c365] Add hidden column "rank". Currently this always returns the same value as the bm25() function. (check-in: [4cc048c365] user: dan branch: fts5, size: 10534) | |
|
2014-07-28
| ||
| 20:14 | [2138741013] part of check-in [770b9540c1] Add the "loadfts" program, for performance testing the loading of data into fts3/fts4/fts5 tables. (check-in: [770b9540c1] user: dan branch: fts5, size: 10074) | |
|
2014-06-23
| ||
| 11:33 | Added: [94f1b4cb4d] part of check-in [1e0648dcf2] Add some code for an experimental fts5 module. Does not work yet. (check-in: [1e0648dcf2] user: dan branch: fts5, size: 10062) | |