/ Timeline
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

100 descendants of [47a9f3cc]

2015-03-21
15:37
When scanning the full-text index as part of the fts5 integrity-check, also run a point query for every term and verify that these results are consistent with those found by the linear scan. check-in: ce972f6a user: dan tags: fts5
2015-03-11
14:51
Add an optimization to the fts5 unicode tokenizer code. check-in: f5db4892 user: dan tags: fts5
2015-03-10
19:24
Avoid redundant string comparisons while merging fts5 segment b-trees. check-in: 5c46820d user: dan tags: fts5
2015-03-07
15:46
Fix some compiler warnings caused by signed/unsigned pointer conversions. check-in: cccee7b5 user: dan tags: fts5
11:50
Fix the bm25() function so that it multiplies scores by -1 before returning them. This means better matches have a lower numerical score, so "ORDER BY rank" (not "ORDER BY rank DESC") does what you want. check-in: 3ee7b5a9 user: dan tags: fts5
2015-03-04
08:29
Fix a couple of build problems. check-in: a5d5468c user: dan tags: fts5
2015-02-27
09:41
Further minor optimizations to flushing fts5 data to disk. check-in: a07dcca9 user: dan tags: fts5
07:23
Fix suffix and prefix compression of terms in top-level fts5 segments. And a crash that could follow an OOM condition. check-in: bb104b36 user: dan tags: fts5
2015-02-26
20:49
Optimize copying data from fts5 in-memory hash tables to top level segments. check-in: 8e3ca632 user: dan tags: fts5
14:54
Fix an fts5 bug in large incremental merges. check-in: 208e3cb6 user: dan tags: fts5
2015-02-25
19:24
Instead of the 4-byte fields, use regular varints for the poslist-size field in fts5_hash.c. check-in: 7eb022d7 user: dan tags: fts5
2015-02-02
11:58
Ensure generated header file fts5parse.h is included in sqlite3.c. check-in: bc7be2fc user: dan tags: fts5
11:32
Fix some problems with building fts5 and fts3 together using the amalgamation. check-in: fb10bbb9 user: dan tags: fts5
09:40
Merge latest trunk changes with this branch. check-in: 76212f2c user: dan tags: fts5
2015-01-31
15:23
Minor optimizations to fts5 writes. check-in: 1fffe51f user: dan tags: fts5
2015-01-29
20:59
Fix some problems with transactions that both read and write an fts5 table. check-in: 0e225b15 user: dan tags: fts5
2015-01-27
20:41
Fix a problem with fts5 doclist-indexes that occured if the first rowid of the first non-term page of a doclist is zero. check-in: f704bc05 user: dan tags: fts5
2015-01-24
19:57
Have fts5 store rowids in ascending order. Query speed is virtually the same regardless of rowid order, and ascending order makes some insert optimizations easier. check-in: 5206ca60 user: dan tags: fts5
2015-01-23
17:43
Fix compression of keys stored on internal segment b-tree nodes by fts5. check-in: 51444f67 user: dan tags: fts5
06:50
Remove some redundant code from fts5. check-in: 939b7a5d user: dan tags: fts5
2015-01-22
19:13
Add further tests and fixes for fts5. check-in: 5b295897 user: dan tags: fts5
2015-01-21
20:30
Further tests and fixes for fts5. check-in: c020a291 user: dan tags: fts5
18:23
Fix an fts5 issue with loading doclist-indexes for a term that is the last thing on its leaf page. check-in: e0d61442 user: dan tags: fts5
17:20
Merge trunk changes with this branch. check-in: f8699a1a user: dan tags: fts5
16:10
Add further tests for fts5 backend. check-in: 09dabb3b user: dan tags: fts5
06:36
Merge latest trunk changes with this branch. check-in: b3348b1e user: dan tags: fts5
2015-01-20
20:34
Add extra fault injection tests to fts5. check-in: f45a0dc0 user: dan tags: fts5
2015-01-19
11:15
Handle the case where a tokenizer determines that there are zero tokens in an fts5 query term. check-in: 75f3d17f user: dan tags: fts5
2015-01-17
20:01
Ensure an up to date copy of the fts5 configuration has been loaded into memory before attempting to modify the same configuration. check-in: f30afd20 user: dan tags: fts5
17:48
Improve the performance of the fts5 porter tokenizer implementation. check-in: 96ea6004 user: dan tags: fts5
2015-01-13
17:25
Fix prefix indexes so that they work in characters, not bytes. check-in: af8d43a4 user: dan tags: fts5
2015-01-12
17:58
Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the default tokenizer. Change the name of the simple tokenizer to "ascii". check-in: f22dbcca user: dan tags: fts5
2015-01-10
20:34
Fix some documentation issues in fts5. check-in: 512e1bdb user: dan tags: fts5
2015-01-07
19:33
Add the fts5 'optimize' command. check-in: e749be56 user: dan tags: fts5
17:11
Add the 'rebuild' and 'delete-all' commands. check-in: 0cb2fed5 user: dan tags: fts5
2015-01-06
19:08
Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. check-in: 65f0262f user: dan tags: fts5
14:38
Further fixes and test cases related to external content tables. check-in: ce6a899b user: dan tags: fts5
2015-01-05
20:41
Tests and fixes for fts5 external content tables. check-in: 047aaf83 user: dan tags: fts5
2015-01-03
20:44
Add support for external content tables to fts5. check-in: 17ef5b59 user: dan tags: fts5
2015-01-02
14:55
Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause. check-in: 1cd15a17 user: dan tags: fts5
2015-01-01
18:03
Merge latest trunk changes with this branch. check-in: 4b365167 user: dan tags: fts5
16:46
Add a version of the unicode61 tokenizer to fts5. check-in: d09f7800 user: dan tags: fts5
2014-12-29
15:59
Move all fts5 test files to new directory "ext/fts5/test". check-in: 7f148edb user: dan tags: fts5
11:24
Fixes to built-in tokenizers. check-in: b33fe0dd user: dan tags: fts5
2014-12-23
19:18
Fix the fts5 bm25() function so that it matches the documentation. check-in: 1ac7a8d0 user: dan tags: fts5
2014-12-22
21:01
Fixes and simplifications for the snippet() and highlight() functions. check-in: ca5d4404 user: dan tags: fts5
2014-12-19
20:53
Remove the fts5_test() aux function. Test aux functions using the tcl interface instead. check-in: 67e3ffd9 user: dan tags: fts5
2014-12-18
20:01
Fix a problem with prefix queries and the AND operator. check-in: 38b3c65e user: dan tags: fts5
18:25
Fix various problems in fts5 revealed by fault-injection tests. check-in: e358c3de user: dan tags: fts5
2014-12-03
17:27
Begin testing fts5 OOM and IO error handling. check-in: 2037dba6 user: dan tags: fts5
2014-12-02
20:18
Add a configuration option to remap the "rank" column to an auxiliary fts5 function. check-in: b5f59712 user: dan tags: fts5
2014-12-01
20:05
Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5. check-in: 9c1697a2 user: dan tags: fts5
2014-11-28
20:01
Add a cookie mechanism to ensure that the %_config table is re-read as required. check-in: bb4a37b5 user: dan tags: fts5
2014-11-27
20:03
Add a %_config table to fts5. check-in: 83491c56 user: dan tags: fts5
2014-11-24
16:24
Add the auxiliary highlight() function to fts5. check-in: 05909237 user: dan tags: fts5
2014-11-15
20:07
Fix the customization interfaces so that they match the documentation. check-in: fba0b5fc user: dan tags: fts5
2014-08-25
19:58
Add documentation for tokenizer api to fts5.h. Also add a script to extract extension API docs and format them as html. check-in: e240d467 user: dan tags: fts5
2014-08-18
19:30
Add an "automerge=0" mode that disables auto-merging and falls back to fts4-style crisis merges. check-in: 2397404e user: dan tags: fts5
2014-08-12
16:07
Cache the value of the "totals" record in memory during transactions. check-in: 05dfdad4 user: dan tags: fts5
08:36
Automatically resize the hash table used by fts5. check-in: f1cb48f4 user: dan tags: fts5
2014-08-11
20:26
Simplify the way position lists are copied when merging data. check-in: 9f8d678a user: dan tags: fts5
19:44
Replace the hash table borrowed from fts3. check-in: 617e2fac user: dan tags: fts5
2014-08-09
18:22
Fix an uninitialized variable causing a problem during fts5 table initialization. check-in: a14fa876 user: dan tags: fts5
18:02
Use multiple memory allocations for a single Fts5Structure object. This is probably less efficient but much easier to get right. check-in: 2821825f user: dan tags: fts5
2014-08-07
18:47
Add "segment promotion" to fts5. This prevents the FTS index from growing indefinitely as data is added and deleted. check-in: ba359d78 user: dan tags: fts5
2014-08-06
20:04
Avoid writing delete markers to the oldest segment in an FTS index. check-in: 1baeb1ce user: dan tags: fts5
16:30
Add support for savepoints to fts5. check-in: 3b19eba0 user: dan tags: fts5
2014-08-05
19:35
Use doclist indexes for AND queries as well as phrases. check-in: 5d38e6ed user: dan tags: fts5
19:00
Use doclist-indexes with "ORDER BY rowid ASC" fts5 queries as well. check-in: d028ba65 user: dan tags: fts5
2014-08-04
20:07
Fix fts5_index.c to use doclist-indexes when possible. Only some cases work so far. check-in: 90b82d3e user: dan tags: fts5
2014-08-02
20:49
Start changing things to use doclist indexes as required. code is not activated yet. check-in: b8864da9 user: dan tags: fts5
2014-08-01
20:13
Add a special case to the integrity-check code to check that the final integer in a doclist index is as expected. check-in: c9893415 user: dan tags: fts5
19:27
Have the fts5 integrity-check verify that doclist indexes match the contents of the leaf pages that they index. check-in: 37a7d303 user: dan tags: fts5
11:16
Add "doclist index" records to the database. These are to make navigating within very large doclists faster. They are not yet used by queries. check-in: 89377421 user: dan tags: fts5
2014-07-31
17:53
Add a comment explaining why fts5 cannot cache "sorter statements". check-in: e6af3b7a user: dan tags: fts5
17:47
Try to reuse sorter statements in fts5. Does not work due to circular references on VTable object. Leaf check-in: bc14e64b user: dan tags: save_sorter_stmt
11:57
Add further tests for the extension APIs with "ORDER BY rank" queries. check-in: 37a417d2 user: dan tags: fts5
2014-07-30
20:26
Fix things so that the fts5 extension API works with "ORDER BY rank" queries. check-in: f1b4e1a9 user: dan tags: fts5
19:41
Add hidden column "rank". Currently this always returns the same value as the bm25() function. check-in: 4cc048c3 user: dan tags: fts5
2014-07-28
20:14
Add the "loadfts" program, for performance testing the loading of data into fts3/fts4/fts5 tables. check-in: 770b9540 user: dan tags: fts5
2014-07-26
18:38
Add tests and fixes for bm25() function. check-in: 71d32f53 user: dan tags: fts5
2014-07-25
20:30
Add extension apis xRowCount, xQueryPhrase, xSetAuxdata and xGetAuxdata. And a ranking function that uses all of the above. check-in: c4d50428 user: dan tags: fts5
2014-07-23
19:31
Add a snippet() function to fts5. check-in: bdc58fd2 user: dan tags: fts5
2014-07-21
15:45
Fix DELETE and UPDATE operations on fts5 tables. check-in: d44d3a85 user: dan tags: fts5
14:22
Add the xTokenize extension API. check-in: 8c6b0aff user: dan tags: fts5
11:44
Fix the xColumnSize() extension API. check-in: 19504c41 user: dan tags: fts5
2014-07-19
20:27
Add simple tests for the xColumnText() extension api. check-in: 1e9053ab user: dan tags: fts5
15:35
Fixes for the xColumnSize() fts5 extension API. check-in: 43fcb844 user: dan tags: fts5
2014-07-18
19:59
Fix issues with position lists and NEAR constraints. check-in: 16352d36 user: dan tags: fts5
2014-07-17
15:14
Fix a problem with position list processing for OR queries. check-in: 5808f30f user: dan tags: fts5
2014-07-16
20:07
Fixes for tcl list generation in fts5_test(). check-in: c1f9a4b7 user: dan tags: fts5
19:15
Begin adding interface for auxiliary functions. check-in: 1e2a7ba0 user: dan tags: fts5
2014-07-10
20:21
Support "ORDER BY rowid ASC". check-in: b96b5e16 user: dan tags: fts5
2014-07-08
16:27
Add support for prefix queries to fts5. check-in: 75ebd3cd user: dan tags: fts5
2014-07-05
15:15
Add support for AND, OR and NOT to fts5. check-in: 8682b87e user: dan tags: fts5
07:54
Add support for the "colname : <nearset>" syntax to fts5. check-in: 00466710 user: dan tags: fts5
2014-07-03
20:39
Add support for NEAR expressions to fts5. check-in: 250ae8d4 user: dan tags: fts5
2014-07-02
20:18
Add support for phrase queries to fts5. check-in: 2e5652e6 user: dan tags: fts5
2014-07-01
20:45
Change the position list format so that its size in bytes is stored at the start of the list itself. check-in: 62f2ff20 user: dan tags: fts5
2014-06-26
12:31
Fix minor problems in term matching. check-in: 94eeb077 user: dan tags: fts5
2014-06-25
20:28
Begin adding query support to fts5. check-in: 47a9f3cc user: dan tags: fts5