/ File History

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of ext/fts1/fts1_tokenizer1.c

Fix ticket #2439: the FTS1 and FTS2 extensions use the non-standard, unportable and highly deprecated <malloc.h> header on all platforms except Apple Mac OS X. The <malloc.h> actually is never required on any OS with an at least partly POSIX-conforming API as the malloc(3) & friends functions officially live in <stdlib.h> since over 10 years. Under some platform like FreeBSD the inclusion of <malloc.h> since a few years even causes an "#error" and this way a build failure. So, just get rid of the bad <malloc.h> usage in FTS1 and FTS2 extensions at all and stick with <stdlib.h> there only. (CVS 4191) file: [fd00d1fe] check-in: [3f9a6661] user: rse branch: trunk, size: 6176
Out-of-memory cleanup in tokenizers. Handle NULL return from malloc/calloc/realloc appropriately, and use sizeof(var) instead of sizeof(type) to make certain that we don't get a mismatch between them as the code rots. (CVS 3693) file: [df09e638] check-in: [fbc53da8] user: shess branch: trunk, size: 6233
Add a Porter stemmer option to the FTS1 module. (CVS 3452) file: [98c2bb9f] check-in: [936b06aa] user: drh branch: trunk, size: 6141
Avoid segfaults when inserted NULL values into FTS1. (CVS 3447) file: [3c969058] check-in: [165645d3] user: drh branch: trunk, size: 5018
Allow virtual tables to contain multiple full-text-indexed columns. Added a magic column "_all" which can be used for querying all columns in a table at once.    For now, each posting list stores position/offset information for multiple columns. We may implement separate posting lists for separate columns at some future point. (CVS 3408) file: [79877389] check-in: [366a70b0] user: adamd branch: trunk, size: 4938
Convert static variables into constants in the FTS module. (CVS 3385) file: [1155942b] check-in: [098cbafc] user: drh branch: trunk, size: 4931
Make tokenizer not rely on nul-terminated text. Instead of using strcspn() and a nul-terminated delimiter list, I just flagged delimiters in an array and wrote things inline. Submitting this for review separately because it's pretty standalone. (CVS 3378) file: [03a9af15] check-in: [2631ceae] user: shess branch: trunk, size: 4912
Refactor the FTS1 module so that its name is "fts1" instead of "fulltext", so that all symbols with external linkage begin with "sqlite3Fts1", and so that all filenames begin with "fts1". (CVS 3377) file: [13789776] check-in: [e1891f0d] user: drh branch: trunk, size: 5255 Added