Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
128 events for the month beginning 2022-11-01 by user drh
Following month ↑|
2022-11-30
| ||
| 21:18 | Add a testcase() macro to verify that the case of a NOT NULL error message hitting the string length limit. (check-in: 91f50964 user: drh tags: trunk) | |
| 20:22 | Fix an over-zealous assert() reported by Yong Heng. (check-in: 6ee61f8c user: drh tags: trunk) | |
| 19:11 | Attempt to rationalize the bits associated with ".wheretrace". Provide a decoder key in sqliteInt.h for what each bit is intended to do. (check-in: 8ec36169 user: drh tags: trunk) | |
| 13:55 | • Edit [6620c57b9d3eae72|6620c57b]: Edit check-in comment. (artifact: 50838a29 user: drh) | |
| 13:44 | Always use nanosleep() (instead of usleep() or sleep) if the _POSIX_C_SOURCE macro says it should be available. See Fossil Forum post ab2e2593ae307946 for driver behind this enhancement. (check-in: 6620c57b user: drh tags: trunk) | |
|
2022-11-29
| ||
| 17:52 | Change the handling of hwtime.h to make it easier to compile performance measurement builds that make use of hwtime.h. This should not affect productions builds. (check-in: f64a2242 user: drh tags: trunk) | |
|
2022-11-28
| ||
| 21:17 | Check-in [8d5b76593d82b3a5] contained an error that was causing some obscure error codes to be lost. Fixed here. (check-in: 46cdd363 user: drh tags: trunk) | |
| 20:08 | Fix harmless compiler warnings. (check-in: 8d5b7659 user: drh tags: trunk) | |
| 19:43 | • Fixed ticket [695a1a53]: Better choice of indexes with covering indexes on expressions plus 3 other changes (artifact: 82a25833 user: drh) | |
| 19:42 | Implementation of enhancement request [695a1a53dea6b240]: The query planner has improved awareness of when indexes on expressions are covering and adjusts their costs accordingly. (check-in: e3474d79 user: drh tags: trunk) | |
| 18:17 | Test cases added derived from the enhancment ticket. (Leaf check-in: c022c015 user: drh tags: covering-indexed-expr) | |
| 16:11 | Merge trunk changes into covering-index-expr branch. (check-in: 89d775ad user: drh tags: covering-indexed-expr) | |
| 15:23 | Rework the covering index checking routine, whereIsCoveringIndex(), so that it can return a "maybe" result for aggregate queries where we are not exactly sure. The index is scored as if it is covering, but the main table is still opened. (check-in: b8eec421 user: drh tags: covering-indexed-expr) | |
|
2022-11-26
| ||
| 20:52 | Better reporting of when the WHERE clause analysis thinks that an index is covering. (check-in: 17ebcf31 user: drh tags: covering-indexed-expr) | |
| 20:48 | Show which AggInfo.aCol an Expr node represents in the tree trace debugging logic. Does not affect production builds. (check-in: b8076f4d user: drh tags: trunk) | |
| 20:13 | Merge trunk fixes into the covering-indexed-expr branch. (check-in: 9ac67ff9 user: drh tags: covering-indexed-expr) | |
| 20:12 | Fix an incorrect assertion-fault in the "TREETRACE" debugging logic on select.c. The problem does not affect production builds. (check-in: f11bb422 user: drh tags: trunk) | |
| 14:19 | Experimental changes to help the query planner detect when an expression index is coverting. Works somewhat, but there are tests that fail. (check-in: 968c189b user: drh tags: covering-indexed-expr) | |
|
2022-11-25
| ||
| 18:45 | • Ticket [695a1a53] Better choice of indexes with covering indexes on expressions status still Open with 3 other changes (artifact: d5202fa0 user: drh) ... 1 similar event omitted. | |
| 17:05 | Relax restriction (8) on the push-down optimization so that it only applies if one or more columns uses a collating sequence other than BINARY. See forum post 3824ced748baa808 and check-in [346a3b12b861ce7b]. (check-in: adbca344 user: drh tags: trunk) | |
| 16:32 | Fix #ifdefs so that restrictions (8) and (9) of the push-down optimization are still enforced even if compiled with SQLITE_OMIT_WINDOWFUNC. This fixes a bug introduced by check-in [346a3b12b861ce7b]. (check-in: 09e1e42e user: drh tags: trunk) | |
| 16:12 | • Fixed ticket [99378177]: Use indexed expressions in an aggregate query plus 6 other changes (artifact: fb3dc805 user: drh) | |
| 16:10 | Improve the query planner such that it is able to make use of indexed expressions within an aggregate query with GROUP BY. This implements enhancement request [99378177930f87bd]. (check-in: b9190d3d user: drh tags: trunk) | |
| 15:52 | Add restriction (9) to the push-down optimization: If the subquery is a compound then all arms of the compound must have the same affinity. dbsqlfuzz 3a548de406a50e896c1bf7142692d35d339d697f. (check-in: 1ad41840 user: drh tags: trunk) | |
| 13:26 | Remove a redundant assert() statement. (Closed-Leaf check-in: e3e1b453 user: drh tags: agg-with-indexed-expr) | |
| 13:15 | Improve the robustness of the updateAccumulator() routine against OOM. (check-in: d2844f57 user: drh tags: agg-with-indexed-expr) | |
| 13:08 | Improved comments. Add assert()s to verify that the AggInfo structure is unchanged after registers have been assigned. (check-in: 5200b841 user: drh tags: agg-with-indexed-expr) | |
|
2022-11-24
| ||
| 23:35 | Correctly deal with IF-NULL-ROW operators when dealing with indexed expressions in aggregates. (check-in: 939cb470 user: drh tags: agg-with-indexed-expr) | |
| 19:02 | Take care not to try to add comments to a TK_AGG_COLUMN opcode that does not have an associated Table object because it is a reference to an indexed expression. (check-in: 5fc23863 user: drh tags: agg-with-indexed-expr) | |
| 18:45 | Change a NEVER() into an assert(). (check-in: a0fd44f4 user: drh tags: agg-with-indexed-expr) | |
| 18:36 | • Edit [ed14863dd72e35fa|ed14863d]: Edit check-in comment. (artifact: 364cc633 user: drh) | |
| 18:22 | • Edit [346a3b12b861ce7b|346a3b12]: Edit check-in comment. (artifact: f426a484 user: drh) | |
| 15:04 | Add NEVER() and ALWAYS() macros on branches that are believed to be unreachable. (check-in: 3a901e88 user: drh tags: agg-with-indexed-expr) | |
| 13:19 | New test cases. Fix the logic so that it works for GROUP BY aggregates that do not require sorting. (check-in: ef6ebe79 user: drh tags: agg-with-indexed-expr) | |
| 01:41 | Merge the latest trunk changes into the agg-with-indexed-expr branch to simplify diffs. (check-in: 38c3d3f1 user: drh tags: agg-with-indexed-expr) | |
| 01:40 | Add explanatory comment to the new optimization. And add a test case. (check-in: e6c20f61 user: drh tags: agg-with-indexed-expr) | |
|
2022-11-23
| ||
| 18:51 | Aggregates with GROUP BY now make use of expressions on indexes. This code works and gets the correct answer for the test case in the ticket. Lots more testing and documentation is needed, however. (check-in: 8dcf9f20 user: drh tags: agg-with-indexed-expr) | |
| 17:56 | This attempt at modifying AggInfo to make use of indexed expressions does not work. It gets an incorrect answer for the test case shown in the ticket. (check-in: 84c06023 user: drh tags: agg-with-indexed-expr) | |
| 14:13 | Further foundation prep work prior to starting to flesh-out the optimizeAggregateUseOfIndexedExpr() routine. (check-in: 23145fe9 user: drh tags: agg-with-indexed-expr) | |
|
2022-11-22
| ||
| 20:58 | Merge enhancements and fixes from trunk. (check-in: f8932e04 user: drh tags: agg-with-indexed-expr) | |
| 20:37 | Add the stub function: optimizeAggregateUsingIndexedExpr(). The hope is that we can fill this in with a routine that does useful optimizations. (check-in: d85bb724 user: drh tags: agg-with-indexed-expr) | |
| 19:56 | Include the treetrace bitmap comment accidentally omitted from the previous check-in. (check-in: db07471c user: drh tags: trunk) | |
| 19:51 | Merge trunk fixes and enhancements into the agg-with-indexed-expr branch. (check-in: 07063478 user: drh tags: agg-with-indexed-expr) | |
| 19:49 | Rename the SELECTTRACE macro to TREETRACE, so that is corresponds to the new CLI command. Renumber all of the bits in the bitmask used to enable various kinds of tracing, and add a trace bitmap decoder in sqliteInt.h. Changes to debugging logic only. No (intentional) changes to production code. (check-in: 8036445a user: drh tags: trunk) | |
| 18:24 | Fix the error message in the CLI for "no such VFS". Forum post 1217fdd6b3. (check-in: b344f33d user: drh tags: branch-3.40) | |
| 18:24 | Fix the error message in the CLI for "no such VFS". Forum post 1217fdd6b3. (check-in: 861af465 user: drh tags: trunk) | |
| 15:48 | Bump the version number to 3.40.1. (check-in: d0ca348b user: drh tags: branch-3.40) | |
| 15:47 | Fix last function pointer in sqlite3Apis init. Reported at forum post eba0faa96d. (check-in: b3795d28 user: drh tags: branch-3.40) | |
| 15:43 | Since the memory registers used by the columns and functions of an AggInfo object are sequential, it is not neecessary to remember each register separately. We can simply remember the first one and do the math when others are needed. (check-in: dc5bd349 user: drh tags: agg-with-indexed-expr) | |
| 14:31 | Omit the unnecessary AggInfo.mnReg field. (check-in: d79c58ef user: drh tags: agg-with-indexed-expr) | |
| 14:10 | Factor out the allocation of registers for aggregates into a separate subroutine. (check-in: 4475799d user: drh tags: agg-with-indexed-expr) | |
| 13:33 | This is the first in what is anticipated to be a long sequence of incremental changes aimed at improving aggregate query processing, and in particular helping aggregate queries take better advantage of indexes on expression. The end goal is to resolve ticket [99378177930f87bd], though it remains to be seen whether or not I can get there with this approach. (check-in: cba837ea user: drh tags: agg-with-indexed-expr) | |
| 12:47 | Convert an ALWAYS() in sqlite3DbSpanDup() into an assert(), for a performance increase and size reduction. (check-in: 21e80a29 user: drh tags: trunk) | |
|
2022-11-21
| ||
| 17:40 | Split out the debugging code that dumps an AggInfo object into a separate subroutine called printAggInfo() so that it can be invoked interactively during debugging. No changes to production code. (check-in: dc33cfbe user: drh tags: trunk) | |
| 16:40 | Change the name of the Parse.pIdxExpr field to pIdxEpr so that the name is distinct from all other identifiers in the code and thus less confusing. (check-in: a2962d01 user: drh tags: trunk) | |
| 15:55 | Performance optimization and size reduction in insertCell() by omitting the "pRC" argument and instead returning the result code as an integer. (check-in: bee94d1b user: drh tags: trunk) | |
| 14:13 | Performance optimization to sqlite3BtreeInsert(). (check-in: b8976ebf user: drh tags: trunk) | |
| 13:35 | Small performance improvement in sqlite3BtreeTransferRow(). (check-in: dab959ea user: drh tags: trunk) | |
|
2022-11-19
| ||
| 20:10 | New assert()s confirm that BTREE_PREFORMAT must be the same value as OPFLAG_PREFORMAT. (check-in: f40bf2c6 user: drh tags: trunk) | |
| 19:37 | Performance optimization in sqlite3BtreeInsert(). (check-in: 9776fa31 user: drh tags: trunk) | |
| 18:43 | Performance improvement and size reduction in balance_nonroot(). (check-in: 715bc81e user: drh tags: trunk) | |
| 18:17 | Small performance improvement and size reduction in btree. (check-in: daa07149 user: drh tags: trunk) | |
| 14:18 | Improved comments on the pageFreeArray() routine of btree.c. No changes to code. (check-in: 0c2adc6d user: drh tags: trunk) | |
| 13:09 | Streamline the decodeFlags() routine in btree.c for a small performance increase. (check-in: 4cb28521 user: drh tags: trunk) | |
| 00:22 | Small performance optimization in btree.c. (check-in: f710cce1 user: drh tags: trunk) | |
| 00:08 | • Fixed ticket [53043c97]: deserialized DB has a sqlite3_db_filename() contrary to docs plus 3 other changes (artifact: 91d1a5cf user: drh) | |
| 00:08 | Databases created using sqlite3_deserialize() should report their filename as an empty string, not as "x". Fix for ticket [53043c9793715f08]. (check-in: ff494449 user: drh tags: trunk) | |
|
2022-11-18
| ||
| 21:23 | • Ticket [53043c97] deserialized DB has a sqlite3_db_filename() contrary to docs status still Open with 6 other changes (artifact: f1738a9d user: drh) | |
| 17:57 | Update the version number to 3.41.0 to begin the next development cycle. (check-in: 5c669f5f user: drh tags: trunk) | |
| 17:50 | Add the SQLITE_DBCONFIG_LENIENT_JSON configuration option. Modify the built-in JSON routines such that when this setting is active, arguments that that ought to be JSON but still give a reasonable result (ex: NULL) rather than raising an error. (Leaf check-in: 186db57d user: drh tags: lenient-json) | |
|
2022-11-17
| ||
| 19:24 | Fix corner cases in UTF8 handling in the REGEXP extension. Forum post 3ffe058b04. (check-in: abb18f61 user: drh tags: trunk) | |
| 14:40 | Use the log10() and log2() functions from the standard C library to implement the equivalent SQL functions, in the hope that this will prevent reported precision problems. See forum post cfceb1230bdcfd84 and the surrounding thread. (check-in: 7c572d02 user: drh tags: trunk) | |
| 13:58 | Split out the documentation for sqlite3_value_encoding() into its own page and make it clear that this interface is intended for testing and debugging only. Forum thread c9f445453da950ad. Comment changes only - no changes to code. (check-in: 9048a766 user: drh tags: trunk) | |
| 01:24 | Raise an error if an attempt is made to compile the CLI with the SQLITE_OMIT_COMPLETE option, since sqlite3_complete() really is necessary for the CLI to operate sanely. (check-in: a119a9e2 user: drh tags: trunk) | |
|
2022-11-16
| ||
| 19:57 | Fix harmless typo in comment, reported by Debian in Fossil https://fossil-scm.org/forum/forumpost/15f7327318. (check-in: 5689f0d9 user: drh tags: trunk) | |
| 19:53 | Avoid returning SQLITE_SCHEMA if the first query run on a connection is "SELECT nosuchcolumn" or similar. Forum post c1798f77ef (check-in: 3dc4f75d user: drh tags: trunk) | |
| 16:14 | Merge version 3.40.0 into the reuse-schema branch. (check-in: 2aec00a7 user: drh tags: reuse-schema) | |
| 16:11 | Merge the 3.40.0 release into the begin-concurrent-pnu-wal2 branch. (check-in: a090de41 user: drh tags: begin-concurrent-pnu-wal2) | |
| 16:05 | Merge the 3.40.0 release changes into the begin-concurrent-report branch. (check-in: 9fc62410 user: drh tags: begin-concurrent-report) | |
| 16:00 | Merge the 3.40.0 release into the wal2 branch. (check-in: 2df915ef user: drh tags: wal2) | |
| 15:59 | Merge 3.40.0 into the begin-concurrent branch. (check-in: a06d57ee user: drh tags: begin-concurrent) | |
| 12:10 | Version 3.40.0 (check-in: 89c459e7 user: drh tags: trunk, release, major-release, version-3.40.0) | |
|
2022-11-14
| ||
| 19:42 | Previous change to the fake_big_file command in the test harness was not correct. This one should fix the problem. (check-in: 6ee57a2e user: drh tags: trunk) | |
| 18:57 | Change the fake_big_file test command so that it fails for files larger than 2MB on Windows, as we have observed that Window10 will sometimes bluescreen when operating on very large sparse files. (check-in: d39ffd2a user: drh tags: trunk) | |
| 13:41 | Merge the 3.40.0 rc1 changes into the reuse-schema branch. (check-in: 886788b6 user: drh tags: reuse-schema) | |
| 13:18 | Merge the 3.40.0 rc1 changes into the begin-concurrent-pnu-wal2 branch. (check-in: b0e2b9aa user: drh tags: begin-concurrent-pnu-wal2) | |
| 13:10 | Merge the 3.40.0 rc1 changes into the wal2 branch. (check-in: a5a610a6 user: drh tags: wal2) | |
| 12:54 | Merge the 3.40.0 rc1 changes into the begin-concurrent-report branch. (check-in: 4d3f2531 user: drh tags: begin-concurrent-report) | |
| 12:44 | Merge 3.40.0 rc1 into the begin-concurrent branch. (check-in: 5ba588e7 user: drh tags: begin-concurrent) | |
|
2022-11-12
| ||
| 17:17 | Disable the ability to change the schema_version cookie when SQLITE_DBCONFIG_DEFENSIVE mode is enabled. This is a security enhancement inspired by the question in forum post 2b9cc3dae1f1e5f6. (check-in: 1d81381e user: drh tags: trunk) | |
|
2022-11-11
| ||
| 13:51 | • Closed ticket [ee4b2b48]: Prepared statement cache plus 5 other changes (artifact: c40bea50 user: drh) | |
| 13:17 | • Fixed ticket [6c266900]: shell: The column mode (and width option) does not manage correctly UTF-8 plus 4 other changes (artifact: 6fcbd024 user: drh) | |
| 13:00 | • Edit [d31c019fd6849e4c|d31c019f]: Edit check-in comment. (artifact: a4f61caf user: drh) | |
|
2022-11-10
| ||
| 23:10 | Remove unnecessary tabs in the ChaCha20 implementation. Forum post 0cdce5db8c. (check-in: b7179efb user: drh tags: trunk) | |
|
2022-11-09
| ||
| 11:02 | Additional defense against corrupt database files in dbdata.c. (check-in: 2e70d1e5 user: drh tags: trunk) | |
| 10:17 | Increase the precision of the nData parameter to the dbdataValue() routine inside the sqlite_dbdata virtual table, to avoid the possibility of integer overflow. (check-in: 295447b4 user: drh tags: trunk) | |
|
2022-11-07
| ||
| 19:40 | Further improvements to the handling of the u32 and u16 typedefs in the shell.c source file. (check-in: 55a19677 user: drh tags: trunk) | |
| 18:36 | Improve the ability of mkshellc.tcl to remove redundant typedefs from the generated shell.c code. This is needed to get shell.c to build on older C compilers. (check-in: 3645585f user: drh tags: trunk) | |
| 15:23 | Fix an obsolete comment. (check-in: e377c0a1 user: drh tags: trunk) | |
| 15:01 | Fix typo in comment. (check-in: c3b94d7d user: drh tags: trunk) | |
| 12:21 | Fix requirements marks so that they match documentation corrections. (check-in: 10d6189d user: drh tags: trunk) | |
| 11:19 | Fix the documentation regarding negative length parameters for sqlite3_result_text() interfaces, to point out that the length parameter to sqlite3_result_text64() cannot be negative. Forum post cf1d043b07. Comment/documentation change only. (check-in: 80165076 user: drh tags: trunk) | |
| 11:05 | Make sure that the recoverStrlen() function (used internally by the new recovery extension) is 64-bit safe. (check-in: ea30a6bf user: drh tags: trunk) | |
|
2022-11-06
| ||
| 17:19 | The recoverAssertMutexHeld() function is for testing and verification only and should be a harmless no-op for production builds. [forum/forumpost/b4f2c7d402|Forum post b4f2c7d402]. (check-in: d7550471 user: drh tags: trunk) | |
|
2022-11-05
| ||
| 17:52 | Fix harmless compiler warnings. (check-in: fe44e7ef user: drh tags: reuse-schema) | |
| 15:31 | Merge the latest trunk enhancements into the reuse-schema branch. (check-in: 224eaf26 user: drh tags: reuse-schema) | |
|
2022-11-04
| ||
| 19:09 | Merge the latest trunk enhancements into the begin-concurrent-pnu-wal2 branch. (check-in: aa2e247b user: drh tags: begin-concurrent-pnu-wal2) | |
| 18:58 | Merge the latest trunk enhancements into the wal2 branch. (check-in: ca63a1be user: drh tags: wal2) | |
| 18:47 | Merge the latest trunk enhancements into the begin-concurrent-report branch. (check-in: d8568a84 user: drh tags: begin-concurrent-report) | |
| 18:33 | Merge the latest trunk enhancements into the begin-concurrent branch. (check-in: b361ee98 user: drh tags: begin-concurrent) | |
| 12:59 | Remove an unimportant testcase() macro that is no longer reachable due to the improvement in corruption detection. (check-in: cd7e3568 user: drh tags: trunk) | |
| 11:54 | Enhance the ability of the OP_Found and similar opcodes to detect truncated index records and report SQLITE_CORRUPT. dbsqlfuzz 2b12f90aeff8e081706c7e9b58834f04869f446c. Test cases in TH3. (check-in: 059a09da user: drh tags: trunk) | |
|
2022-11-03
| ||
| 21:08 | Experimental changes that try to identify indexes as covering when they contain expressions which do cover all data uses. This check-in does not work, because the AggInfo object might still refer to individual columns. The purpose of this check-in is to preserve the idea. I might come back to it later. (Leaf check-in: 018914a5 user: drh tags: indexed-expr-exp) | |
| 18:46 | • New ticket [73ebbb3a] View ought not be materialized. (artifact: 60c699c8 user: drh) | |
| 11:59 | • New ticket [99378177] Use indexed expressions in an aggregate query. (artifact: 9593cae7 user: drh) | |
| 11:35 | • New ticket [695a1a53] Better choice of indexes with covering indexes on expressions. (artifact: f6561b0c user: drh) | |
|
2022-11-02
| ||
| 14:08 | Clarify documentation regarding the --recovery-db option to ".recover" and the magic 789 configuration option it is associated with. (check-in: f6fa0cff user: drh tags: trunk) | |
| 13:09 | Minor improvements to API documentation in comments for the recovery extension. (check-in: ed1c3515 user: drh tags: trunk) | |
| 11:25 | Emcc seems confused by SQLITE_DEBUG, for reasons unknown. Use NDEBUG instead to simplify the #ifdef logic in sqlite3recover.c. (check-in: 2610779a user: drh tags: trunk) | |
|
2022-11-01
| ||
| 21:42 | Fix a harmless compiler warning. (check-in: 663a8916 user: drh tags: trunk) | |
| 18:56 | Fix harmless compiler warnings. (Closed-Leaf check-in: de829770 user: drh tags: sqlite3_filename) | |
| 13:12 | Fix a #ifdef involving SQLITE_OS_KV that was adding code unnecessarily. (check-in: b6c1b6e4 user: drh tags: trunk) | |
| 12:11 | • Fixed ticket [57c47526]: Incorrect answer when flattening a UNION ALL compound plus 5 other changes (artifact: a68a3eba user: drh) | |
| 12:10 | Enforce affinity on materialized tables for subqueries and views. Also, do not allow UNION ALL flattening if the affinity of a result column varies between different arms of the compound. This is a fix for ticket [57c47526c34f01e8]. (check-in: 88a05141 user: drh tags: trunk) | |
| 12:01 | Improvements to comments. Change the "optimization_control" TCL command in the test harness so that it returns the new optimization mask, for verification. (Closed-Leaf check-in: a3a50012 user: drh tags: tkt-57c47526) | |
| 01:07 | Do not flatten a UNION ALL subquery where the column affinities do not match on all arms. Force that subquery to be materialized. (check-in: 1b8a1288 user: drh tags: tkt-57c47526) | |
| 00:52 | Enforce column affinity on the materialization of a subquery or view. (check-in: b6692de3 user: drh tags: tkt-57c47526) | |