SQLite 3.20.0 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
l.   Compare sqlite3.c and sqlite3.h against the previous release. drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code. drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok++  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok+  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 (nmake /f makefile.msc) drh ok+  *
e.   Windows (64-bit) MSVC using option /W4 (nmake /f makefile.msc) drh ok+  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh multitest.tcl (take care to update ../th3private)
0 failures on 42 th3makes and 183908644 tests in (05:57:02) 3 cores on bella • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 failures on 42 th3makes and 183916539 tests in (07:42:01) 2 cores on bella • SQLite 3.20.0 2017-07-27 18:43:13 2dfcd9a8ecdf0ddd8e044d820639830c6171141c588cf0224255af85c64cf79c • 0 failures on 42 th3makes and 183916038 tests in (06:12:44) 3 cores on bella • SQLite 3.20.0 2017-07-30 20:30:36 5c8cb1ff5da872fb5ab3f77f678b9df3b68525433f6d5d918f2911a5622bdd14 • 0 failures on 42 th3makes and 184112802 tests in (07:28:41) 2 cores on bella • SQLite 3.20.0 2017-07-31 17:40:15 be0e24a0293f31b81fc5608a1d5aa1e57d3f5f7dddef6b368ae2e207bbdaf44c
drh ok+++  *
b.   tclsh releasetest.tcl
0 failures out of 9996005 tests in (01:42:50) 3 cores on darkstar • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected
5 failures on 5 th3makes and 118 tests in (00:00:32) on bella • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected
All configurations report FAIL. • 26 failures out of 786 tests in (00:08:58) on darkstar • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
e.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc
th3: 0 errors in 1621553 tests. 4811.772 seconds on beaglebone 32-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a
dan ok  *
b.   Recompile and test Fossil.
[fossil all rebuild] works. [fossil clone] works.
dan ok  *
 
8.   Tests for platform Mac OS X: drh ok  *
 
a.   tclsh releasetest.tcl
0 failures out of 4937873 tests in (04:09:39) 2 cores on Chanphen-Kruatawongs-iMac.local • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
b.   tclsh multitest.tcl (after updating th3private)
0 failures on 37 th3makes and 148487304 tests in (09:24:53) 2 cores on macpro01 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 failures on 37 th3makes and 148497516 tests in (07:59:30) 3 cores on macpro01 • SQLite 3.20.0 2017-07-27 18:43:13 2dfcd9a8ecdf0ddd8e044d820639830c6171141c588cf0224255af85c64cf79c
drh ok+  *
c.   tclsh multitest.tcl --scenario failures - all failures detected
2 failures on 2 th3makes and 42 tests in (00:00:07) on macpro01 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected
18 failures out of 394 tests in (00:07:04) on macpro01 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc
th3: 0 errors in 885590 tests. 2807.394 seconds on crabapple.local. 32-bit big-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • th3: 0 errors in 1103194 tests. 9452.248 seconds on crabapple.local. 32-bit big-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows: drh ok  *
 
a.   tclsh multitest.tcl --msvc (after updating th3private)
0 failures on 36 th3makes and 138830148 tests in (08:46:10) 3 cores on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
b.   tclsh multitest.tcl --msvc --quick on x86
0 failures on 15 th3makes and 20951037 tests in (01:11:00) 3 cores on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • ON x64: 0 failures on 15 th3makes and 20763072 tests in (01:54:29) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-27 18:43:13 2dfcd9a8ecdf0ddd8e044d820639830c6171141c588cf0224255af85c64cf79c
drh ok+  *
c.   tclsh multitest.tcl --msvc --scenario failures - verify failures detected
2 failures on 2 th3makes and 42 tests in (00:11:52) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
d.   tclsh test/releasetest.tcl --msvc
0 failures out of 1986814 tests in (02:10:19) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 failures out of 1986770 tests in (02:10:39) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-27 18:43:13 2dfcd9a8ecdf0ddd8e044d820639830c6171141c588cf0224255af85c64cf79c • 0 failures out of 1986820 tests in (02:10:05) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-30 20:30:36 5c8cb1ff5da872fb5ab3f77f678b9df3b68525433f6d5d918f2911a5622bdd14 • 0 failures out of 1986799 tests in (02:11:16) on DESKTOP-8U9G1N8 • SQLite 3.20.0 2017-07-31 17:40:15 be0e24a0293f31b81fc5608a1d5aa1e57d3f5f7dddef6b368ae2e207bbdaf44c
drh ok+++  *
e.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
f.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 test
SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 114421 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian • SQLite 2017-07-31 20:06:21 96ff1675721c744b5c1173a99fc2ad3a2df64ca8e931738e3a87c72a6f8b1e72 • 0 errors out of 114406 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian
drh ok+  *
g.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 test
SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 115460 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian
drh ok  *
h.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
i.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
 
11.   Tests for platform OpenBSD (x86): dan ok  *
 
a.   make test
SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 141991 tests on wolfman.devio.us OpenBSD 32-bit little-endian • Also • SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 141709 tests on obsd.my.domain OpenBSD 32-bit little-endian
dan ok+  *
b.   th3make quick.rc
th3: 0 errors in 1746226 tests. 720.718 seconds on obsd.my.domain 32-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
 
12.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 737 seconds
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 2004 seconds
drh ok  *
 
13.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Verify the correct version numbers have been installed. drh ok  *
 
14.   Fossil updated to use the latest SQLite. drh ok+  *
 
a.   No SQLite compiler warnings. drh ok+  *
b.   Used on active websites with no issues. drh ok+  *
c.   fossil all dbstat --db-check drh ok  *
 
15.   Rebuild and use Firefox with the latest SQLite drh ok  *
 
a.   Routine use with no problems drh ok  *
b.   ./mach mochitest dom/indexedDB drh ok  *
c.   ./mach xpcshell-test dom/indexedDB drh ok  *
d.   ./mach web-platform-tests IndexedDB drh ok  *
 
16.   CEROD tests in the "test/" subdirectory. drh ok  *
 
17.   SEE tests using TH3: drh ok  *
 
a.   see.c
th3: 0 errors in 8206243 tests. 4616.974 seconds on bella 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
b.   see-aes128-ofb.c
th3: 0 errors in 6433213 tests. 2766.653 seconds on macpro01 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
c.   see-aes256-ofb.c
th3: 0 errors in 1703529 tests. 226.680 seconds on bella 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • F
drh ok  *
d.   see-rc4.c
th3: 0 errors in 1707357 tests. 1345.545 seconds on win7dev 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
e.   see-aes128-ccm.c
th3: 0 errors in 1703766 tests. 253.431 seconds on bella 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
f.   see-cccrypt.c
th3: 0 errors in 1687321 tests. 254.223 seconds on macpro01 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
g.   At least one of the above using "test.rc". drh ok  *
h.   At least one of the above using "memdebug.rc". drh ok  *
i.   At least one of the above on Linux. drh ok  *
j.   At least one of the above on Mac OS X. drh ok  *
k.   At least one of the above on Windows. drh ok  *
 
18.   SEE using configure; make test drh ok  *
 
a.   Linux drh ok  *
b.   Mac
SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 141069 tests on macpro01 Darwin 64-bit little-endian
drh ok  *
 
19.   ZIPVFS tests: dan ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt for details)
SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 85603 tests on darkstar Linux 64-bit little-endian
dan ok  *
b.   th3make zipvfs.rc test.rc
th3: 0 errors in 8033488 tests. 4685.085 seconds on DESKTOP-8U9G1N8 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
c.   th3make zipvfs.rc memdebug.rc
th3: 0 errors in 10032199 tests. 8557.638 seconds on darkstar 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
d.   th3make zipvfs.rc quick.rc -valgrind
th3: 0 errors in 2821613 tests. 24585.089 seconds on darkstar 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
e.   th3make zipvfs.rc quick.rc
On OSX. • th3: 0 errors in 2800811 tests. 1619.771 seconds on Chanphen-Kruatawongs-iMac.local 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
dan ok  *
f.   At least one of the above on Linux.
(a) on Linux
dan ok  *
g.   At least one of the above on Mac OS X.
(e) ran on OSX.
dan ok  *
h.   At least one of the above on Windows. drh ok  *
i.   th3make zipvfs-cov.rc - verify full coverage
th3: 0 errors in 1246782 tests. 382.653 seconds on darkstar 64-bit little-endian • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • Statement coverage: 100.00% hit 1590 missed 0 total 1590 • Branch coverage: 100.00% hit 941 missed 0 total 941
dan ok  *
 
20.   NDS-Devkit testing drh ok  *
 
a.   Verify that devkit sources are up-to-date with SQLite and ZIPVFS by running update-src.sh and mkdevkit.tcl in the sbin subdirectory of the devkit source tree. Record nds_sqlite3.[ch] hashes in the comment.
aba55eb8642d5a07f44086b2c4219c5ee12ebb847a141c995bd2972422aabb0c nds_sqlite3.c • 63bf8f0fd39cb183e4c8c9e04891d86e7d90d7a3edec27255bbce9dbb62f3651 nds_sqlite3.h
drh ok+  *
b.   Test using: tclsh th3make test.rc nds_devkit.rc
th3: 0 errors in 7061459 tests. 1166.711 seconds on bella 64-bit little-endian • th3: NDS DevKit 3.20.0 2017-07-26 15:49:12 75b78758aa285553 • th3: SQLite 3.20.0 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9
drh ok  *
c.   Verify the "NDS DevKit" version number shown at the end of the test drh ok  *
 
21.   Amalgamation autoconf tarball. drh ok  *
 
a.   Builds. drh ok  *
b.   Works on Linux. drh ok  *
c.   Works on Mac OS X. drh ok  *
d.   Works on Windows MinGW drh ok  *
e.   Works on Windows MSVC drh ok  *
 
22.   TEA archive builds correctly and runs: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
 
23.   Performance tests using speedtest1 compared against the previous release and a release from about one year ago. drh ok  *
 
a.   Android drh ok  *
b.   Linux
1.144G cycles on 3.19.2 vs. 1.122G cycles on 3.20.0 - decrease of 1.9% • Size changes from 491656 to 492102 - an increase of 0.09%
drh ok  *
c.   Mac drh ok  *
d.   Windows drh ok  *
 
24.   Performance tests using speedtest1 --testset rtree drh ok  *
 
a.   Linux drh ok  *
b.   Windows drh ok  *
 
25.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
26.   Compare performance to the previous release using kvtest. drh ok  *
 
a.   Android drh ok  *
b.   Linux drh ok  *
c.   Mac
No detectable difference
drh ok  *
d.   Windows drh ok  *
 
27.   Use the ".selftest" command of the shell to verify that legacy database files are readable and cross-platform drh ok  *
 
a.   iBook PPC drh ok  *
b.   Linux drh ok  *
c.   Mac drh ok  *
d.   Windows drh ok  *
 
28.   Verify that the performance and size measurement spreadsheet in the documentation (misc/speed-size-graph.ods) is up-to-date. drh ok  *
 
29.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
6e3463de355fad4553c134e13fa4e5f97b5f6498d433ec649af096509adfdda8 sqlite3.c • 247226788d6cdebd7c9564e017673306289bfff42fe0db6f6d459a56a795cc59 sqlite3.h
drh ok  *
b.   Mac OS X
6e3463de355fad4553c134e13fa4e5f97b5f6498d433ec649af096509adfdda8 sqlite3.c • 247226788d6cdebd7c9564e017673306289bfff42fe0db6f6d459a56a795cc59 sqlite3.h
drh ok  *
c.   Windows using native MinGW.
6e3463de355fad4553c134e13fa4e5f97b5f6498d433ec649af096509adfdda8 sqlite3.c • 247226788d6cdebd7c9564e017673306289bfff42fe0db6f6d459a56a795cc59 sqlite3.h
drh ok  *
d.   Windows using NMAKE.
6e3463de355fad4553c134e13fa4e5f97b5f6498d433ec649af096509adfdda8 sqlite3.c • 247226788d6cdebd7c9564e017673306289bfff42fe0db6f6d459a56a795cc59 sqlite3.h
drh ok  *
 
30.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested using backcompat.test against 3.8.2 and 3.7.3. • SQLite 2017-07-25 15:12:01 f39cb76b3347baba22f2c329e74036710b64620414433a952de8d44da79ba8d9 • 0 errors out of 265 tests on darkstar Linux 64-bit little-endian
dan ok  *
 
31.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Windows (MinGW) drh ok  *
d.   Windows (MSVC) drh ok  *
e.   A database containing WITHOUT ROWID tables. drh ok  *
 
32.   Build and verify sqldiff drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Windows drh ok  *
 
33.   Run the rbu/run_rbu_tests.tcl script in the test-dbs project on Linux. drh ok+  *
 
34.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *