SQLite 3.17.0 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code. drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 (nmake /f makefile.msc USE_FULLWARN=1) drh ok  *
e.   Windows (64-bit) MSVC using option /W4 (nmake /f makefile.msc USE_FULLWARN=1) drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: dan ok  *
 
a.   tclsh multitest.tcl (take care to update ../th3private)
0 failures on 42 th3makes and 182108515 tests in (05:11:09) 3 cores on bella • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 failures on 42 th3makes and 182114770 tests in (05:25:24) 3 cores on bella • SQLite 3.17.0 2017-02-11 15:02:23 b2e49ae36bfd00a1d0b70a9de9d23d2e16d1c7ca
drh ok+  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
0 failures out of 9746664 tests in (01:43:37) 3 cores on darkstar • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
d.   Check the "releasetest.tcl" log files for undetected errors. dan ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected
5 failures on 5 th3makes and 118 tests in (00:00:32) on bella • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc
th3: 0 errors in 1619422 tests. 4791.346 seconds on beaglebone 32-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
b.   Recompile and test Fossil.
[fossil all rebuild] works. [fossil update], [fossil open] seem to work.
dan ok  *
 
8.   Tests for platform Mac OS X: drh ok  *
 
a.   tclsh releasetest.tcl
0 failures out of 4657851 tests in (02:37:43) on macpro01 • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 failures out of 4657973 tests in (02:37:31) on macpro01 • SQLite 3.17.0 2017-02-11 15:02:23 b2e49ae36bfd00a1d0b70a9de9d23d2e16d1c7ca
drh ok+  *
b.   tclsh multitest.tcl --omit test-ex (after updating th3private)
0 failures on 33 th3makes and 134118669 tests in (07:12:01) 2 cores on macpro01 • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected
2 failures on 2 th3makes and 42 tests in (00:00:28) on Chanphen-Kruatawongs-iMac.local • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc
th3: 0 errors in 1982594 tests. 12033.773 seconds on crabapple.local. 32-bit big-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows: drh ok  *
 
a.   tclsh multitest.tcl (after updating th3private)
0 failures on 36 th3makes and 138039061 tests in (09:42:45) 2 cores on DESKTOP-8U9G1N8 • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
b.   tclsh multitest.tcl --quick on x86
0 failures on 15 th3makes and 20760885 tests in (03:56:30) on win7dev • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 failures on 15 th3makes and 20762136 tests in (03:57:21) on win7dev • SQLite 3.17.0 2017-02-11 15:02:23 b2e49ae36bfd00a1d0b70a9de9d23d2e16d1c7ca
drh ok+  *
c.   tclsh multitest.tcl --scenario failures - verify failures detected drh ok  *
d.   tclsh test/releasetest.tcl --msvc
0 failures out of 1959590 tests in (02:02:22) on DESKTOP-8U9G1N8 • SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 failures out of 1959538 tests in (02:03:28) on DESKTOP-8U9G1N8 • SQLite 3.17.0 2017-02-11 15:02:23 b2e49ae36bfd00a1d0b70a9de9d23d2e16d1c7ca
drh ok+  *
e.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
f.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 test
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 112902 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian • SQLite 2017-02-11 15:02:23 b2e49ae36bfd00a1d0b70a9de9d23d2e16d1c7ca • 0 errors out of 112901 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian
drh ok+  *
g.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 test
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 113959 tests on DESKTOP-8U9G1N8 Windows NT 64-bit little-endian
drh ok  *
h.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
i.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
 
11.   Tests for alternative and special-purpose Windows systems mistachkin ok  *
 
a.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1615638 tests. 785.024 seconds on 32-bit little-endian
mistachkin ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM)
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1615636 tests. 5030.960 seconds on 32-bit little-endian
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1615653 tests. 7427.643 seconds on 32-bit little-endian
mistachkin ok  *
d.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1614366 tests. 984.548 seconds on 32-bit little-endian
mistachkin ok  *
e.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1614373 tests. 3374.545 seconds on 32-bit little-endian
mistachkin ok  *
f.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well.
798fb9d70d2e5f95e64237b04d6692360133381a, 0 errors in 1622442 tests. 3955.743 seconds on 32-bit little-endian
mistachkin ok  *
 
12.   Tests for platform OpenBSD (x86): dan ok  *
 
a.   make test
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 140648 tests on wolfman.devio.us OpenBSD 32-bit little-endian
drh ok++  *
b.   th3make quick.rc
th3: 0 errors in 1730318 tests. 679.285 seconds on obsd.my.domain 32-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
 
13.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 753 seconds
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 3401 seconds
drh ok  *
 
14.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Verify the correct version numbers have been installed. drh ok  *
 
15.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
c.   fossil all dbstat --db-check drh ok  *
 
16.   Rebuild and use Firefox with the latest SQLite drh ok  *
 
a.   Routine use with no problems drh ok  *
b.   ./mach mochitest dom/indexedDB drh ok  *
c.   ./mach xpcshell-test dom/indexedDB drh ok  *
d.   ./mach web-platform-tests IndexedDB drh ok  *
 
17.   CEROD tests in the "test/" subdirectory. drh ok  *
 
18.   SEE tests using TH3: drh ok  *
 
a.   see.c
th3: 0 errors in 1670446 tests. 214.529 seconds on bella 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
b.   see-aes128-ofb.c
th3: 0 errors in 1707035 tests. 1236.487 seconds on win7dev 32-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • quick.rc
drh ok  *
c.   see-aes256-ofb.c
th3: 0 errors in 8131312 tests. 4533.525 seconds on bella 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • memdebug.rc
drh ok  *
d.   see-rc4.c
th3: 0 errors in 1670517 tests. 251.958 seconds on bella 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
e.   see-aes128-ccm.c
th3: 0 errors in 8133109 tests. 2417.506 seconds on bella 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • test.rc
drh ok+  *
f.   see-cccrypt.c
th3: 0 errors in 1654111 tests. 247.705 seconds on macpro01 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
g.   At least one of the above using "test.rc". drh ok  *
h.   At least one of the above using "memdebug.rc". drh ok  *
i.   At least one of the above on Linux. drh ok  *
j.   At least one of the above on Mac OS X. drh ok  *
k.   At least one of the above on Windows. drh ok  *
 
19.   SEE using configure; make test drh ok  *
 
a.   Linux
SQLite 2017-02-08 16:01:57 77b470b0df73dc5ae5ad2f0170ef7c50558c7c88 • 0 errors out of 140535 tests on bella Linux 64-bit little-endian
drh ok  *
b.   Mac
SQLite 2017-02-08 16:01:57 77b470b0df73dc5ae5ad2f0170ef7c50558c7c88 • 0 errors out of 139920 tests on macpro01 Darwin 64-bit little-endian
drh ok  *
 
20.   ZIPVFS tests: dan ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 85659 tests on darkstar Linux 64-bit little-endian
dan ok  *
b.   th3make zipvfs.rc test.rc
th3: 0 errors in 9943792 tests. 2536.998 seconds on darkstar 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
c.   th3make zipvfs.rc memdebug.rc
th3: 0 errors in 8223939 tests. 15875.892 seconds on Chanphen-Kruatawongs-iMac.local 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok  *
d.   th3make zipvfs.rc quick.rc -valgrind
th3: 0 errors in 2770033 tests. 24322.550 seconds on darkstar 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • ==32082== total heap usage: 373,212,623 allocs, 373,212,622 frees, 2,445,661,674,186 bytes allocated • ==32082== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)
dan ok  *
e.   th3make zipvfs.rc quick.rc
th3: 0 errors in 2830781 tests. 3998.995 seconds on win7dev 32-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
drh ok  *
f.   At least one of the above on Linux.
(a) and (b) ran on Linux.
dan ok  *
g.   At least one of the above on Mac OS X.
(c) ran on osx.
dan ok  *
h.   At least one of the above on Windows. drh ok  *
i.   th3make zipvfs-cov.rc - verify full coverage
th3: 0 errors in 1229220 tests. 347.605 seconds on darkstar 64-bit little-endian • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • Statement coverage: 100.00% hit 1573 missed 0 total 1573 • Branch coverage: 100.00% hit 931 missed 0 total 931
dan ok  *
 
21.   NDS-Devkit testing dan ok  *
 
a.   Verify that devkit sources are up-to-date with SQLite and ZIPVFS by running update-src.sh and mkdevkit.tcl in the sbin subdirectory of the devkit source tree. Record nds_sqlite3.[ch] hashes in the comment. dan ok  *
b.   Test using: tclsh th3make test.rc nds_devkit.rc
th3: 0 errors in 6982330 tests. 1429.832 seconds on darkstar 64-bit little-endian • th3: NDS DevKit 3.17.0 2017-02-10 09:14:35 6e1b95f3de0a542d • th3: SQLite 3.17.0 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a
dan ok+  *
c.   Verify the "NDS DevKit" version number shown at the end of the test
th3: NDS DevKit 3.17.0 2017-02-10 09:14:35 6e1b95f3de0a542d
dan ok  *
 
22.   Amalgamation autoconf tarball. drh ok  *
 
a.   Builds. drh ok  *
b.   Works on Linux. drh ok  *
c.   Works on Mac OS X. drh ok  *
d.   Works on Windows MinGW drh ok  *
e.   Works on Windows MSVC drh ok  *
 
23.   TEA archive builds correctly and runs: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
 
24.   Performance tests using speedtest1 compared against the previous release and a release from about one year ago. drh ok  *
 
a.   Android
72.689 vs 68.639 (5.6% faster) on GalaxyS3 Android 4.4.2.
drh ok  *
b.   Linux
3.909 to 3.789 (3% faster)
drh ok  *
c.   Mac
4.939 to 4.779 (3.2% faster)
drh ok  *
d.   Windows
17.508 to 16.866 (3.7% faster) on win2dev
drh ok  *
 
25.   Performance tests using speedtest1 --testset rtree drh ok  *
 
a.   Linux
11.421 to 7.788 (33% faster)
drh ok  *
b.   Windows
35.339 to 25.374 (28% faster) on win7dev
drh ok  *
 
26.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c
27.231 to 22.671 (17% faster) on bella
drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync
39.825 to 32.037 (20% faster) on bella
drh ok  *
 
27.   Compare performance to the previous release using kvtest. drh ok  *
 
a.   Android
1.131 to 0.998 (11.8% faster) with x10k.db on GalaxyS3 Android 4.4.2
drh ok  *
b.   Linux
1.170 to 1.143 (2.3% faster)
drh ok  *
c.   Mac
1.652 to 1.621 (1.9% faster)
drh ok  *
d.   Windows
1.363 to 1.342 (1.5% faster) on win7dev with --blob-api
drh ok  *
 
28.   Use dbselftest to verify that legacy database files are readable and cross-platform drh ok  *
 
a.   iBook PPC
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 357 tests on 6 databases
drh ok  *
b.   Linux
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 357 tests on 6 databases
drh ok  *
c.   Mac
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 357 tests on 6 databases
drh ok  *
d.   Windows
SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 357 tests on 6 databases
drh ok  *
 
29.   Verify that the performance and size measurement spreadsheet in the documentation (misc/speed-size-graph.ods) is up-to-date. drh ok  *
 
30.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
3a8ee628b6f53216342767536d975309da1248d1 sqlite3.c • 3103d3da7ea57a8c42963efed095ace7102302ad sqlite3.h
drh ok  *
b.   Mac OS X
3a8ee628b6f53216342767536d975309da1248d1 sqlite3.c • 3103d3da7ea57a8c42963efed095ace7102302ad sqlite3.h
drh ok  *
c.   OpenBSD
3a8ee628b6f53216342767536d975309da1248d1 sqlite3.c • 3103d3da7ea57a8c42963efed095ace7102302ad sqlite3.h
drh ok  *
d.   Windows using native MinGW.
3a8ee628b6f53216342767536d975309da1248d1 sqlite3.c • 3103d3da7ea57a8c42963efed095ace7102302ad sqlite3.h
drh ok  *
e.   Windows using NMAKE.
3a8ee628b6f53216342767536d975309da1248d1 sqlite3.c • 3103d3da7ea57a8c42963efed095ace7102302ad sqlite3.h
drh ok  *
 
31.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested against 3.7.3 and 3.8.2 using backcompat.test. • SQLite 2017-02-09 17:12:22 798fb9d70d2e5f95e64237b04d6692360133381a • 0 errors out of 265 tests on darkstar Linux 64-bit little-endian
dan ok+  *
 
32.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Windows (MinGW) drh ok  *
d.   Windows (MSVC) drh ok  *
e.   A database containing WITHOUT ROWID tables. drh ok  *
 
33.   Build and verify sqldiff drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Windows drh ok  *
 
34.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
35.   System.Data.SQLite builds and checks out using the SQLite core. mistachkin ok  *
 
a.   Using Microsoft .NET Framework on Windows
798fb9d70d2e5f95e64237b04d6692360133381a, Debug NetFx46 x86: 0 errors/569 tests, 968 seconds, Release NetFx46 x86: 0 errors/569 tests, 933 seconds, Debug NetFx451 x64: 0 errors/569 tests, 946 seconds, Release NetFx451 x64: 0 errors/569 tests, 920 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok  *
b.   Using Mono on unix
798fb9d70d2e5f95e64237b04d6692360133381a, Debug Mono 4.6.1 on Ubuntu 15.10 x86_64: 0 errors/569 tests, 589 seconds, Release Mono 4.6.1 on Ubuntu 15.10 x86_64: 0 errors/569 tests, 547 seconds
mistachkin ok  *