SQLite 3.8.12 Status Board

History    Checklist    Baseline

Cancelled: Release 3.8.12 will not occur. The next release will be named 3.9.0 instead.
 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
 
3.   Documentation review: --- ---
 
a.   Latest release on the "index.html" page. --- ---
b.   Release announcement in "changes.in". --- ---
c.   Release accouncement in "news.html". --- ---
d.   No unresolved hyperlinks in the documentation build. --- ---
e.   Requirements marks are up-to-date in both documentation and source code. --- ---
f.   The compile-time options are all up-to-date (compile.html). --- ---
g.   Database footprint is up-to-date (features.html). --- ---
h.   Test metrics are up-to-date (testing.html). --- ---
i.   Check new/changed documentation for spelling and gramatical mistakes. --- ---
 
4.   Compiler warning checks. --- ---
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) --- ---
c.   OpenBSD GCC using options -Wall --- ---
d.   Windows (32-bit) MSVC using option /W4 --- ---
e.   Windows (64-bit) MSVC using option /W4 --- ---
f.   sh tool/warnings-clang.sh
false positives only.
drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: --- ---
 
a.   tclsh multitest.tcl
0 failures on 31 th3make runs and 168765114 tests in (16:45:10) SQLite 3.8.12 2015-10-08 02:44:42 77b707b77496a08703fe9405e8e4521a4e5b419e
drh ok  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
0 failures out of 9509899 tests in (08:10:51) SQLite 3.8.12 2015-10-07 13:24:27 f20f9f813f00cefcd427e506a09b0b973c782e3f
drh ok  *
d.   Check the "releasetest.tcl" log files for undetected errors. drh ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected --- ---
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected
errors reported for all configurations
dan ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc dan ok  *
b.   Recompile and test Fossil. dan ok  *
 
8.   Tests for platform Mac OS X (x86): --- ---
 
a.   tclsh releasetest.tcl
0 failures out of 4409620 tests in (05:36:27) SQLite 3.8.12 2015-10-07 16:14:18 d591e860d3d7c61637b4b07989bf176cb337db2c
dan ok+  *
b.   tclsh multitest.tcl --omit test-ex
passed, but -m32 tests not run
dan ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected --- ---
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected --- ---
 
9.   Tests for platform Mac OS X 10.2 (PPC): --- ---
 
a.   tclsh th3make quick.rc --- ---
b.   Recompile and test Fossil. --- ---
c.   Verify that Fossil repositories are cross-platform with x86/x64. --- ---
 
10.   Tests for platform Windows 7.0/8.x (x86): --- ---
 
a.   th3make msvc.rc test.rc /RTC1
th3: 0 errors out of 5966474 tests in 6287.078 seconds. 32-bit little-endian th3: SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2, Win7
drh ok  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 24 th3make runs and 109750356 tests in (10:48:54) SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2, win8
drh ok  *
c.   tclsh multitest.tcl --scenario failures - verify failures detected --- ---
d.   tclsh test/releasetest.tcl --- ---
e.   tclsh test/releasetest.tcl --msvc
0 failures out of 1793322 tests in (02:04:40) SQLite 3.8.12 2015-10-07 13:24:27 f20f9f813f00cefcd427e506a09b0b973c782e3f
drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected --- ---
g.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 fulltestonly --- ---
h.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 fulltestonly --- ---
i.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies --- ---
j.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. --- ---
 
11.   Tests for platform Windows (other): --- ---
 
a.   th3make msvc.rc test.rc - Windows 7.0/8.x (x64)
th3: 0 errors out of 5965989 tests in 5754.805 seconds. 32-bit little-endian th3: SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2, win7
drh ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
df9ef61f1ba2e3a3420fae84e3eaa2e0e235bc28, 0 errors out of 1486053 tests in 703.698 seconds. 32-bit little-endian
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM) --- ---
d.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1 --- ---
e.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0 --- ---
f.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1 --- ---
g.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well. --- ---
 
12.   Tests for platform OpenBSD (x86): dan ok  *
 
a.   make test
0 errors out of 139294 tests
dan ok+  *
b.   th3make quick.rc
th3: 0 errors out of 1570101 tests in 839.440 seconds. 32-bit little-endian th3: SQLite 3.8.12 2015-10-08 02:44:42 77b707b77496a08703fe9405e8e4521a4e5b419e
dan ok  *
 
13.   Tests for platform Solaris (SPARC): drh ok  *
 
a.   make test
0 errors out of 139730 tests
drh ok  *
b.   tclsh multitest.tcl --only quick
0 failures on 7 th3make runs and 11402307 tests in (03:58:46) SQLite 3.8.12 2015-10-07 19:06:21 83dc1ff7fa010715ca7f406a572f4ee444a967d7
drh ok  *
c.   Recompile and test Fossil. drh ok  *
d.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
14.   JSON1 drh ok  *
 
a.   ./th3make test.rc json/*.test -DTH3_JSON
th3: 0 errors out of 71513 tests in 2.907 seconds. 64-bit little-endian th3: SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2
drh ok  *
b.   ./th3make cov.rc json/*.test -DTH3_JSON - manually review coverage
All branches covered.
drh ok  *
c.   ./th3make quick.rc json/*.test -DTH3_JSON -valgrind
th3: 0 errors out of 29961 tests in 32.094 seconds. 64-bit little-endian th3: SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2, and no valgrind warnings.
drh ok  *
 
15.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 1159 seconds
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 3537 seconds, Win7
drh ok  *
 
16.   Build using the configure/make in main source tree. dan ok  *
 
a.   Make sure that autoconf has been run to update the configure script. dan ok  *
b.   Verify the correct version numbers have been installed. dan ok  *
 
17.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
 
18.   CEROD tests in the "test/" subdirectory. --- ---
 
19.   SEE tests using TH3: --- ---
 
a.   see.c
th3: 0 errors out of 1556799 tests in 559.706 seconds. 64-bit little-endian th3: SQLite 3.8.12 2015-10-07 17:06:17 13adcd038fc20dd1b6f344f79b449b4034f8f8f2, win8, msvc
drh ok  *
b.   see-aes128-ofb.c --- ---
c.   see-aes256-ofb.c --- ---
d.   see-rc4.c --- ---
e.   see-aes128-ccm.c --- ---
f.   At least one of the above using "test.rc". --- ---
g.   At least one of the above using "memdebug.rc". --- ---
h.   At least one of the above on Linux. --- ---
i.   At least one of the above on Mac OS X. --- ---
j.   At least one of the above on Windows. drh ok  *
 
20.   ZIPVFS tests: --- ---
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
0 errors out of 63764 tests (on Linux)
dan ok  *
b.   th3make zipvfs.rc test.rc dan ok  *
c.   th3make zipvfs.rc memdebug.rc dan ok  *
d.   th3make zipvfs.rc quick.rc -valgrind dan ok  *
e.   th3make zipvfs.rc quick.rc dan ok+  *
f.   At least one of the above on Linux. dan ok  *
g.   At least one of the above on Mac OS X. --- ---
h.   At least one of the above on Windows. --- ---
 
21.   NX-Devkit compiles and runs tclsh th3make test.rc nx_compress.o without error. --- ---
 
22.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds. dan ok  *
b.   Works on Linux. dan ok  *
c.   Works on Mac OS X. dan ok  *
 
23.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac OS X dan ok  *
 
24.   Run performance tests comparing the new SQLite release against the previous release and/or a release from one year ago. Document and justify any performance decrease. --- ---
 
a.   The Tcl "speed*.test" scripts. --- ---
b.   The TH3 speed tests. --- ---
c.   The "speedtest1" program. --- ---
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
--- ---
e.   One or more of the above on Linux. --- ---
f.   One or more of the above on Windows.
Using speedtest1: 1 year ago was about 9.9s. Current is about 9.3s. No measurable changes since the previous release.
drh ok  *
g.   One or more of the above on Mac OS X. --- ---
 
25.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
26.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments. --- ---
 
a.   Versus the previous release. --- ---
b.   Versus the trunk from 12 months ago. --- ---
 
27.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. --- ---
 
a.   Linux
000247965fc7eeb7a05f9a4e81ac8f2cd7dfe928 sqlite3.c 59ba9051065d5d6b9b0641da48ee76207ea2e21b sqlite3.h
drh ok  *
b.   Mac OS X --- ---
c.   OpenBSD --- ---
d.   Windows using native MinGW. --- ---
e.   Windows using NMAKE.
000247965fc7eeb7a05f9a4e81ac8f2cd7dfe928 sqlite3.c 59ba9051065d5d6b9b0641da48ee76207ea2e21b sqlite3.h
drh ok  *
f.   Solaris (SPARC) using autoconf.
000247965fc7eeb7a05f9a4e81ac8f2cd7dfe928 sqlite3.c 59ba9051065d5d6b9b0641da48ee76207ea2e21b sqlite3.h
drh ok  *
 
28.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested with backcompat.test against 3.6.4, 3.7.3 and 3.8.3. 0 errors out of 411 tests.
dan ok  *
 
29.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. --- ---
 
a.   32-big to 64-little, database. --- ---
b.   32-big to 64-little, WAL. --- ---
c.   32-big to 64-little, rollback. --- ---
d.   64-little to 32-big, SEE database. --- ---
e.   64-little to 32-big, ZIPVFS database. --- ---
f.   64-little to 32-big, CEROD database. --- ---
 
30.   Build and verify correct operation of sqlite3_analyzer on: --- ---
 
a.   Linux drh ok  *
b.   Mac OS X dan ok  *
c.   Solaris (SPARC) drh ok  *
d.   Windows (MinGW) --- ---
e.   Windows (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables. drh ok  *
 
31.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK. --- ---
 
a.   tclsh th3make session.rc test.rc (on Windows) --- ---
b.   tclsh th3make session.rc test.rc (on Unix)
th3: 0 errors out of 7849442 tests in 2198.847 seconds. 64-bit little-endian th3: SQLite 3.8.12 2015-10-08 14:55:30 35b1b8d4b97715030700e37b292bb4f1bb3f44d6
dan ok  *
c.   tclsh th3make session.rc quick.rc -valgrind dan ok  *
d.   make test (on Windows) --- ---
e.   make test (on Unix)
0 errors out of 63764 tests
dan ok+  *
f.   testfixture test/session.test
0 errors out of 48505 tests
dan ok  *
 
32.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. --- ---
 
33.   System.Data.SQLite builds and checks out using the SQLite core.
df9ef61f1ba2e3a3420fae84e3eaa2e0e235bc28, Debug NetFx46 x86: 0 errors/492 tests, 681 seconds, Release NetFx46 x86: 0 errors/492 tests, 646 seconds, Debug NetFx46 x64: 0 errors/492 tests, 887 seconds, Release NetFx46 x64: 0 errors/492 tests, 883 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok  *