SQLite 3.8.10 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code. drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 drh ok  *
e.   Windows (64-bit) MSVC using option /W4 drh ok  *
f.   sh tool/warnings-clang.sh
5 false-positives ignored
drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh multitest.tcl
0 failures on 31 th3make runs and 166723322 tests in (16:23:47) SQLite 3.8.10 2015-05-07 00:09:29 5f2539da8cb9df99029ab4ab7023804722697673
drh ok+  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
1 failures out of 9335973 tests in (07:25:27) SQLite 3.8.10 2015-05-07 00:09:29 5f2539da8cb9df99029ab4ab7023804722697673. The one error appears to be a timing bug in the a crash test script. It is not reproducible and does not seem to indicate any problems in the core.
drh ok  *
d.   Check the "releasetest.tcl" log files for undetected errors. dan ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies dan ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) drh ok  *
 
a.   tclsh th3make min.rc
./th3: 0 errors out of 1444999 tests in 3393.943 seconds ./th3: SQLite 3.8.10 2015-05-05 16:57:52 cc50883d67334507227e1384fef6cc7c93fd7de
drh ok  *
b.   Recompile and test Fossil. drh ok  *
 
8.   Tests for platform Mac OS X (x86): drh ok  *
 
a.   tclsh releasetest.tcl dan ok  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 26 th3make runs and 118618631 tests in (23:29:10) SQLite 3.8.10 2015-05-05 01:09:06 5f3cd68b3e3ac9957059c7076e95c5c4e8238f51
drh ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc
./th3: architecture: 32-bit big-endian ./th3: 0 errors out of 1447611 tests in 3942.390 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
b.   Recompile and test Fossil.
The GCC on MacOS 10.2 crashes on the amalgamation. Substituting the split amalgamation makes it work. Chalk this one up as a compiler bug.
drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows 7.0/8.x (x86): drh ok  *
 
a.   th3make msvc.rc test.rc /RTC1
0 errors out of 5876248 tests in 6079.788 seconds SQLite 3.8.10 2015-05-06 14:18:58 31834c3aa7dee
drh ok  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 25 th3make runs and 113339298 tests in (11:46:38) SQLite 3.8.10 2015-05-05 01:09:06 5f3cd68b3e3ac9957059c7076e95c5c4e8238f51
drh ok  *
c.   tclsh multitest.tcl --scenario failures - verify failures detected drh ok  *
d.   tclsh test/releasetest.tcl
0 failures out of 1201583 tests in (01:46:55) SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
e.   tclsh test/releasetest.tcl --msvc
0 failures out of 1775368 tests in (06:54:35) SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 fulltestonly
0 errors out of 1185706 tests
drh ok  *
h.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 fulltestonly
0 errors out of 1190515 tests
drh ok  *
i.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
j.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
 
11.   Tests for platform Windows (other): mistachkin ok  *
 
a.   th3make msvc.rc test.rc - Windows 7.0/8.x (x64) drh ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
04afa3febee32854fbb09ef8d4ffffd432119716, 0 errors out of 1448546 tests in 663.063 seconds
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM)
04afa3febee32854fbb09ef8d4ffffd432119716, 0 errors out of 1448538 tests in 4242.527 seconds
mistachkin ok  *
d.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1
31834c3aa7deeafee1163a67caf5f3197f07baf4, 0 errors out of 1448551 tests in 5547.360 seconds
mistachkin ok  *
e.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0
04afa3febee32854fbb09ef8d4ffffd432119716, 0 errors out of 1447563 tests in 895.436 seconds
mistachkin ok  *
f.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1
31834c3aa7deeafee1163a67caf5f3197f07baf4, 0 errors out of 1447577 tests in 3034.767 seconds
mistachkin ok  *
g.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well.
04afa3febee32854fbb09ef8d4ffffd432119716, 0 errors out of 1452564 tests in 3079.474 seconds
mistachkin ok  *
 
12.   Tests for platform OpenBSD (x86): drh ok  *
 
a.   make test
0 errors out of 139126 tests
drh ok  *
b.   th3make quick.rc
0 errors out of 1527811 tests in 1894.481 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
 
13.   Tests for platform Solaris (SPARC): drh ok  *
 
a.   make test
0 errors out of 139319 tests
drh ok  *
b.   tclsh multitest.tcl --only quick
0 failures on 7 th3make runs and 11115267 tests in (03:47:49) SQLite 3.8.10 2015-05-04 20:25:05 1c9c6eaa9f75fd7b90fbf8b057656fd9e50b5060
drh ok  *
c.   Recompile and test Fossil. drh ok+  *
d.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
14.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   run-all.sh - no errors drh ok  *
d.   run-all.bat - no errors drh ok  *
 
15.   Build using the configure/make in main source tree. dan ok  *
 
a.   Make sure that autoconf has been run to update the configure script. dan ok  *
b.   Verify the correct version numbers have been installed. dan ok  *
 
16.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
 
17.   Firefox recompiled using lastest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Active use with no issues noted. drh ok  *
 
18.   CEROD tests in the "test/" subdirectory. drh ok  *
 
19.   SEE tests using TH3: drh ok  *
 
a.   see.c
0 errors out of 1512678 tests in 1157.278 seconds SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
b.   see-aes128-ofb.c
./th3: 0 errors out of 6075341 tests in 6536.226 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
c.   see-aes256-ofb.c
./th3: 0 errors out of 7741141 tests in 4592.232 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
d.   see-rc4.c
./th3: 0 errors out of 1493991 tests in 681.131 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
e.   see-aes128-ccm.c
./th3: 0 errors out of 8146380 tests in 2078.209 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd4321197
drh ok  *
f.   At least one of the above using "test.rc". drh ok  *
g.   At least one of the above using "memdebug.rc". drh ok  *
h.   At least one of the above on Linux. drh ok  *
i.   At least one of the above on Mac OS X. drh ok  *
j.   At least one of the above on Windows. drh ok  *
 
20.   ZIPVFS tests: drh ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.) dan ok  *
b.   th3make zipvfs.rc test.rc
./th3: 0 errors out of 1500996 tests in 249.023 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
c.   th3make zipvfs.rc memdebug.rc
./th3: 0 errors out of 8175993 tests in 4668.842 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd432119716
drh ok  *
d.   th3make zipvfs.rc quick.rc -valgrind
./th3: 0 errors out of 2027936 tests in 10890.816 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
e.   th3make zipvfs.rc quick.rc
0 errors out of 2050409 tests in 1643.341 seconds SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32
drh ok  *
f.   At least one of the above on Linux. drh ok  *
g.   At least one of the above on Mac OS X.
0 errors out of 49516 tests, OSX, 2015-05-05 18:52:54 04afa3febee328
dan ok  *
h.   At least one of the above on Windows. drh ok  *
 
21.   NX-Devkit compiles and runs tclsh th3make test.rc nx_compress.o without error.
./th3: 0 errors out of 6769630 tests in 1339.321 seconds ./th3: SQLite 3.8.10 2015-05-05 18:52:54 04afa3febee32854fbb09ef8d4ffffd43211971
drh ok  *
 
22.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds. dan ok  *
b.   Works on Linux. dan ok  *
c.   Works on Mac OS X. dan ok  *
 
23.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac OS X dan ok  *
 
24.   Run performance tests comparing the new SQLite release against the previous release and/or a release from one year ago. Document and justify any performance decrease. drh ok  *
 
a.   The Tcl "speed*.test" scripts.
2014-05-07: 24609962 uS. 3.8.9: 24310082 uS. 3.8.10: 23918807 uS. Win7.
drh ok  *
b.   The TH3 speed tests.
2014-05-07: 3.346s. 3.8.9: 2.972s. 3.8.10: 2.940s.
drh ok  *
c.   The "speedtest1" program.
2014-05-07: 1056 million. 3.8.9: 847 million. 3.8.10: 789 million. 33.8% and 7.4% faster, respectively.
drh ok  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
2014-05-07: 4.091s. 3.8.9: 3.765s. 3.8.10: 3.652s. Mac
drh ok  *
e.   One or more of the above on Linux. drh ok  *
f.   One or more of the above on Windows. drh ok  *
g.   One or more of the above on Mac OS X. drh ok  *
 
25.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
26.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments. drh ok  *
 
a.   Versus the previous release.
477648 to 479931 bytes. 0.477% growth
drh ok  *
b.   Versus the trunk from 12 months ago.
462087 to 479931 bytes. 3.9% growth
drh ok  *
 
27.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
b.   Mac OS X
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
c.   OpenBSD
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
d.   Windows using native MinGW.
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
e.   Windows using NMAKE.
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
f.   Solaris (SPARC) using autoconf.
aa4f0f90c9c77424943e026a2ecee4a6c7f9e0d3 sqlite3.c fd2f6fc08b9bedc2cef32bf2309b6773940fb0ff sqlite3.h
drh ok  *
 
28.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested with backcompat.test against 3.6.4, 3.7.3 and 3.8.9. 0 errors out of 411 tests.
dan ok  *
 
29.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database. drh ok  *
b.   32-big to 64-little, WAL. drh ok  *
c.   32-big to 64-little, rollback. drh ok  *
d.   64-little to 32-big, SEE database. drh ok  *
e.   64-little to 32-big, ZIPVFS database. drh ok  *
f.   64-little to 32-big, CEROD database. drh ok  *
 
30.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Solaris (SPARC) drh ok  *
d.   Windows (MinGW) drh ok  *
e.   Windows (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables. drh ok  *
 
31.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK. drh ok  *
 
a.   tclsh th3make session.rc test.rc (on Windows)
C:\MinGW\msys\1.0\home\drh\sqlite\th3\th3.exe: 0 errors out of 6089424 tests in 2274.647 seconds C:\MinGW\msys\1.0\home\drh\sqlite\th3\th3.exe: SQLite 3.8.10 2015-05-05 17:12:27 de7083cfe2bb00b689bec6bcc75e994f564ceda6
drh ok  *
b.   tclsh th3make session.rc test.rc (on Unix)
./th3: 0 errors out of 7738963 tests in 1978.590 seconds
dan ok  *
c.   tclsh th3make session.rc quick.rc -valgrind
./th3: 0 errors out of 1516501 tests in 9752.714 seconds, ./th3: SQLite 3.8.10 2015-05-05 17:12:27 de7083cfe2bb00b689bec6bcc75e994f564ceda6
dan ok  *
d.   make test (on Windows) drh ok  *
e.   make test (on Unix) drh ok  *
f.   testfixture test/session.test
0 errors out of 48226 tests
dan ok  *
 
32.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
33.   System.Data.SQLite builds and checks out using the SQLite core.
04afa3febee32854fbb09ef8d4ffffd432119716, Debug NetFx40 x86: 0 errors/455 tests, 708 seconds, Release NetFx40 x86: 0 errors/455 tests, 676 seconds, Debug NetFx45 x64: 0 errors/455 tests, 739 seconds, Release NetFx45 x64: 0 errors/455 tests, 725 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok  *