SQLite 3.8.11 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code.
There are 14 stale evidence marks. But we should have fixed those before doing all the rest of the testing. We'll fix them before the next release...
drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. dan ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok+  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script)
Lots of errors on the "Android Configuration". No matter - that is a problem with tool/warnings.sh not with SQLite.
drh ok  *
c.   OpenBSD GCC using options -Wall
[gcc -Wall sqlite3.c shell.c -lpthread] produces no warnings. [gcc -v] says "gcc version 4.2.1 20070719"
dan ok  *
d.   Windows (32-bit) MSVC using option /W4 mistachkin ok  *
e.   Windows (64-bit) MSVC using option /W4 drh ok  *
f.   sh tool/warnings-clang.sh
false positives only.
drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh multitest.tcl
0 failures on 31 th3make runs and 168520136 tests in (17:00:48) SQLite 3.8.11 2015-07-24 18:22:29 a343745d99cf4bccb2f5582735cc2f88b03e847d
drh ok  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
1 failures out of 9435499 tests in (08:10:09) SQLite 3.8.11 2015-07-25 14:12:26 af85b01d93d3043f2e1a38d289ca00a5ef24520c. The one error is memsubsys1.wal3-1.0 on Device-One. This is not an important test case. Deemed pass.
drh ok  *
d.   Check the "releasetest.tcl" log files for undetected errors. drh ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok+  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc
th3: 0 errors out of 1464223 tests in 3614.467 seconds. 32-bit little-endian, th3: SQLite 3.8.11 2015-07-24 18:22:29 a343745d99cf4bccb2f5582735cc2f88b03e847d
dan ok  *
b.   Recompile and test Fossil.
Builds, clones, can do checkouts etc.
dan ok  *
 
8.   Tests for platform Mac OS X (x86): drh ok  *
 
a.   tclsh releasetest.tcl
0 failures out of 4379834 tests in (08:52:47) SQLite 3.8.11 2015-07-25 14:12:26 af85b01d93d3043f2e1a38d289ca00a5ef24520c
drh ok  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 25 th3make runs and 132218080 tests in (31:48:16) SQLite 3.8.11 2015-07-25 19:26:52 ee348b12754abda1fe13231c1868faca9d78481c, on mac air including test-ex which took 9:37:04 itself.
drh ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc
th3: 0 errors out of 1469493 tests in 4059.372 seconds. 32-bit big-endian th3: SQLite 3.8.11 2015-07-25 14:26:17 7efed5786bb6a7a452f5aece9d6c6a09e6930939
drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows 7.0/8.x (x86): drh ok  *
 
a.   th3make msvc.rc test.rc /RTC1
th3: 0 errors out of 5944298 tests in 6196.994 seconds. 32-bit little-endian th3: SQLite 3.8.11 2015-07-24 23:28:05 db129149812cb4eadb4cd79ad293d14962d2638d
drh ok  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 25 th3make runs and 114525732 tests in (12:05:44) SQLite 3.8.11 2015-07-24 17:36:34 1997ee548b2e569a39e73319b661c1a78dfe5dae
drh ok  *
c.   tclsh multitest.tcl --scenario failures - verify failures detected drh ok  *
d.   tclsh test/releasetest.tcl
0 failures out of 1228425 tests in (01:49:37) SQLite 3.8.11 2015-07-25 14:12:26 af85b01d93d3043f2e1a38d289ca00a5ef24520c
drh ok  *
e.   tclsh test/releasetest.tcl --msvc
0 failures out of 1774855 tests in (06:08:39) SQLite 3.8.11 2015-07-24 18:22:29 a343745d99cf4bccb2f5582735cc2f88b03e847d, Win7
drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 fulltestonly
0 errors out of 1183518 tests
drh ok  *
h.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 fulltestonly
1 errors out of 1182761 tests. The one error is selectG-100. It took longer than 10 seconds because the test was running on a slow machine. Deemed pass.
drh ok  *
i.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
j.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
 
11.   Tests for platform Windows (other): mistachkin ok  *
 
a.   th3make msvc.rc test.rc - Windows 7.0/8.x (x64)
Windows 8 64-bit, 1997ee548b2e569a39e73319b661c1a78dfe5dae, 0 errors out of 5944202 tests in 3403.062 seconds. 32-bit little-endian
mistachkin ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
1997ee548b2e569a39e73319b661c1a78dfe5dae, 0 errors out of 1468877 tests in 703.085 seconds. 32-bit little-endian
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM)
db129149812cb4eadb4cd79ad293d14962d2638d, 0 errors out of 1468873 tests in 4287.391 seconds. 32-bit little-endian
mistachkin ok  *
d.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1
a343745d99cf4bccb2f5582735cc2f88b03e847d, 0 errors out of 1468878 tests in 6128.961 seconds. 32-bit little-endian
mistachkin ok  *
e.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0
1997ee548b2e569a39e73319b661c1a78dfe5dae, 0 errors out of 1467958 tests in 959.029 seconds. 32-bit little-endian
mistachkin ok  *
f.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1
de281a4fac0de3700e754c17976a8497587ca797, 0 errors out of 1467933 tests in 2968.389 seconds. 32-bit little-endian
mistachkin ok  *
g.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well.
2d572b8cdc67679cc95e69677a87e7b4a82f6c2d, 0 errors out of 1474701 tests in 3161.945 seconds. 32-bit little-endian
mistachkin ok  *
 
12.   Tests for platform OpenBSD (x86): dan ok  *
 
a.   make test dan ok  *
b.   th3make quick.rc dan ok  *
 
13.   Tests for platform Solaris (SPARC): drh ok  *
 
a.   make test
0 errors out of 139462 tests
drh ok  *
b.   tclsh multitest.tcl --only quick
0 failures on 7 th3make runs and 11288441 tests in (03:54:27) SQLite 3.8.11 2015-07-23 20:44:49 017c5019e1ce042025d4f327e50ec50af49f9fa4
drh ok  *
c.   Recompile and test Fossil. drh ok  *
d.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
14.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 535 seconds - bella, x64
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 1452 seconds
drh ok  *
 
15.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Verify the correct version numbers have been installed. drh ok  *
 
16.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
 
17.   CEROD tests in the "test/" subdirectory. drh ok+  *
 
18.   SEE tests using TH3: drh ok  *
 
a.   see.c
th3: 0 errors out of 6115298 tests in 3311.922 seconds. 32-bit little-endian th3: SQLite 3.8.11 2015-07-24 19:56:44 de281a4fac0de3700e754c17976a8497587ca797, win8, test.rc
drh ok  *
b.   see-aes128-ofb.c
th3: 0 errors out of 1518802 tests in 704.309 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 19:56:44 de281a4fac0de3700e754c17976a8497587ca797, mac, quick.rc
drh ok  *
c.   see-aes256-ofb.c
th3: 0 errors out of 7767755 tests in 4359.975 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 19:56:44 de281a4fac0de3700e754c17976a8497587ca797, unix, memdebug.rc
drh ok  *
d.   see-rc4.c
th3: 0 errors out of 1526750 tests in 222.673 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 19:56:44 de281a4fac0de3700e754c17976a8497587ca797, unix, quick.rc
drh ok  *
e.   see-aes128-ccm.c
th3: 0 errors out of 1526899 tests in 222.650 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 19:56:44 de281a4fac0de3700e754c17976a8497587ca797, unix, quick.rc
drh ok  *
f.   At least one of the above using "test.rc". drh ok  *
g.   At least one of the above using "memdebug.rc". drh ok  *
h.   At least one of the above on Linux. drh ok  *
i.   At least one of the above on Mac OS X. drh ok  *
j.   At least one of the above on Windows. drh ok  *
 
19.   ZIPVFS tests: drh ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.) dan ok  *
b.   th3make zipvfs.rc test.rc dan ok  *
c.   th3make zipvfs.rc memdebug.rc dan ok  *
d.   th3make zipvfs.rc quick.rc -valgrind dan ok  *
e.   th3make zipvfs.rc quick.rc
Win8: th3: 0 errors out of 2086998 tests in 719.610 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-25 19:26:52 ee348b12754abda1fe13231c1868faca9d78481c
drh ok  *
f.   At least one of the above on Linux. dan ok  *
g.   At least one of the above on Mac OS X. dan ok  *
h.   At least one of the above on Windows.
Win8. Added msvc.rc to 19e.
drh ok  *
 
20.   NX-Devkit compiles and runs tclsh th3make test.rc nx_compress.o without error.
th3: 0 errors out of 6820295 tests in 1195.641 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-25 19:26:52 ee348b12754abda1fe13231c1868faca9d78481c
drh ok  *
 
21.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds. dan ok  *
b.   Works on Linux. dan ok  *
c.   Works on Mac OS X. dan ok  *
 
22.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac OS X dan ok  *
 
23.   Run performance tests comparing the new SQLite release against the previous release and/or a release from one year ago. Document and justify any performance decrease. drh ok  *
 
a.   The Tcl "speed*.test" scripts.
trunk: 5.091s. 3.8.10.2: 5.382s 2014-07-31: 5.913s. Unix x64
drh ok  *
b.   The TH3 speed tests.
Win8, trunk: 7.847s vs. version 3.8.10.2: 8.047s
drh ok  *
c.   The "speedtest1" program.
with --shrink-memory. year-ago: 1129M. v3.8.10.2: 860M. v3.8.11: 728M. 50% faster in the previous year.
drh ok  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
trunk: 30.106s, v3.8.10.2: 30.194s, 2014-07-31: 30.312s. Little difference because this test is dominated by parsing time. iMac
drh ok  *
e.   One or more of the above on Linux. drh ok  *
f.   One or more of the above on Windows. drh ok  *
g.   One or more of the above on Mac OS X. drh ok  *
 
24.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
25.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments. drh ok  *
 
a.   Versus the previous release.
3.8.10.2: 459680 bytes. 3.8.11: 461737 bytes. Increase of 2057 bytes or 0.45%.
drh ok  *
b.   Versus the trunk from 12 months ago.
year-ago: 442900 bytes. 3.8.11: 461737 bytes. Increase of 18837 bytes or 4.3%
drh ok  *
 
26.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms.
th3: 0 errors out of 6820295 tests in 1195.641 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-25 19:26:52 ee348b12754abda1fe13231c1868faca9d78481c
drh ok  *
 
a.   Linux
288905f2b78f66627fc87efc8fb0b9567bbb08c9 sqlite3.c b700535052297ab6264175e76754da41408e7609 sqlite3.h
drh ok+  *
b.   Mac OS X
288905f2b78f66627fc87efc8fb0b9567bbb08c9 sqlite3.c b700535052297ab6264175e76754da41408e7609 sqlite3.h
drh ok  *
c.   OpenBSD
Commit [ee348b127] generates "SHA1 (./sqlite3.c) = 288905f2b78f66627fc87efc8fb0b9567bbb08c9" and "SHA1 (sqlite3.h) = b700535052297ab6264175e76754da41408e7609"
dan ok  *
d.   Windows using native MinGW.
288905f2b78f66627fc87efc8fb0b9567bbb08c9 sqlite3.c b700535052297ab6264175e76754da41408e7609 sqlite3.h
drh ok  *
e.   Windows using NMAKE.
288905f2b78f66627fc87efc8fb0b9567bbb08c9 sqlite3.c b700535052297ab6264175e76754da41408e7609 sqlite3.h
drh ok  *
f.   Solaris (SPARC) using autoconf.
Checked out on an earlier beta.
drh ok+  *
 
27.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested with backcompat.test against 3.6.4, 3.7.3 and 3.8.3. 0 errors out of 411 tests.
dan ok  *
 
28.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database. drh ok  *
b.   32-big to 64-little, WAL. drh ok  *
c.   32-big to 64-little, rollback. drh ok  *
d.   64-little to 32-big, SEE database. drh ok  *
e.   64-little to 32-big, ZIPVFS database. drh ok  *
f.   64-little to 32-big, CEROD database. drh ok  *
 
29.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Solaris (SPARC) drh ok  *
d.   Windows (MinGW) drh ok  *
e.   Windows (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables. drh ok  *
 
30.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK. drh ok  *
 
a.   tclsh th3make session.rc test.rc (on Windows)
Win8 with msvc.rc. th3: 0 errors out of 5930570 tests in 2252.237 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 22:21:01 0298a9a780695b666e7c683700d9f2f889d6f826
drh ok  *
b.   tclsh th3make session.rc test.rc (on Unix)
th3: 0 errors out of 7800572 tests in 1669.260 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 22:21:01 0298a9a780695b666e7c683700d9f2f889d6f826
drh ok  *
c.   tclsh th3make session.rc quick.rc -valgrind
th3: 0 errors out of 1538178 tests in 7140.275 seconds. 64-bit little-endian th3: SQLite 3.8.11 2015-07-24 22:21:01 0298a9a780695b666e7c683700d9f2f889d6f826
drh ok  *
d.   make test (on Windows)
0 errors out of 165778 tests, Win8, msvc64.
drh ok  *
e.   make test (on Unix)
0 errors out of 208692 tests
drh ok  *
f.   testfixture test/session.test
0 errors out of 48672 tests
drh ok  *
 
31.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
32.   System.Data.SQLite builds and checks out using the SQLite core.
1997ee548b2e569a39e73319b661c1a78dfe5dae, Debug NetFx46 x86: 0 errors/485 tests, 681 seconds, Release NetFx46 x86: 0 errors/485 tests, 646 seconds, Debug NetFx46 x64: 0 errors/485 tests, 782 seconds, Release NetFx46 x64: 0 errors/485 tests, 770 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok+  *