SQLite 3.8.9 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code. drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 drh ok  *
e.   Windows (64-bit) MSVC using option /W4 drh ok  *
f.   sh tool/warnings-clang.sh
5 false-positives ignored
drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh multitest.tcl
0 failures on 31 th3make runs and 166230515 tests in (16:20:22) SQLite 3.8.9 2015-04-07 15:39:29 8e4ac2ce24415926247961b00a62425ae85d6ffb - after printf() fix
drh ok+  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
0 failures out of 8807992 tests in (06:34:33) SQLite 3.8.9 2015-04-07 15:39:29 8e4ac2ce24415926247961b00a62425ae85d6ffb - after prinf() fixes
dan ok+++  *
d.   Check the "releasetest.tcl" log files for undetected errors. drh ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
f.   tclsh releasetest.cl --platform Failure-Detection - all failures detected drh ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) drh ok  *
 
a.   tclsh th3make min.rc
0 errors out of 1446874 tests in 3264.477 seconds, SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
b.   Recompile and test Fossil. drh ok  *
 
8.   Tests for platform Mac OS X (x86): drh ok  *
 
a.   tclsh releasetest.tcl
0 failures out of 4294998 tests in (07:02:47) SQLite 3.8.9 2015-04-07 15:39:29 8e4ac2ce24415926247961b00a62425ae85d6ffb - after printf() fixes.
drh ok++  *
b.   tclsh multitest.tcl --omit test-ex
0 failures on 26 th3make runs and 118257165 tests in (30:54:56) SQLite 3.8.9 2015-04-04 16:49:04 edc1de2a588fd50c0049bb2be76d3f6783443165
drh ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
d.   tclsh releasetest.cl --platform Failure-Detection - all failures detected drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc
0 errors out of 1448644 tests in 3989.750 seconds, SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows 7.0/8.x (x86): drh ok  *
 
a.   th3make msvc.rc test.rc /RTC1
0 errors out of 5870100 tests in 3298.510 seconds SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
b.   tclsh test/releasetest.tcl
0 failures out of 1139097 tests in (06:00:33) SQLite 3.8.9 2015-04-07 15:39:29 8e4ac2ce24415926247961b00a62425ae85d6ffb - retest after printf() changes
drh ok+++  *
c.   tclsh multitest.tcl --omit test-ex
0 failures on 25 th3make runs and 112990827 tests in (11:45:29) SQLite 3.8.9 2015-04-04 16:49:04 edc1de2a588fd50c0049bb2be76d3f6783443165
drh ok+  *
d.   tclsh multitest.tcl --scenario failures - verify failures detected drh ok  *
e.   tclsh releasetest.cl --platform Failure-Detection - all failures detected drh ok  *
f.   nmake /f makefile.msc fulltestonly
0 errors out of 1163666 tests
mistachkin ok  *
g.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 fulltestonly
0 errors out of 1185414 tests
drh ok  *
h.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 fulltestonly
1 errors out of 1187629 tests - the error was selectG-100 which is a timing test that runs slow due to the configuration.
drh ok  *
i.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
j.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. mistachkin ok  *
 
11.   Tests for platform Windows (other): mistachkin ok  *
 
a.   th3make msvc.rc test.rc - Windows 7.0/8.x (x64)
Win8: 0 errors out of 5870094 tests in 2215.406 seconds SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
90701227085b8b8eb10a8eebe8d55f38b4778574, 32-bit little-endian, 0 errors out of 1450524 tests in 897.747 seconds
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM)
90701227085b8b8eb10a8eebe8d55f38b4778574, 32-bit little-endian, 0 errors out of 1450521 tests in 4976.436 seconds
mistachkin ok  *
d.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1
6868cc66d2be67b7f03776c982962ffa4b30de11, 32-bit little-endian, 0 errors out of 1450549 tests in 6764.924 seconds
mistachkin ok  *
e.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0
90701227085b8b8eb10a8eebe8d55f38b4778574, 32-bit little-endian, 0 errors out of 1449553 tests in 902.409 seconds
mistachkin ok  *
f.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1
6868cc66d2be67b7f03776c982962ffa4b30de11, 32-bit little-endian, 0 errors out of 1449582 tests in 2801.523 seconds
mistachkin ok  *
g.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well.
90701227085b8b8eb10a8eebe8d55f38b4778574, 32-bit little-endian, 0 errors out of 1453847 tests in 3082.716 seconds
mistachkin ok  *
 
12.   Tests for platform OpenBSD (x86): dan ok  *
 
a.   make test dan ok  *
b.   th3make quick.rc dan ok  *
 
13.   Tests for platform Solaris (SPARC): drh ok  *
 
a.   make test
0 errors out of 139225 tests
drh ok  *
b.   tclsh multitest.tcl --only quick
0 failures on 7 th3make runs and 11117373 tests in (03:50:25) SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
c.   Recompile and test Fossil. drh ok  *
d.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
14.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   run-all.sh - no errors drh ok  *
d.   run-all.bat - no errors drh ok  *
 
15.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Verify the correct version numbers have been installed. drh ok  *
 
16.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
 
17.   Firefox recompiled using lastest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Active use with no issues noted. drh ok  *
 
18.   CEROD tests in the "test/" subdirectory. drh ok  *
 
19.   SEE tests using TH3: drh ok  *
 
a.   see.c
Linux, memdebug.rc, 0 errors out of 7697776 tests in 4644.168 seconds, SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
b.   see-aes128-ofb.c
Win8, msvc, quick.rc, 0 errors out of 1513634 tests in 535.664 seconds SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
c.   see-aes256-ofb.c
Mac: 0 errors out of 1491193 tests in 669.860 seconds, SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c
drh ok  *
d.   see-rc4.c
/Users/dMacair: 0 errors out of 6029849 tests in 6109.230 seconds, SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c
drh ok  *
e.   see-aes128-ccm.c
0 errors out of 2023541 tests in 10161.583 seconds SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c
drh ok  *
f.   At least one of the above using "test.rc". drh ok  *
g.   At least one of the above using "memdebug.rc". drh ok  *
h.   At least one of the above on Linux. drh ok  *
i.   At least one of the above on Mac OS X. drh ok  *
j.   At least one of the above on Windows. drh ok  *
 
20.   ZIPVFS tests: drh ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.) dan ok  *
b.   th3make zipvfs.rc test.rc
Win8: 1 errors out of 6499373 tests in 2930.732 seconds SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c. The error is zipvfs1.req1_bind02.130, which is a memory sizing test. We accept that one failure.
drh ok  *
c.   th3make zipvfs.rc memdebug.rc
0 errors out of 8130445 tests in 5178.102 seconds, SQLite 3.8.9 2015-04-01 13:21:33 30011ad2f55cfcacaf23a58ebcc17b17a7b9355e
drh ok  *
d.   th3make zipvfs.rc quick.rc -valgrind
0 errors out of 2023541 tests in 10161.583 seconds ./th3: SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c
drh ok  *
e.   th3make zipvfs.rc quick.rc
Win8: 0 errors out of 2044711 tests in 542.865 seconds SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5c
drh ok  *
f.   At least one of the above on Linux. drh ok  *
g.   At least one of the above on Mac OS X.
Test "a" ran on OSX
dan ok  *
h.   At least one of the above on Windows. drh ok  *
 
21.   NX-Devkit compiles and runs tclsh th3make test.rc nx_compress.o without error.
0 errors out of 6763990 tests in 1259.341 seconds, SQLite 3.8.9 2015-04-06 11:04:51 3ad829e50faca538db3abb2afb898b5521550c5
drh ok  *
 
22.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds.
[make amalgamation-tarball] works
dan ok  *
b.   Works on Linux. dan ok  *
c.   Works on Mac OS X. dan ok  *
 
23.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac OS X dan ok  *
 
24.   Run performance tests comparing the new SQLite release against the previous release and/or a release from one year ago. Document and justify any performance decrease. drh ok  *
 
a.   The Tcl "speed*.test" scripts.
3.8.8: 23585763 uS versus trunk: 23558133 uS. Win7. Same speed.
drh ok  *
b.   The TH3 speed tests.
3.8.8: 11.09 seconds, trunk: 11.06 seconds. Same speed.
drh ok  *
c.   The "speedtest1" program.
2014-04-06: 1057330524, 3.8.8: 847537039, trunk: 846774512. 25% faster than one year ago.
drh ok+  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
3.8.8: 0.996 s. trunk: 0.958s. Same speed.
drh ok  *
e.   One or more of the above on Linux. drh ok  *
f.   One or more of the above on Windows. drh ok  *
g.   One or more of the above on Mac OS X. drh ok  *
 
25.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
26.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments. drh ok  *
 
a.   Versus the previous release.
3.8.8: 474721 versus 3.8.9: 477648. 0.6% growth.
drh ok+  *
b.   Versus the trunk from 12 months ago.
Since 2014-04-06, growth from 460031 to 477615, 3.8%
drh ok  *
 
27.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
86252a89f366f45bd14dbb159ee74f90699736c2 sqlite3.c 785192d63c444f3b85dfa47e779b5a379abdc9ac sqlite3.h
drh ok+  *
b.   Mac OS X
86252a89f366f45bd14dbb159ee74f90699736c2 sqlite3.c 785192d63c444f3b85dfa47e779b5a379abdc9ac sqlite3.h
drh ok  *
c.   OpenBSD
With [30011ad2f5] - SHA1 (sqlite3.c) = 5fb4da6984b5db72399003acd248e63938baf8d8 SHA1 (sqlite3.h) = 40d578479d0b3127195ed8e969b4eaaf3345ec46
dan ok  *
d.   Windows using native MinGW.
86252a89f366f45bd14dbb159ee74f90699736c2 sqlite3.c 785192d63c444f3b85dfa47e779b5a379abdc9ac sqlite3.h
drh ok  *
e.   Windows using NMAKE.
5fb4da6984b5db72399003acd248e63938baf8d8 sqlite3.c 40d578479d0b3127195ed8e969b4eaaf3345ec46 sqlite3.h
drh ok  *
f.   Solaris (SPARC) using autoconf.
5fb4da6984b5db72399003acd248e63938baf8d8 sqlite3.c 40d578479d0b3127195ed8e969b4eaaf3345ec46 sqlite3.h
drh ok  *
 
28.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested with backcompat.test against 3.6.4 and 3.7.3. 0 errors out of 269 tests.
dan ok  *
 
29.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database. drh ok  *
b.   32-big to 64-little, WAL. drh ok  *
c.   32-big to 64-little, rollback. drh ok  *
d.   64-little to 32-big, SEE database. drh ok  *
e.   64-little to 32-big, ZIPVFS database. drh ok  *
f.   64-little to 32-big, CEROD database. drh ok  *
 
30.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X dan ok  *
c.   Solaris (SPARC) drh ok  *
d.   Windows (MinGW) drh ok  *
e.   Windows (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables. drh ok  *
 
31.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK. drh ok  *
 
a.   tclsh th3make session.rc test.rc (on Windows)
0 errors out of 6088222 tests in 2277.180 seconds SQLite 3.8.9 2015-04-06 12:08:24 271c110bcf5bf2ea7e113dd01dec876a08e3c047
drh ok  *
b.   tclsh th3make session.rc test.rc (on Unix)
./th3: 0 errors out of 7712065 tests in 1963.829 seconds
dan ok  *
c.   tclsh th3make session.rc quick.rc -valgrind
./th3: 0 errors out of 1517653 tests in 9700.380 seconds ///// 22666== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)
dan ok  *
d.   make test (on Windows)
The first run of 10b was on the sessions branch (by mistake) so this is good.
drh ok  *
e.   make test (on Unix) dan ok  *
f.   testfixture test/session.test dan ok  *
 
32.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
33.   System.Data.SQLite builds and checks out using the SQLite core.
90701227085b8b8eb10a8eebe8d55f38b4778574, Debug NetFx40 x86: 0 errors/454 tests, 670 seconds, Release NetFx40 x86: 0 errors/454 tests, 659 seconds, Debug NetFx40 x64: 0 errors/454 tests, 734 seconds, Release NetFx40 x64: 0 errors/454 tests, 724 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok  *