SQLite 3.22.0 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. --- ---
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. --- ---
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. --- ---
c.   Review this checklist for completeness and accuracy. --- ---
 
2.   Source code change review. fossil diff --from release --to trunk --- ---
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. --- ---
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. --- ---
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
l.   Compare sqlite3.c and sqlite3.h against the previous release. drh ok  *
 
3.   Documentation review: --- ---
 
a.   Latest release on the "index.html" page. --- ---
b.   Release announcement in "changes.in". --- ---
c.   Release accouncement in "news.html". --- ---
d.   No unresolved hyperlinks in the documentation build. --- ---
e.   Requirements marks are up-to-date in both documentation and source code. --- ---
f.   The compile-time options are all up-to-date (compile.html). --- ---
g.   Database footprint is up-to-date (features.html). --- ---
h.   Test metrics are up-to-date (testing.html). --- ---
i.   Check new/changed documentation for spelling and gramatical mistakes. --- ---
 
4.   Compiler warning checks. --- ---
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 (nmake /f makefile.msc) --- ---
e.   Windows (64-bit) MSVC using option /W4 (nmake /f makefile.msc) --- ---
 
5.   OMIT, ENABLE, and DISABLE options: dan ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a
Building with SQLITE_ENABLE_LOCKING_STYLE fails on Linux. All other configurations build successfully.
dan ok  *
 
6.   Tests for platform Linux x86_64: --- ---
 
a.   tclsh multitest.tcl (take care to update ../th3private)
0 failures on 44 th3makes and 196653085 tests in (05:53:26) 3 cores on bella • SQLite 3.22.0 2018-01-17 21:14:17 469b96be5350ba2291518280ffe179b87aa7fbe701e2813ef63843922771517a
drh ok  *
b.   tclsh releasetest.tcl --- ---
c.   tclsh multitest.tcl --scenario failures - all failures detected --- ---
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected --- ---
e.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc
th3: 0 errors in 1609336 tests. 4922.658 seconds on beaglebone 32-bit little-endian (SQLite 3.22.0 2018-01-17 13:15:23 bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b36e66)
dan ok  *
b.   Recompile and test Fossil.
[fossil all rebuild] works. [fossil up http://www.sqlite.org/src] works. (fossil version 2.5 [6e694cd37b] 2018-01-17 01:11:19 UTC)
dan ok+  *
 
8.   Tests for platform Mac OS X: drh ok  *
 
a.   tclsh releasetest.tcl
0 failures out of 4934137 tests in (03:05:23) 2 cores on macpro01 • SQLite 3.22.0 2018-01-17 16:11:26 a8aea925f8fde8f2dc5ff4b744d54aa2bf8916f3ee57f22d77fd1ddb5a35a9cc
drh ok  *
b.   tclsh multitest.tcl (after updating th3private)
0 failures on 39 th3makes and 159334683 tests in (10:19:06) 3 cores on macpro01 • SQLite 3.22.0 2018-01-17 21:14:17 469b96be5350ba2291518280ffe179b87aa7fbe701e2813ef63843922771517a
drh ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   .selftest checks (see below) drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows: --- ---
 
a.   tclsh multitest.tcl --msvc (after updating th3private)
0 failures on 38 th3makes and 149502180 tests in (10:29:10) 3 cores on Lenovo-Win10 • SQLite 3.22.0 2018-01-17 21:14:17 469b96be5350ba2291518280ffe179b87aa7fbe701e2813ef63843922771517a
drh ok  *
b.   tclsh multitest.tcl --msvc --quick on x86 --- ---
c.   tclsh multitest.tcl --msvc --scenario failures - verify failures detected --- ---
d.   tclsh test/releasetest.tcl --msvc
0 failures out of 1976638 tests in (02:13:33) 2 cores on Lenovo-Win10 • SQLite 3.22.0 2018-01-17 01:40:57 3e04999dabb87715de46255b1a9b08d5dfa70d140e0a09a37ea2842d71c77caf
drh ok  *
e.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected --- ---
f.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 test drh ok  *
g.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 test drh ok  *
h.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies --- ---
i.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. --- ---
 
11.   Tests for platform OpenBSD (x86): --- ---
 
a.   make test drh ok  *
b.   th3make quick.rc --- ---
 
12.   ON an F2FS filesystem with the F2FS_FEATURE_ATOMIC_WRITE feature, test with: $(TOP)/configure && make test OPTS="-DSQLITE_ENABLE_BATCH_ATOMIC_WRITE -DSQLITE_DEBUG -DSQLITE_NO_SYNC"
(0 errors out of 141482 tests on darkstar Linux 64-bit little-endian) SQLite 2018-01-17 13:15:23 bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b3alt1
dan ok  *
 
13.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 797 seconds
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 2291 seconds
drh ok  *
 
14.   Build using the configure/make in main source tree. --- ---
 
a.   Make sure that autoconf has been run to update the configure script. --- ---
b.   Verify the correct version numbers have been installed. --- ---
 
15.   Fossil updated to use the latest SQLite. --- ---
 
a.   No SQLite compiler warnings. --- ---
b.   Used on active websites with no issues. --- ---
c.   fossil all dbstat --db-check --- ---
 
16.   Rebuild and use Firefox with the latest SQLite drh ok  *
 
a.   Routine use with no problems drh ok  *
b.   ./mach mochitest dom/indexedDB drh ok  *
c.   ./mach xpcshell-test dom/indexedDB drh ok  *
d.   ./mach web-platform-tests IndexedDB drh ok  *
 
17.   CEROD tests in the "test/" subdirectory. --- ---
 
18.   SEE tests using TH3: --- ---
 
a.   see.c --- ---
b.   see-aes128-ofb.c --- ---
c.   see-aes256-ofb.c --- ---
d.   see-rc4.c --- ---
e.   see-aes128-ccm.c --- ---
f.   see-cccrypt.c --- ---
g.   At least one of the above using "test.rc". --- ---
h.   At least one of the above using "memdebug.rc". --- ---
i.   At least one of the above on Linux. --- ---
j.   At least one of the above on Mac OS X. --- ---
k.   At least one of the above on Windows. --- ---
 
19.   SEE using configure; make test --- ---
 
a.   Linux --- ---
b.   Mac --- ---
 
20.   ZIPVFS tests: --- ---
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt for details)
0 errors out of 78630 tests on darkstar Linux 64-bit little-endian (SQLite 2018-01-17 13:15:23 bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b3alt1)
dan ok  *
b.   th3make zipvfs.rc test.rc --- ---
c.   th3make zipvfs.rc memdebug.rc --- ---
d.   th3make zipvfs.rc quick.rc -valgrind
No valgrind errors. th3: 0 errors in 2840112 tests. 53456.708 seconds on darkstar 64-bit little-endian (th3: SQLite 3.22.0 2018-01-17 13:15:23 bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b3alt1)
dan ok  *
e.   th3make zipvfs.rc quick.rc
th3: 0 errors in 2841446 tests. 473.379 seconds on darkstar 64-bit little-endian (SQLite 3.22.0 2018-01-17 13:15:23 bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b3alt1)
dan ok  *
f.   At least one of the above on Linux.
(e) and (a) passed on Linux
dan ok  *
g.   At least one of the above on Mac OS X. --- ---
h.   At least one of the above on Windows. --- ---
i.   th3make zipvfs-cov.rc - verify full coverage --- ---
 
21.   NDS-Devkit testing --- ---
 
a.   Verify that devkit sources are up-to-date with SQLite and ZIPVFS by running update-src.sh and mkdevkit.tcl in the sbin subdirectory of the devkit source tree. Record nds_sqlite3.[ch] hashes in the comment. --- ---
b.   Test using: tclsh th3make test.rc nds_devkit.rc --- ---
c.   Verify the "NDS DevKit" version number shown at the end of the test --- ---
 
22.   Amalgamation autoconf tarball. --- ---
 
a.   Builds. drh ok  *
b.   Works on Linux.
Picks up zlib
drh ok+  *
c.   Works on Mac OS X.
picks up zlib
drh ok+  *
d.   Works on Windows MinGW
Picks up zlib
drh ok  *
e.   Works on Windows MSVC --- ---
 
23.   TEA archive builds correctly and runs: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
 
24.   Performance tests using speedtest1 compared against the previous release and a release from about one year ago. --- ---
 
a.   Android --- ---
b.   Linux --- ---
c.   Mac --- ---
d.   Windows --- ---
 
25.   Performance tests using speedtest1 --testset rtree --- ---
 
a.   Linux --- ---
b.   Windows --- ---
 
26.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
27.   Compare performance to the previous release using kvtest. --- ---
 
a.   Android --- ---
b.   Linux --- ---
c.   Mac --- ---
d.   Windows --- ---
 
28.   Use the ".selftest" command of the shell to verify that legacy database files are readable and cross-platform drh ok  *
 
a.   iBook PPC drh ok  *
b.   Linux drh ok  *
c.   Mac drh ok  *
d.   Windows drh ok  *
 
29.   Verify that the performance and size measurement spreadsheet in the documentation (misc/speed-size-graph.ods) is up-to-date. drh ok  *
 
30.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
7bd685ecba923bf830ac932209f791e9fd1449b02876b9ed35daeb98caa41678 sqlite3.c • f0024df899ca7eaa298b729c0b6db81c382d5c7490d8ebb14412b4b2524f8e5f sqlite3.h
drh ok  *
b.   Mac OS X
7bd685ecba923bf830ac932209f791e9fd1449b02876b9ed35daeb98caa41678 sqlite3.c • f0024df899ca7eaa298b729c0b6db81c382d5c7490d8ebb14412b4b2524f8e5f sqlite3.h
drh ok  *
c.   Windows using native MinGW.
7bd685ecba923bf830ac932209f791e9fd1449b02876b9ed35daeb98caa41678 sqlite3.c • f0024df899ca7eaa298b729c0b6db81c382d5c7490d8ebb14412b4b2524f8e5f sqlite3.h
drh ok  *
d.   Windows using NMAKE.
7bd685ecba923bf830ac932209f791e9fd1449b02876b9ed35daeb98caa41678 sqlite3.c • f0024df899ca7eaa298b729c0b6db81c382d5c7490d8ebb14412b4b2524f8e5f sqlite3.h
drh ok  *
 
31.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa. --- ---
 
32.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Windows (MinGW) drh ok  *
d.   Windows (MSVC) drh ok  *
e.   A database containing WITHOUT ROWID tables. drh ok  *
 
33.   Build and verify sqldiff drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Windows drh ok  *
 
34.   Run the rbu/run_rbu_tests.tcl script in the test-dbs project on Linux. --- ---
 
35.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
36.   Website built procedures --- ---
 
a.   Compile-time options for build products have been updated as necessary --- ---
b.   All build products work on their target platforms --- ---