SQLite 3.8.3 Status Board

History    Checklist    Baseline

 
1.   Compiler warning checks. (Warnings in the Porter stemmer code are allowed.) drh ok  *
 
a.   Linux GCC -Wall -Wextra (the tool/warnings.sh script)
gcc 4.8.1 gives spurious array bounds warnings with -O3 but is clean with -O0. gcc 4.6.3 is clean in all configurations.
drh ok  *
b.   Mac GCC -Wall -Wextra (the tool/warnings.sh script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows MSVC Win32 /W3 drh ok  *
e.   Windows MSVC Win64 /W3 drh ok  *
f.   sh tool/warnings-clang.sh
clang 3.4 gives many spurious warnings. clang 3.0 gives only two. The quality of analysis from clang seems to be on the decline. We may need to drop this item from the checklist.
drh ok  *
 
2.   Documentation checks: drh ok  *
 
a.   Latest release on the index.html page drh ok  *
b.   Release announcement in changes.in drh ok  *
c.   Release accouncement in news.html drh ok  *
d.   No unresolved hyperlinks in the documentation build drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code drh ok  *
f.   The compile-time options are all up-to-date (compile.html) drh ok  *
g.   Database footprint is up-to-date (features.html) drh ok  *
h.   Test metrics are up-to-date (testing.html) drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes drh ok  *
 
3.   Source code change review. "fossil diff --from release --to trunk" drh ok  *
 
a.   No stray changes drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation drh ok  *
c.   New code complies with style guidelines drh ok  *
d.   New code complies with design rules drh ok  *
e.   Comments have been updated to reflect code changes drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use drh ok  *
g.   Check all multiplications, and especially those involving the offset parameters to sqlite3OsRead() and sqlite3OsWrite() or having operands pageSize or szPage to make sure that 32x32-bit multiplicates that intend to yield a 64-bit result do not instead truncate to 32-bits. drh ok  *
h.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
i.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h) drh ok  *
 
4.   OMIT, ENABLE, and DISABLE options: dan ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run dan ok  *
 
5.   Tests for platform Linux x86: dan ok  *
 
a.   tclsh releasetest.tcl dan ok  *
b.   tclsh th3make cov.rc (verify 100% branch test coverage) dan ok  *
c.   tclsh fulltest.tcl fast.rc test.rc dan ok  *
d.   tclsh th3make fast-ex.rc dan ok  *
 
6.   Tests for platform Linux x86_64: dan ok  *
 
a.   tclsh th3make cov.rc (verify 100% branch test coverage)
0 errors out of 1368417 tests in 19 configurations, i7 x64.
drh ok  *
b.   tclsh th3make cov.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE (verify 100% branch test coverage)
0 errors out of 1366028 tests in 19 configurations, "tallis"
drh ok  *
c.   tclsh th3make cov.rc -DSQLITE_ENABLE_STAT4 (verify 100% branch test coverage)
0 errors out of 1448397 tests in 19 configurations
drh ok  *
d.   tclsh releasetest.tcl dan ok  *
e.   tclsh fulltest.tcl fast.rc test.rc
0 errors out of 77,080,687 tests, 330 configurations, and 10 alignment.
drh ok  *
f.   tclsh th3make memdebug.rc dan ok  *
g.   tclsh th3make test-ex.rc dan ok  *
h.   tclsh th3make test.rc CC=clang dan ok  *
i.   tclsh th3make fast.rc CC=clang dan ok  *
j.   ./mptester x.db mptest/crash01.test dan ok  *
k.   ./mptester x.db mptest/multiwrite01.test dan ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) drh ok  *
 
a.   tclsh th3make min.rc
0 errors out of 1374991 tests in 19 configurations
drh ok  *
 
8.   Tests for platform Mac OS-X x86: dan ok  *
 
a.   tclsh releasetest.tcl dan ok  *
b.   tclsh fulltest.tcl fast.rc test.rc dan ok  *
c.   tclsh th3make fast.rc CC=clang dan ok  *
d.   ./mptester x.db mptest/crash01.test dan ok  *
e.   ./mptester x.db mptest/multiwrite01.test dan ok  *
 
9.   Tests for platform MacOS 10.2 PPC: drh ok  *
 
a.   tclsh th3make -Os min.rc drh ok  *
b.   Recompile and test Fossil drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Win32/64: mistachkin ok  *
 
a.   make fulltestonly
0 errors out of 1,143,593 tests. MSVC-64 on Win8
drh ok  *
b.   th3make test.rc
0 errors out of 5688300 tests in 27 configurations. Win8
drh ok  *
c.   th3make fast.rc
0 errors out of 5693345 tests
drh ok  *
d.   At least one of the above using MinGW drh ok  *
e.   At least one of the above using MSVC-32 drh ok  *
f.   At least one of the above using MSVC-64 drh ok  *
g.   At least one of the above on WinRT (x86) mistachkin ok  *
h.   At least one of the above on WinRT (ARM) mistachkin ok  *
i.   At least one of the above on Windows Phone mistachkin ok  *
j.   At least one of the above on Windows Embedded Compact 2013 mistachkin ok  *
k.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. mistachkin ok  *
l.   th3make msvc.rc test.rc /RTC1
0 errors out of 5688303 tests. msvc-32 on win8.
drh ok  *
m.   mptester x.db mptest/crash01.test drh ok  *
n.   mptester x.db mptest/multiwrite01.test drh ok  *
 
11.   Tests for platform Android: dan ok  *
 
a.   th3make -Os min.rc dan ok  *
 
12.   Tests for platform OpenBSD x86: dan ok  *
 
a.   make test dan ok  *
b.   th3make -Os min.rc dan ok  *
 
13.   Tests for platform Solaris Sparc: drh ok  *
 
a.   make test
0 errors out of 136429 tests
drh ok  *
b.   th3make test.rc
0 errors out of 7256279 tests in 33 configurations
drh ok  *
c.   th3make fast.rc
0 errors out of 7256286 tests in 33 configurations
drh ok  *
d.   Recompile and test Fossil drh ok  *
e.   Verify that Fossil repositories are cross-platform with x86/x64 drh ok  *
 
14.   Other test performed on any available platform: drh ok  *
 
a.   th3make alignment2.rc test.rc
0 errors out of 5483998 tests in 33 configurations
drh ok  *
b.   th3make test.rc -DHAVE_LOCALTIME_R
0 errors out of 7504579 tests in 33 configurations, tallis
drh ok  *
c.   th3make test.rc -DSQLITE_THREADSAFE=0
0 errors out of 7483515 tests in 33 configurations, bella
drh ok  *
d.   th3make test.rc -ftrapv
0 errors out of 7504581 tests in 33 configurations on "bella"
drh ok  *
e.   OPTS=-DSQLITE_SMALL_STACK make sqlite3.c; th3make test.rc -DSQLITE_SMALL_STACK
0 errors out of 7517535 tests in 33 configurations, bella
drh ok  *
f.   th3make test.rc CC=clang -fsanitize=undefined
0 errors out of 7504582 tests in 33 configurations, Linux x64, clang 3.4-1ubuntu1
drh ok  *
g.   th3make test.rc -DSQLITE_MAX_ATTACHED=62
0 errors out of 7504574 tests in 33 configurations on "bella"
drh ok  *
h.   th3make min.rc -Os -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
0 errors out of 1368245 tests in 19 configurations, no valgrind warnings, on "tallis"
drh ok  *
i.   th3make min.rc -Os -DTH3_LOWMEM -DTH3_OMIT_MISUSE -DSQLITE_ENABLE_STAT4; valgrind ./th3
0 errors out of 1448225 tests in 19 configurations, no valgrind warnings, on "bella".
drh ok  *
j.   valgrind testfixture permutations.test valgrind
21 valgrind warnings, but all were legitimate, arising from "misuse" cases.
drh ok  *
k.   th3make cov.rc -DSQLITE_TRACE_SIZE_LIMIT=15 (verify coverage)
0 errors out of 1368445 tests in 19 configurations, 100% coverage. "tallis"
drh ok  *
l.   th3make min.rc -DSQLITE_TRACE_SIZE_LIMIT=15 -O6
0 errors out of 1368385 tests in 19 configurations, "tallis"
drh ok  *
 
15.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation drh ok  *
b.   No compiler warnings drh ok  *
c.   run-all.sh with no errors
0 errors out of 17,819,637 tests.
drh ok  *
d.   run-all.bat with no errors drh ok  *
 
16.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Run "make test" to verify that the build works.
On solaris
drh ok  *
c.   Verify the correct version numbers have been installed. drh ok  *
d.   Verify that the --disable-amalgamation option to configure works. drh ok  *
e.   Works on Linux drh ok  *
f.   Works on Mac
0 errors out of 136368 tests. Mac OS 10.6.8
drh ok  *
g.   Works on OpenBSD
percentile-2.1.50 gives 2749999.50004681 instead of just 2749999.5. All other tests pass.
drh ok  *
h.   Works on Solaris drh ok  *
 
17.   Exported symbol checks: tool/symbols.sh drh ok  *
 
a.   No private symbols exported. (This is also checked by releasetest.tcl) drh ok  *
b.   No undesirable library dependencies drh ok  *
c.   No private symbols exported in MinGW (check using tool/symbols-mingw.sh) drh ok  *
d.   No undesirable library dependencies on MinGW drh ok  *
 
18.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No compiler warnings drh ok  *
b.   Used on active websites with no issues drh ok  *
 
19.   Firefox recompiled using lastest SQLite. drh ok  *
 
a.   No SQLite compiler warnings drh ok  *
b.   Active use with no issues noted drh ok  *
 
20.   CEROD tests in the test/ subdirectory. drh ok  *
 
21.   SEE tests using TH3: drh ok  *
 
a.   see.c drh ok  *
b.   see-aes128-ofb.c drh ok  *
c.   see-aes256-ofb.c drh ok  *
d.   see-rc4.c drh ok  *
e.   see-aes128-ccm.c drh ok  *
f.   At least one of the above using test.rc drh ok  *
g.   At least one of the above using memdebug.rc drh ok  *
h.   At least one of the above on Linux drh ok  *
i.   At least one of the above on Mac drh ok  *
j.   At least one of the above on Windows drh ok  *
 
22.   ZIPVFS tests: dan ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.) dan ok  *
b.   th3make zipvfs.rc test.rc dan ok  *
c.   th3make zipvfs.rc memdebug.rc dan ok  *
d.   th3make zipvfs.rc min.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3 dan ok  *
e.   th3make min.rc dan ok  *
f.   At least one of the above on Linux dan ok  *
g.   At least one of the above on Mac dan ok  *
h.   At least one of the above on Windows
0 errors out of 1842576 tests. min.rc, msvc-32 on win8.
drh ok  *
 
23.   NX-Devkit compiles and runs "tclsh th3make test.rc nx_compress.o" without error.
0 errors out of 6580681 tests in 31 configurations. "bella"
drh ok  *
 
24.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds dan ok  *
b.   Works on Linux dan ok  *
c.   Works on Mac dan ok  *
 
25.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac dan ok  *
 
26.   Run performance tests comparing the new SQLite release against the previous release and a release from one year ago. Document and justify any performance decrease. drh ok  *
 
a.   The TCL speed*.test scripts
speedp.test and speed4.test both show 3.8.3 as 3-4% faster (wall-clock time) than 3.8.2.
dan ok+  *
b.   The TH3 speed tests
3.8.2: 17.467 seconds (wall clock time) vs. 3.8.3: 17.110. 2.0% faster. Mac OS 10.6.8
drh ok  *
c.   The speedtest1 program
1,056,355,823 cycles for 3.8.2 versus 990,753,314 cycles for 3.8.3, measured by valgrind. 6.2% faster
drh ok  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
3.8.2: 2.805s versus 3.8.3: 2.657s on win8 with msvc-32. 5.3% faster
drh ok  *
e.   One or more of the above on linux drh ok  *
f.   One or more of the above on windows drh ok  *
g.   One or more of the above on mac drh ok  *
 
27.   Run "make wordcount; bash run-wordcount.bash $OPTIONS" with options: drh ok  *
 
a.   sqlite3.c drh ok  *
b.   sqlite3.c --cachesize 5 --nosync drh ok  *
 
28.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments drh ok  *
 
a.   Versus the previous release
3.8.2: 436911 bytes. 3.8.3: 437417 bytes. gcc 4.8.1 on x64.
drh ok+  *
b.   Versus the trunk from 12 months ago
trunk:2013-01-02: 413917 bytes. 3.8.3: 437417 bytes. 5.7% larger
drh ok  *
 
29.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   linux drh ok  *
b.   mac drh ok  *
c.   openbsd drh ok  *
d.   windows native mingw drh ok  *
e.   windows nmake drh ok  *
f.   sparc solaris using autoconf drh ok  *
 
30.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa. dan ok  *
 
31.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database drh ok  *
b.   32-big to 64-little, WAL drh ok  *
c.   32-big to 64-little, rollback drh ok  *
d.   64-little to 32-big, SEE database drh ok  *
e.   64-little to 32-big, ZIPVFS database drh ok  *
f.   64-little to 32-big, CEROD database drh ok  *
 
32.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Sparc Solaris drh ok  *
d.   Win32 (MinGW) drh ok  *
e.   Win32 (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables drh ok  *
 
33.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK drh ok  *
 
a.   tclsh th3make session.rc test.rc (on windows)
0 errors out of 5677702 tests. msvc-32 on win8.
drh ok  *
b.   tclsh th3make session.rc test.rc (on unix) dan ok  *
c.   tclsh th3make session.rc cov.rc dan ok  *
d.   tclsh th3make session.rc min.rc -norun -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3 dan ok  *
e.   make test (on windows) drh ok  *
f.   make test (on unix) drh ok  *
g.   testfixture test/session.test dan ok  *
 
34.   Verify that the sqlite3-all.c build target works and that the resulting sqlite3-all.c file and its include files (sqlite3-?.c) compile and run the same as the single-file amalgamation. drh ok  *
 
35.   System.Data.SQLite builds and checks out using the SQLite core
netfx40, debug, release, netCF 2.0/3.5 (x86 & x64) OK
mistachkin ok  *