SQLite 3.8.7.1 Status Board

History    Checklist    Baseline

This is an abbreviated set of tests since the change from 3.8.7 are very small (see [1]) and because the one of the patches has already been tested in the 3.8.6.1 release.

 
1.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the tool/warnings.sh script)
The usual false-positives with -O3. No warnings with -O0
drh ok  *
b.   Mac GCC -Wall -Wextra (the tool/warnings.sh script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows MSVC Win32 /W3 drh ok  *
e.   Windows MSVC Win64 /W3 drh ok  *
f.   sh tool/warnings-clang.sh
The usual false-positives.
drh ok  *
 
2.   Documentation checks: drh ok  *
 
a.   Latest release on the index.html page drh ok  *
b.   Release announcement in changes.in drh ok  *
c.   Release accouncement in news.html drh ok  *
d.   No unresolved hyperlinks in the documentation build drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code drh ok  *
f.   The compile-time options are all up-to-date (compile.html) drh ok  *
g.   Check new/changed documentation for spelling and gramatical mistakes drh ok  *
 
3.   Source code change review. "fossil diff --from version-3.8.7 --to branch-3.8.7" drh ok  *
 
a.   No stray changes drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation drh ok  *
c.   New code complies with style guidelines drh ok  *
d.   New code complies with design rules drh ok  *
e.   Comments have been updated to reflect code changes drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h) drh ok  *
 
4.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a
ENABLE_LOCKING_STYLE does not work on linux. All else is OK.
drh ok  *
 
5.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh th3make cov.rc (verify 100% branch test coverage)
0 errors out of 1374851 tests in 191.170 seconds, 100% coverage, bella
drh ok  *
b.   tclsh th3make cov.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE (verify 100% branch test coverage)
0 errors out of 1372352 tests in 193.502 seconds, 100% coverage, bella
drh ok  *
c.   tclsh th3make cov.rc -DSQLITE_ENABLE_STAT4 (verify 100% branch test coverage)
0 errors out of 1451840 tests in 230.451 seconds, 100% coverage, bella
drh ok  *
d.   tclsh releasetest.tcl drh ok  *
e.   tclsh fulltest.tcl fast.rc test.rc
0 errors out of 7591247 tests in 1591.027 seconds, tallis
drh ok  *
f.   tclsh th3make memdebug.rc
0 errors out of 7563407 tests in 3355.000 seconds, bella
drh ok  *
g.   tclsh th3make test-ex.rc
16 errors out of 18054882 tests in 20590.825 seconds, bella. All errors are hlr10000.1.1 which was expecting 3.8.7.1 but got 3.8.7. This is a test case problem.
drh ok  *
h.   tclsh th3make test.rc CC=clang
0 errors out of 7590967 tests in 1765.669 seconds
drh ok  *
i.   tclsh th3make fast.rc CC=clang
0 errors out of 7387434 tests in 878.547 seconds
drh ok  *
j.   ./mptester x.db mptest/crash01.test
0 errors in 94 tests
drh ok  *
k.   ./mptester x.db mptest/multiwrite01.test
0 errors in 76 tests
drh ok  *
 
6.   Tests for 32-bit x86 Linux drh ok  *
 
a.   tclsh th3make test.rc -m32
0 errors out of 7591247 tests in 1591.027 seconds, bella
drh ok  *
b.   tclsh th3make test.rc CC=clang -m32
0 errors out of 7591434 tests in 1748.144 seconds, bella
drh ok  *
c.   tclsh th3make quick.rc -m32
0 errors out of 1455670 tests in 144.288 seconds
drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) drh ok  *
 
a.   tclsh th3make min.rc
0 errors out of 1378499 tests in 3153.523 seconds
drh ok  *
b.   Recompile and test Fossil drh ok  *
 
8.   Tests for platform Mac OS-X x86: dan ok  *
 
a.   tclsh releasetest.tcl dan ok  *
b.   tclsh fulltest.tcl min.rc
0 errors out of 7214772 tests in 3696.940 seconds
drh ok  *
c.   tclsh th3make fast.rc CC=clang
0 errors out of 5797056 tests in 2429.334 seconds
drh ok  *
d.   ./mptester x.db mptest/crash01.test
Summary: 0 errors in 94 tests
drh ok  *
e.   ./mptester x.db mptest/multiwrite01.test
Summary: 0 errors in 76 tests
drh ok  *
 
9.   Tests for platform Win32/64: drh ok  *
 
a.   make fulltestonly
0 errors out of 1167021 tests, msvc64, win8
drh ok  *
b.   th3make test.rc
0 errors out of 5767926 tests in 2161.334 seconds. msvc64, win8.
drh ok  *
c.   th3make fast.rc
0 errors out of 5819986 tests in 3089.434 seconds. mingw, win7.
drh ok  *
d.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
e.   th3make msvc.rc test.rc /RTC1
8 errors out of 5768078 tests in 3108.785 seconds. Errors are req1_malloc02.3?? and result from sqlite3_msize() always returning exactly the number of bytes requested when /RTC1 is used.
drh ok  *
f.   mptester x.db mptest/crash01.test
0 errors out of 94 tests
drh ok  *
g.   mptester x.db mptest/multiwrite01.test
0 errors out of 76 tests
drh ok  *
h.   nmake /f makefile.msc DEBUG=2 test
0 errors out of 163785 tests
drh ok  *
 
10.   Tests for platform Android: dan ok  *
 
a.   th3make quick.rc
./th3: architecture: 32-bit little-endian,./th3: 0 errors out of 1455628 tests in 2061.901 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
 
11.   Tests for platform OpenBSD x86: drh ok  *
 
a.   make test
1 errors out of 137108 tests Failures on these tests: percentile-2.1.50
drh ok  *
 
12.   Tests for platform Solaris Sparc: drh ok  *
 
a.   th3make fast.rc
0 errors out of 7393336 tests in 6708.388 seconds
drh ok  *
 
13.   Other test performed on any available platform: drh ok  *
 
a.   th3make alignment2.rc test.rc
requires that sqlite3.c be built with SQLITE_ENABLE_UPDATE_DELETE_LIMIT, ./th3: 0 errors out of 5443918 tests in 1224.700 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
b.   th3make test.rc -DHAVE_LOCALTIME_R
./th3: 0 errors out of 7591291 tests in 1854.328 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
c.   th3make test.rc -DSQLITE_THREADSAFE=0
./th3: 0 errors out of 7534434 tests in 1410.639 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
d.   th3make test.rc -ftrapv
0 errors out of 7591089 tests in 1744.290 seconds, bella
drh ok  *
e.   OPTS=-DSQLITE_SMALL_STACK make sqlite3.c; th3make test.rc -DSQLITE_SMALL_STACK
./th3: 0 errors out of 7604127 tests in 1788.529 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
f.   th3make test.rc CC=clang -fsanitize=undefined
0 errors out of 7591467 tests in 5455.491 seconds, bella
drh ok  *
g.   th3make test.rc -DSQLITE_MAX_ATTACHED=125
0 errors out of 5951796 tests in 4445.453 seconds, iMac
drh ok  *
h.   th3make quick.rc -valgrind
0 errors out of 1450988 tests in 10914.446 seconds, no valgrind warnings or errors, tallis
drh ok  *
i.   th3make quick.rc -DSQLITE_ENABLE_STAT4 -valgrind
0 errors out of 1533874 tests in 12921.007 seconds, no valgrind problems, tallis
drh ok  *
j.   th3make quick.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE -valgrind
0 errors out of 1451035 tests in 6974.914 seconds, no valgrind errors or warnings, bella.
drh ok  *
k.   valgrind testfixture permutations.test valgrind
0 errors out of 96702 tests, no valgrind errors or warnings, bella
drh ok  *
l.   th3make quick.rc -DSQLITE_TRACE_SIZE_LIMIT=15
./th3: 0 errors out of 1451108 tests in 192.762 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
m.   th3make quick.rc -funsigned-char
0 errors out of 1446959 tests in 595.784 seconds
drh ok  *
n.   th3make quick.rc -fsigned-char
0 errors out of 1462773 tests in 702.517 seconds, mingw, win7.
drh ok  *
o.   th3make quick.rc -DSQLITE_ENABLE_MEMSYS5 -DTH3_LOWMEM
./th3: 0 errors out of 1382017 tests in 174.177 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
p.   th3make quick.rc -DSQLITE_ENABLE_RTREE -DSQLITE_ENABLE_FTS4
./th3: 0 errors out of 1481812 tests in 206.512 seconds, ./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
q.   th3make quick.rc -DSQLITE_TEST_REALLOC_STRESS
0 errors out of 1689786 tests in 739.008 seconds, iMac
drh ok  *
r.   th3make test.rc ../th3private/*.test
0 errors out of 454 tests in 23.591 seconds, iMac
drh ok  *
s.   ./configure; make fulltest
0 errors out of 2538074 tests, bella
drh ok  *
 
14.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation drh ok  *
b.   No compiler warnings drh ok  *
c.   run-all.sh with no errors drh ok  *
 
15.   Build using the configure/make in main source tree. dan ok  *
 
a.   Make sure that autoconf has been run to update the configure script. dan ok  *
b.   Run "make test" to verify that the build works. dan ok  *
c.   Verify the correct version numbers have been installed. dan ok  *
d.   Verify that the --disable-amalgamation option to configure works. dan ok  *
e.   Works on Linux dan ok  *
 
16.   Exported symbol checks: tool/symbols.sh drh ok  *
 
a.   No private symbols exported. (This is also checked by releasetest.tcl) drh ok  *
b.   No undesirable library dependencies drh ok  *
c.   No private symbols exported in MinGW (check using tool/symbols-mingw.sh) drh ok  *
d.   No undesirable library dependencies on MinGW drh ok  *
 
17.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No compiler warnings drh ok  *
b.   Used on active websites with no issues drh ok  *
 
18.   Firefox recompiled using lastest SQLite. drh ok  *
 
a.   No SQLite compiler warnings drh ok  *
b.   Active use with no issues noted drh ok  *
 
19.   CEROD tests in the test/ subdirectory. drh ok  *
 
20.   SEE tests using TH3: drh ok  *
 
a.   see.c
quick.rc on bella. 0 errors out of 1435306 tests in 199.611 seconds
drh ok  *
 
21.   ZIPVFS tests: dan ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.) dan ok  *
b.   th3make zipvfs.rc test.rc
./th3: SQLite 3.8.7.1 2014-10-29 01:27:43 83afe23e553e802c0947c80d0ffdd120423e7c52
dan ok  *
 
22.   NX-Devkit compiles and runs "tclsh th3make test.rc nx_compress.o" without error.
0 errors out of 6638143 tests in 1234.727 seconds, bella
drh ok  *
 
23.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds dan ok  *
b.   Works on Linux dan ok  *
c.   Works on Mac dan ok  *
 
24.   Run performance tests comparing the new SQLite release against the previous release. drh ok  *
 
a.   The speedtest1 program
0.031% slower. 58 bytes larger
drh ok  *
 
25.   Run "make wordcount; bash run-wordcount.bash $OPTIONS" with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
26.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   linux
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
b.   mac
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
c.   openbsd
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
d.   windows native mingw
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
e.   windows nmake
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
f.   sparc solaris using autoconf
1f45625df220822ada445e22a97ab46bedbfa358 sqlite3.c a79fdd57615753461da56efb1cb1e4017d556def sqlite3.h
drh ok  *
 
27.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Win32 drh ok  *
 
28.   Verify that the sqlite3-all.c build target works and that the resulting sqlite3-all.c file and its include files (sqlite3-?.c) compile and run the same as the single-file amalgamation. drh ok  *