SQLite 3.8.6 Status Board

History    Checklist    Baseline

 
1.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the tool/warnings.sh script)
False-positive "array subscript is above array bounds" when using -O3. There are compiler bugs. No other warnings.
drh ok  *
b.   Mac GCC -Wall -Wextra (the tool/warnings.sh script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows MSVC Win32 /W3 drh ok  *
e.   Windows MSVC Win64 /W3 drh ok  *
f.   sh tool/warnings-clang.sh drh ok  *
 
2.   Documentation checks: drh ok  *
 
a.   Latest release on the index.html page drh ok  *
b.   Release announcement in changes.in drh ok  *
c.   Release accouncement in news.html drh ok  *
d.   No unresolved hyperlinks in the documentation build drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code drh ok  *
f.   The compile-time options are all up-to-date (compile.html) drh ok  *
g.   Database footprint is up-to-date (features.html) drh ok  *
h.   Test metrics are up-to-date (testing.html) drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes drh ok  *
 
3.   Source code change review. "fossil diff --from release --to trunk" drh ok  *
 
a.   No stray changes drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation drh ok  *
c.   New code complies with style guidelines drh ok  *
d.   New code complies with design rules drh ok  *
e.   Comments have been updated to reflect code changes drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h) drh ok  *
 
4.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a
As expected, SQLITE_ENABLE_LOCKING_STYLE failed. Tested with gcc 4.7.1.
dan ok  *
 
5.   Tests for platform Linux x86: dan ok  *
 
a.   tclsh releasetest.tcl
[d46adf9d8f] passes on "Linux cyril 3.11.0-26-generic"
dan ok  *
b.   tclsh th3make cov.rc (verify 100% branch test coverage)
A branch at http://www.sqlite.org/src/artifact/d90a1e8acf8b6?ln=446 was not exercised.
dan review  *
c.   tclsh fulltest.tcl fast.rc test.rc
Passed on "cyril". The test.rc/c1.cfg test was rerun due to mysterious SQLITE_READONLY errors showing up the first time.
dan ok  *
d.   tclsh th3make fast-ex.rc
32-bit little-endian, 0 errors out of 17970883 tests in 17 configurations, SQLite 3.8.6 2014-08-14 19:53:37 3f45b8192dad7fb1f027cbaa694046e3c1b3e278
dan ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh th3make cov.rc (verify 100% branch test coverage)
0 errors out of 1390115 tests on "bella"
drh ok  *
b.   tclsh th3make cov.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE (verify 100% branch test coverage)
0 errors out of 1387786 tests in 3m35.954s on "bella"
drh ok  *
c.   tclsh th3make cov.rc -DSQLITE_ENABLE_STAT4 (verify 100% branch test coverage)
0 errors out of 1459212 tests, 100% coverage, on "bella"
drh ok  *
d.   tclsh releasetest.tcl dan ok  *
e.   tclsh fulltest.tcl fast.rc test.rc
0 errors out of 77729934 tests. "bella". 3h25m
drh ok  *
f.   tclsh th3make memdebug.rc
0 errors out of 7572245 tests 51n15s
drh ok+  *
g.   tclsh th3make test-ex.rc
o errors out of 18080624 tests. "bella", 5h46m
drh ok  *
h.   tclsh th3make test.rc CC=clang
0 errors out of 7572053 tests in 26m16s on linux x64 "bella"
drh ok  *
i.   tclsh th3make fast.rc CC=clang
0 errors out of 7316020 tests in 10m28s on linux x64 "bella"
drh ok  *
j.   ./mptester x.db mptest/crash01.test
0 errors in 94 tests
drh ok  *
k.   ./mptester x.db mptest/multiwrite01.test
0 errors in 76 tests
drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) drh ok  *
 
a.   tclsh th3make min.rc
0 errors out of 1393871 tests
drh ok  *
b.   Recompile and test Fossil drh ok  *
 
8.   Tests for platform Mac OS-X x86: drh ok  *
 
a.   tclsh releasetest.tcl
[f01d42cc8b] passes
dan ok  *
b.   tclsh fulltest.tcl fast.rc test.rc
0 errors out of 60897170 test. 9h33m.
drh ok  *
c.   tclsh th3make fast.rc CC=clang
0 errors out of 5717516 tests. 32m35s
drh ok  *
d.   ./mptester x.db mptest/crash01.test
0 errors in 94 tests
drh ok  *
e.   ./mptester x.db mptest/multiwrite01.test
0 errors in 76 tests
drh ok  *
 
9.   Tests for platform MacOS 10.2 PPC: drh ok  *
 
a.   tclsh th3make quick.rc
24 errors out of 1383763 tests - all errors are *.ctime03.1.21.[34] and are due to compile-time option differences from when the th3.c file was generated on the workstation and compiled on the device.
drh ok  *
b.   Recompile and test Fossil drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Win32/64: mistachkin ok  *
 
a.   make fulltestonly
0 errors out of 1134705 tests. msvc64 on win8.
drh ok  *
b.   th3make test.rc
0 errors out of 5932646 tests. Win7, vs2010, mingw.
drh ok  *
c.   th3make fast.rc
0 errors out of 5524104 tests. Win7, vs2010, x32
drh ok  *
d.   At least one of the above using MinGW drh ok  *
e.   At least one of the above using MSVC-32 drh ok  *
f.   At least one of the above using MSVC-64 drh ok  *
g.   At least one of the above on WinRT (x86)
MSVC 2012, 32-bit little-endian, 0 errors out of 1391194 tests in 19 configurations
mistachkin ok  *
h.   At least one of the above on WinRT (ARM)
MSVC 2012, 32-bit little-endian, 0 errors out of 1391192 tests in 19 configurations
mistachkin ok  *
i.   At least one of the above on Windows Phone 8.0
MSVC 2012, 32-bit little-endian, 0 errors out of 1390238 tests
mistachkin ok  *
j.   At least one of the above on Windows Phone 8.1
MSVC 2013, 32-bit little-endian, 0 errors out of 1390243 tests
mistachkin ok  *
k.   At least one of the above on Windows Embedded Compact 2013
MSVC 2012, 32-bit little-endian, 0 errors out of 1391155 tests in 19 configurations
mistachkin ok  *
l.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. mistachkin ok  *
m.   th3make msvc.rc test.rc /RTC1
0 errors out of 5724276 tests. Win8, vs2012, x64
drh ok  *
n.   mptester x.db mptest/crash01.test
0 errors out of 94 tests, on win8, vs2012, x64
drh ok  *
o.   mptester x.db mptest/multiwrite01.test
0 errors in 76 tests, win8, vs2012, x64
drh ok  *
p.   nmake /f makefile.msc DEBUG=2 test
0 errors out of 166449 tests, win8, vs2012.
drh ok  *
 
11.   Tests for platform Android: drh ok  *
 
a.   th3make quick.rc
./th3: 0 errors out of 1488608 tests in 19 configurations
dan ok  *
 
12.   Tests for platform OpenBSD x86: drh ok  *
 
a.   make test
1 error (percentile-2.1.50) out of 137035 tests
drh ok  *
b.   th3make quick.rc
0 errors out of 1492332 tests
drh ok  *
 
13.   Tests for platform Solaris Sparc: drh ok  *
 
a.   make test
0 errors out of 137089 tests
drh ok  *
b.   th3make test.rc
0 errors out of 7562823 tests in 4h16m
drh ok  *
c.   th3make fast.rc
32 errors out of 1987851 tests, 1h51m
drh ok  *
d.   Recompile and test Fossil drh ok  *
e.   Verify that Fossil repositories are cross-platform with x86/x64 drh ok  *
 
14.   Other test performed on any available platform: drh ok  *
 
a.   th3make alignment2.rc test.rc
0 errors out of 5504375 tests, x64/bella, 19m20s
drh ok  *
b.   th3make test.rc -DHAVE_LOCALTIME_R
darkstar, 0 errors out of 7536432 tests in 33 configurations, SQLite 3.8.6 2014-08-14 02:59:51 f5cce9db109a2bbe9a05b4c01b076a51d5fad8ba
dan ok  *
c.   th3make test.rc -DSQLITE_THREADSAFE=0
64-bit little-endian, 0 errors out of 7536432 tests in 33 configurations, SQLite 3.8.6 2014-08-14 02:59:51 f5cce9db109a2bbe9a05b4c01b076a51d5fad8ba
dan ok  *
d.   th3make test.rc -ftrapv
64-bit little-endian, 0 errors out of 7558101 tests in 33 configurations, SQLite 3.8.6 2014-08-14 02:59:51 f5cce9db109a2bbe9a05b4c01b076a51d5fad8ba
dan ok  *
e.   OPTS=-DSQLITE_SMALL_STACK make sqlite3.c; th3make test.rc -DSQLITE_SMALL_STACK
64-bit little-endian, 0 errors out of 7571121 tests in 33 configurations, SQLite 3.8.6 2014-08-14 02:59:51 f5cce9db109a2bbe9a05b4c01b076a51d5fad8ba
dan ok  *
f.   th3make test.rc CC=clang -fsanitize=undefined
OSX 64-bit little-endian, 0 errors out of 5908128 tests in 27 configurations, SQLite 3.8.6 2014-08-14 02:59:51 f5cce9db109a2bbe9a05b4c01b076a51d5fad8ba
dan ok  *
g.   th3make test.rc -DSQLITE_MAX_ATTACHED=125
0 errors out of 5713979 tests, win8, msvc.
drh ok  *
h.   th3make quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
0 errors out of 1484086 tests on x64/bella in 1h45m. No valgrind errors or warnings.
drh ok  *
i.   th3make quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE -DSQLITE_ENABLE_STAT4; valgrind ./th3
0 errors out of 1564809 tests on x64/bella in 2h10m. No valgrind warnings.
drh ok  *
j.   valgrind testfixture permutations.test valgrind
"0 errors out of 97144 tests". x86-64/darkstar. Only errors are the expected misuse errors and one fault injected into os_unix.c (see oserror.test).
dan ok  *
k.   th3make cov.rc -DSQLITE_TRACE_SIZE_LIMIT=15 (verify coverage)
0 errors out of 1385743 tests, x64/tallis, 100% coverage, 4m31s
drh ok  *
l.   th3make quick.rc -DSQLITE_TRACE_SIZE_LIMIT=15
0 errors out of 1484223 tests, x64/tallis, 3m57s
drh ok  *
m.   th3make quick.rc -funsigned-char
0 errors out of 1484195, x64/bella, 3m12s.
drh ok  *
n.   th3make quick.rc -fsigned-char
0 errors out of 1484197 tests, linux x64 "bella"
drh ok  *
o.   th3make quick.rc -DSQLITE_ENABLE_MEMSYS5
0 errors out of 1407884 tests. win7, vs2010, x64
drh ok  *
p.   th3make quick.rc -DSQLITE_ENABLE_RTREE -DSQLITE_ENABLE_FTS4
24 errors out of 1513781 tests. Errors are *.ctime03.1.15.[34]. "bella". 3m36s.
drh ok  *
q.   th3make quick.rc -DSQLITE_TEST_REALLOC_STRESS
0 errors out of 1838890 test. win7, msvc.
drh ok  *
r.   ./configure; make fulltest
1 error (memsubsys1-3.1.4) out of 2240287 tests. Tallis. 45m44s
drh ok  *
 
15.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation drh ok  *
b.   No compiler warnings drh ok  *
c.   run-all.sh with no errors
0 errors out of 17819637 tests
drh ok  *
d.   run-all.bat with no errors
0 errors out of 17819637 tests, win8, mingw
drh ok  *
 
16.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Run "make test" to verify that the build works. drh ok  *
c.   Verify the correct version numbers have been installed. drh ok  *
d.   Verify that the --disable-amalgamation option to configure works.
--disable-amalgamation generates an incorrect binary on Mac. Works ok without --disable-amalgamation.
drh ok+  *
e.   Works on Linux drh ok  *
f.   Works on Mac
Except, --disable-amalgamation does not work.
drh ok  *
g.   Works on OpenBSD drh ok  *
h.   Works on Solaris drh ok  *
 
17.   Exported symbol checks: tool/symbols.sh drh ok  *
 
a.   No private symbols exported. (This is also checked by releasetest.tcl) drh ok  *
b.   No undesirable library dependencies drh ok  *
c.   No private symbols exported in MinGW (check using tool/symbols-mingw.sh) drh ok  *
d.   No undesirable library dependencies on MinGW drh ok  *
 
18.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No compiler warnings drh ok  *
b.   Used on active websites with no issues drh ok  *
 
19.   Firefox recompiled using lastest SQLite. drh ok  *
 
a.   No SQLite compiler warnings drh ok  *
b.   Active use with no issues noted drh ok  *
 
20.   CEROD tests in the test/ subdirectory.
linux x64 "bella"
drh ok  *
 
21.   SEE tests using TH3: drh ok  *
 
a.   see.c
0 errors out of 1379738 tests, win7, vs2010, min.rc, x64
drh ok  *
b.   see-aes128-ofb.c
0 errors out of 7543971 tests, linux, "tallis", 1h9m, memdebug.rc
drh ok+  *
c.   see-aes256-ofb.c
0 errors out of 1466853 tests. Mac, x64, 12m54s
drh ok  *
d.   see-rc4.c
0 errors out of 7526663 tests, x64/tallis, 40m56s
drh ok  *
e.   see-aes128-ccm.c
0 errors out of 1465417 tests, linux x64 "bella", quick.rc, 4m5s.
drh ok  *
f.   At least one of the above using test.rc drh ok  *
g.   At least one of the above using memdebug.rc drh ok  *
h.   At least one of the above on Linux drh ok  *
i.   At least one of the above on Mac drh ok  *
j.   At least one of the above on Windows drh ok  *
 
22.   ZIPVFS tests: drh ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
0 errors out of 50045 tests on Linux x86-64 darkstar
dan ok  *
b.   th3make zipvfs.rc test.rc
1 error out of 6108361 tests (zipvfs1.req1_bind01.130). The failed test is incompatible with ZIPVFS. Win7, msvc
drh ok+  *
c.   th3make zipvfs.rc memdebug.rc
0 errors out of 7974511 tests on linux x64 "bella"
drh ok  *
d.   th3make zipvfs.rc quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
32 errors out of 1987851 tests. All errors were *.ctime03.1.37.[34] which can be ignored. Linux x64 "bella" in 6h24m
drh ok  *
e.   th3make quick.rc
0 errors out of 1979889 tests. 17m18s. Mac
drh ok  *
f.   At least one of the above on Linux drh ok  *
g.   At least one of the above on Mac drh ok  *
h.   At least one of the above on Windows drh ok  *
 
23.   NX-Devkit compiles and runs "tclsh th3make test.rc nx_compress.o" without error.
0 errors out of 6614006 tests. x64/bella. 19m2s.
drh ok  *
 
24.   Amalgamation autoconf tarball. dan ok  *
 
a.   Builds
Running "make dist" creates file sqlite-autoconf-3080600.tar.gz
dan ok  *
b.   Works on Linux dan ok  *
c.   Works on Mac dan ok  *
 
25.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac dan ok  *
 
26.   Run performance tests comparing the new SQLite release against the previous release and a release from one year ago. Document and justify any performance decrease. dan ok  *
 
a.   The TCL speed*.test scripts
On darkstar: 385: 6020359, 6010745, 5975904 uS TOTAL. trunk: 5986745, 5954364, 5945456 uS TOTAL (times for 3 indpendent runs of speed1p.test using each version)
dan ok  *
b.   The TH3 speed tests
On tallis, 3.8.5: 4.260s, trunk: 4.256s.
drh ok  *
c.   The speedtest1 program
On mac: 3.8.5: 20.879s, trunk: 20.815s
drh ok  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
win8, x64, vs2012. 2013-08-13: 2.605, 3.8.5: 2.465s, trunk: 2.356s.
drh ok+  *
e.   One or more of the above on linux drh ok  *
f.   One or more of the above on windows drh ok  *
g.   One or more of the above on mac drh ok  *
 
27.   Run "make wordcount; bash run-wordcount.bash $OPTIONS" with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c
No errors. WITHOUT ROWID is faster in all cases. Linux, x64, "bella"
drh ok+  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync
No errors. WITHOUT ROWID is faster in all cases. Linux, x64, "bella"
drh ok  *
 
28.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments drh ok  *
 
a.   Versus the previous release
trunk=445264, v365=442823. Increase of 0.55%
drh ok  *
b.   Versus the trunk from 12 months ago
trunk=445264, year-ago=424821. Increase of 4.81%
drh ok  *
 
29.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   linux
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
b.   mac
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
c.   openbsd
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
d.   windows native mingw
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
e.   windows nmake
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
f.   sparc solaris using autoconf
md5sum 37d323bd362b73c20479c8a29f0d4342 sqlite3.c 65ec8d8642fff422ea908e39dbef1d81 sqlite3.h
drh ok  *
 
30.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
tested with backcompat.test against 3.6.4. 3.7.12 and 3.8.0. Linux x86-64 darkstar.
dan ok  *
 
31.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database drh ok  *
b.   32-big to 64-little, WAL drh ok  *
c.   32-big to 64-little, rollback drh ok  *
d.   64-little to 32-big, SEE database drh ok  *
e.   64-little to 32-big, ZIPVFS database drh ok  *
f.   64-little to 32-big, CEROD database drh ok  *
 
32.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Sparc Solaris drh ok  *
d.   Win32 (MinGW) drh ok  *
e.   Win32 (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables drh ok  *
 
33.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK drh ok  *
 
a.   tclsh th3make session.rc test.rc (on windows)
0 errors out of 5737712 tests. Win8, vs2012, x64.
drh ok  *
b.   tclsh th3make session.rc test.rc (on unix)
0 errors out of 7559926 tests, linux x64 "bella"
drh ok  *
c.   tclsh th3make session.rc cov.rc
0 errors out of 1384080 tests. 95.99% branch coverage
drh ok  *
d.   tclsh th3make session.rc min.rc -norun -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
Linux x64 "bella", 0 errors out of 1381290 tests, 1h27m
drh ok  *
e.   make test (on windows)
win8, vs2012, x64: 2 errors out of 163062 tests: hook-7.5.2.1 hook-7.5.2.2
drh ok  *
f.   make test (on unix)
linux, x64, "bella": 3 errors in 206869 tests: hook-7.5.2.1 hook-7.5.2.2 memsubsys1-3.1.4
drh ok  *
g.   testfixture test/session.test
0 errors out of 24882 tests, linux, x64, "bella"
drh ok  *
 
34.   Verify that the sqlite3-all.c build target works and that the resulting sqlite3-all.c file and its include files (sqlite3-?.c) compile and run the same as the single-file amalgamation. drh ok  *
 
35.   System.Data.SQLite builds and checks out using the SQLite core
b85106c7606524876a63b809b428345d5de8b869, 0 errors/374 tests (Debug NetFx40-x86/NetFx45-x64), 0 errors/363 tests (Release NetFx40-x86/NetFx45-x64), 0 errors/23 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/23 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok+  *