SQLite 3.12.0 Status Board

History    Checklist    Baseline

 
1.   Test procedure review. drh ok  *
 
a.   Review the "test/releasetest.tcl" script for completeness and accuracy. drh ok  *
b.   Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness. drh ok  *
c.   Review this checklist for completeness and accuracy. drh ok  *
 
2.   Source code change review. fossil diff --from release --to trunk drh ok  *
 
a.   No stray changes. drh ok  *
b.   All significant changes are mentioned in the "changes" log of the documentation. drh ok  *
c.   New code complies with style guidelines. drh ok  *
d.   New code complies with design rules. drh ok  *
e.   Comments have been updated to reflect code changes. drh ok  *
f.   Variables and functions have been renamed to reflect changes in their use. drh ok  *
g.   Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean. drh ok  *
h.   Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*\(/ drh ok  *
i.   Verify that source code contains no tabs and that surplus whitespace has been removed. drh ok  *
j.   Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h). drh ok  *
k.   Significant compile-time options are recognized by the sqlite3_compileoption_used() interface. drh ok  *
 
3.   Documentation review: drh ok  *
 
a.   Latest release on the "index.html" page. drh ok  *
b.   Release announcement in "changes.in". drh ok  *
c.   Release accouncement in "news.html". drh ok  *
d.   No unresolved hyperlinks in the documentation build. drh ok  *
e.   Requirements marks are up-to-date in both documentation and source code. drh ok  *
f.   The compile-time options are all up-to-date (compile.html). drh ok  *
g.   Database footprint is up-to-date (features.html). drh ok  *
h.   Test metrics are up-to-date (testing.html). drh ok  *
i.   Check new/changed documentation for spelling and gramatical mistakes. drh ok  *
 
4.   Compiler warning checks. drh ok  *
 
a.   Linux GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
b.   Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script) drh ok  *
c.   OpenBSD GCC using options -Wall drh ok  *
d.   Windows (32-bit) MSVC using option /W4 drh ok  *
e.   Windows (64-bit) MSVC using option /W4 drh ok  *
 
5.   OMIT, ENABLE, and DISABLE options: drh ok  *
 
a.   tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a drh ok  *
 
6.   Tests for platform Linux x86_64: drh ok  *
 
a.   tclsh multitest.tcl (take care to update ../th3private)
0 failures on 35 th3makes and 169888570 tests in (04:24:21) 4 cores on bella • SQLite 3.12.0 2016-03-22 20:05:09 605eba4a756e7185119088e2242f82691d078b01
drh ok  *
b.   Check the "multitest.tcl" log files for undetected errors. drh ok  *
c.   tclsh releasetest.tcl
0 failures out of 9287964 tests in (01:30:07) 3 cores on bella • SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
drh ok  *
d.   Check the "releasetest.tcl" log files for undetected errors. drh ok  *
e.   tclsh multitest.tcl --scenario failures - all failures detected drh ok  *
f.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
g.   sh tool/symbols.sh - no incorrect exports or dependencies drh ok  *
 
7.   Tests for platform Linux ARM (BeagleBoard) dan ok  *
 
a.   tclsh th3make min.rc
th3: 0 errors in 1543329 tests. 3825.642 seconds on beaglebone 32-bit little-endian th3: SQLite 3.12.0 2016-03-23 16:32:29 3fa88f68c3e1bbb3421cb0d2b82b9bb3fe7b9b14
dan ok+  *
b.   Recompile and test Fossil.
This is fossil version 1.35 [314f194227] 2016-03-22 16:34:48 UTC
dan ok  *
 
8.   Tests for platform Mac OS X (x86): dan ok  *
 
a.   tclsh releasetest.tcl dan ok  *
b.   tclsh multitest.tcl --omit test-ex (after updating th3private)
0 failures on 26 th3makes and 123098439 tests in (20:00:36) SQLite 3.12.0 2016-03-23 17:54:19 a1fd14694c1adc54e5c443ebfdef38e38637f5c5
dan ok  *
c.   tclsh multitest.tcl --scenario failures - all failures detected dan ok  *
d.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected dan ok  *
 
9.   Tests for platform Mac OS X 10.2 (PPC): drh ok  *
 
a.   tclsh th3make quick.rc drh ok  *
b.   Recompile and test Fossil. drh ok  *
c.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
10.   Tests for platform Windows 7.0/8.x (x86): drh ok  *
 
a.   tclsh multitest.tcl (after updating th3private)
0 failures on 29 th3makes and 127279817 tests in (10:29:18) 4 cores on poulenc • SQLite 3.12.0 2016-03-23 17:54:19 a1fd14694c1adc54e5c443ebfdef38e38637f5c5
drh ok  *
b.   tclsh multitest.tcl --scenario failures - verify failures detected drh ok  *
c.   tclsh test/releasetest.tcl
0 failures out of 1226218 tests in (03:17:38) on win7dev • SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
d.   tclsh test/releasetest.tcl --msvc
0 failures out of 1609207 tests in (02:12:40) 2 cores on poulenc • SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
drh ok  *
e.   tclsh releasetest.tcl --platform Failure-Detection - all failures detected drh ok  *
f.   nmake /f makefile.msc MEMDEBUG=1 DEBUG=3 fulltestonly
SQLite 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756 • 0 errors out of 1187968 tests on poulenc Windows NT 64-bit little-endian
drh ok  *
g.   nmake /f makefile.msc WIN32HEAP=1 DEBUG=4 fulltestonly
SQLite 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756 • 0 errors out of 1189685 tests on poulenc Windows NT 64-bit little-endian
drh ok  *
h.   sh tool/symbols-mingw.sh - no incorrect exports or dependencies drh ok  *
i.   Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources. drh ok  *
 
11.   Tests for platform Windows (other): mistachkin ok  *
 
a.   th3make msvc.rc test.rc - Windows 7.0/8.x (x64)
th3: 0 errors in 6173113 tests. 3242.182 seconds on poulenc 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
b.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (x86)
0 errors in 1544330 tests. 769.855 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
c.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.0 (ARM)
0 errors in 1544307 tests. 4764.621 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
d.   th3make msvc.rc winrt.rc min.rc - Windows Runtime 8.1
0 errors in 1544322 tests. 5475.035 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
e.   th3make msvc.rc wp80.rc min.rc - Windows Phone 8.0
0 errors in 1543211 tests. 1100.714 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
f.   th3make msvc.rc wp81.rc min.rc - Windows Phone 8.1
0 errors in 1543193 tests. 3184.578 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
g.   th3make msvc.rc wince.rc min.rc - Windows Embedded Compact 2013 - When tests are going to be run on the [Hyper-V based] emulator, no-mmap.rc must be used as well.
0 errors in 1550897 tests. 3752.452 seconds on 32-bit little-endian, SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
mistachkin ok  *
 
12.   Tests for platform OpenBSD (x86): drh ok  *
 
a.   make test drh ok  *
b.   th3make quick.rc
th3: 0 errors in 1637145 tests. 3497.759 seconds on wolfman.devio.us 32-bit little-endian • th3: SQLite 3.12.0 2016-03-23 17:54:19 a1fd14694c1adc54e5c443ebfdef38e38637f5c5
drh ok  *
 
13.   Tests for platform Solaris (SPARC): drh ok  *
 
a.   configure; OPTS=-lrt make test
0 errors out of 134505 tests on sparc.mikeowens.ws SunOS 32-bit big-endian
drh ok  *
b.   tclsh multitest.tcl --quick -q (after updating th3private)
0 failures on 9 th3makes and 11964631 tests in (02:28:03) 2 cores on sparc.mikeowens.ws • SQLite 3.12.0 2016-03-23 17:54:19 a1fd14694c1adc54e5c443ebfdef38e38637f5c5
drh ok  *
c.   Recompile and test Fossil. drh ok  *
d.   Verify that Fossil repositories are cross-platform with x86/x64. drh ok  *
 
14.   Sqllogictest: drh ok  *
 
a.   Checked in latest SQLite amalgamation. drh ok  *
b.   No SQLite compiler warnings. drh ok  *
c.   tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 801 seconds
drh ok  *
d.   tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 3165 seconds
drh ok  *
 
15.   Build using the configure/make in main source tree. drh ok  *
 
a.   Make sure that autoconf has been run to update the configure script. drh ok  *
b.   Verify the correct version numbers have been installed. drh ok  *
 
16.   Fossil updated to use the latest SQLite. drh ok  *
 
a.   No SQLite compiler warnings. drh ok  *
b.   Used on active websites with no issues. drh ok  *
c.   fossil all dbstat --db-check drh ok  *
 
17.   Rebuild and use Firefox with the latest SQLite drh ok  *
 
18.   CEROD tests in the "test/" subdirectory. drh ok  *
 
19.   SEE tests using TH3: drh ok  *
 
a.   see.c
th3: 0 errors in 1600810 tests. 231.425 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-24 20:55:03 817e93f42c09eb876421e27eb8eceb7b077cb45d
drh ok  *
b.   see-aes128-ofb.c
th3: 0 errors in 1600841 tests. 223.299 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
c.   see-aes256-ofb.c
th3: 0 errors in 8026284 tests. 4699.683 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-24 15:32:19 6db1d1fbc6c1acc896fa635dfdc5564800502c40
drh ok  *
d.   see-rc4.c
th3: 0 errors in 1613125 tests. 1300.228 seconds on win7dev 32-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
e.   see-aes128-ccm.c
th3: 0 errors in 1601066 tests. 263.107 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
f.   see-cccrypt.c
th3: 0 errors in 6305569 tests. 2284.967 seconds on macpro 64-bit little-endian • th3: SQLite 3.12.0 2016-03-24 15:32:19 6db1d1fbc6c1acc896fa635dfdc5564800502c40
drh ok  *
g.   At least one of the above using "test.rc". drh ok  *
h.   At least one of the above using "memdebug.rc". drh ok  *
i.   At least one of the above on Linux. drh ok  *
j.   At least one of the above on Mac OS X. drh ok  *
k.   At least one of the above on Windows. drh ok  *
 
20.   SEE using configure; make test drh ok  *
 
a.   Linux
SQLite 2016-03-24 15:09:14 f4d234b5013bf93b6eac7f8be6d4c074cf9f5293 • 0 errors out of 134260 tests on bella Linux 64-bit little-endian
drh ok  *
b.   Mac
SQLite 2016-03-24 15:09:14 f4d234b5013bf93b6eac7f8be6d4c074cf9f5293 • 0 errors out of 133653 tests on macpro Darwin 64-bit little-endian
drh ok  *
 
21.   ZIPVFS tests: drh ok  *
 
a.   testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
SQLite 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18 • 0 errors out of 66097 tests on bella Linux 64-bit little-endian
drh ok  *
b.   th3make zipvfs.rc test.rc
th3: 0 errors in 9812139 tests. 2569.502 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
drh ok  *
c.   th3make zipvfs.rc memdebug.rc
th3: 0 errors in 9810443 tests. 8054.288 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
d.   th3make zipvfs.rc quick.rc -valgrind
th3: 0 errors in 2670668 tests. 20641.064 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756
drh ok  *
e.   th3make zipvfs.rc quick.rc
th3: 0 errors in 2695741 tests. 3450.663 seconds on win7dev 64-bit little-endian • th3: SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
drh ok  *
f.   At least one of the above on Linux. drh ok  *
g.   At least one of the above on Mac OS X. drh ok  *
h.   At least one of the above on Windows. drh ok  *
i.   th3make zipvfs-cov.rc - verify full coverage
th3: 0 errors in 1212580 tests. 310.632 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-26 15:36:36 8213c2f58167243411d29cc58e303b4be656f756 • Statement coverage: 100.00% hit 1557 missed 0 total 1557 • Branch coverage: 100.00% hit 914 missed 0 total 914
drh ok  *
 
22.   NX-Devkit testing drh ok  *
 
a.   Verify that devkit sources are up-to-date with SQLite and ZIPVFS by running update-src.sh and mkdevkit.tcl in the sbin subdirectory of the devkit source tree. Record nds_sqlite3.[ch] hashes in the comment.
be25cc9d69a6891b7c9b38878eda876fc48447bb sqlite3.c • 26e76025d49c585dae4b0a1021d201f3807099cc sqlite3.h
drh ok  *
b.   Build using: sh mkdevkit.sh; gcc -o nxc.o -c nx_compress.c drh ok  *
c.   Test using: tclsh th3make test.rc nxc.o -DNDS_ENABLE_COMPRESS
th3: 0 errors in 6954280 tests. 1259.986 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-28 11:01:54 f6a88cccbc0c62a0b453f4711298c9d5e1882b18
drh ok  *
d.   Verify failure if run without -DNDS_ENABLE_COMPRESS drh ok  *
 
23.   Amalgamation autoconf tarball. drh ok  *
 
a.   Builds. drh ok  *
b.   Works on Linux.
The amalgamation-tarball and snapshot-tarball targets do not work when the make • is run from the source directory. Running "../sqlite/configure; make snapshot-tarball". Fix this in the next release.
drh ok  *
c.   Works on Mac OS X. drh ok  *
d.   Works on Windows MinGW drh ok  *
e.   Works on Windows MSVC drh ok  *
 
24.   TEA archive builds correctly and runs: dan ok  *
 
a.   Linux dan ok  *
b.   Mac OS X dan ok  *
 
25.   Run performance tests comparing the new SQLite release against the previous release and/or a release from one year ago. Document and justify any performance decrease. drh ok  *
 
a.   The Tcl "speed*.test" scripts.
current: 13077273us • 3.11.0: 13618334us • 3.8.9: 13777220us • Tested on windows10
drh ok  *
b.   The TH3 speed tests.
current: 3.117s • 3.11.0: 3.607s • 3.8.9: 3.985s • Tested on macpro
drh ok  *
c.   The "speedtest1" program.
Current: 1033 million cycles. • 3.11.0: 1088 million cycles (5%) • 3.8.9: 1366 million cycles (24%)
drh ok  *
d.   ./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null
current: 1.164s • 3.11.0: 1.368s • 3.8.9: 1.462s • On macpro
drh ok  *
e.   One or more of the above on Linux. drh ok  *
f.   One or more of the above on Windows. drh ok  *
g.   One or more of the above on Mac OS X. drh ok  *
 
26.   Run make wordcount; bash run-wordcount.bash $OPTIONS with options: drh ok  *
 
a.   bash run-wordcount.sh sqlite3.c drh ok  *
b.   bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync drh ok  *
 
27.   Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments. drh ok  *
 
a.   Versus the previous release.
485831 vs 486322 bytes. 491 bytes smaller!
drh ok  *
b.   Versus the trunk from 12 months ago.
Current: 485831 • 3.8.9: 469696 • 6135 bytes larger.
drh ok  *
 
28.   Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms. drh ok  *
 
a.   Linux
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
b.   Mac OS X
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
c.   OpenBSD
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
d.   Windows using native MinGW.
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
e.   Windows using NMAKE.
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
f.   Solaris (SPARC) using autoconf.
67cc629a46c50c27e3955213852074c9883c0911 sqlite3.c • a9910ae5a9177380ede2dec2fd03cab600c33614 sqlite3.h
drh ok  *
 
29.   Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested against 3.6.4, 3.7.1 and 3.8.3 using the backcompat.test script.
dan ok  *
 
30.   Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems. drh ok  *
 
a.   32-big to 64-little, database. drh ok  *
b.   32-big to 64-little, WAL. drh ok  *
c.   32-big to 64-little, rollback. drh ok  *
d.   64-little to 32-big, SEE database. drh ok  *
e.   64-little to 32-big, ZIPVFS database. drh ok  *
f.   64-little to 32-big, CEROD database. drh ok  *
 
31.   Build and verify correct operation of sqlite3_analyzer on: drh ok  *
 
a.   Linux drh ok  *
b.   Mac OS X drh ok  *
c.   Solaris (SPARC) drh ok  *
d.   Windows (MinGW) drh ok  *
e.   Windows (MSVC) drh ok  *
f.   A database containing WITHOUT ROWID tables. drh ok  *
 
32.   Build and verify sqldiff drh ok  *
 
a.   Linux drh ok  *
b.   Mac drh ok  *
c.   Windows drh ok  *
 
33.   Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK. drh ok  *
 
a.   tclsh th3make session.rc test.rc (on Windows)
th3: 0 errors in 6385075 tests. 5409.199 seconds on win7dev 32-bit little-endian • th3: SQLite 3.12.0 2016-03-24 14:34:26 beb5ea1439995fb8ab112451a8ffcc08fe42d0c4
drh ok  *
b.   tclsh th3make session.rc test.rc (on Unix)
th3: 0 errors in 8062658 tests. 1758.421 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-24 14:34:26 beb5ea1439995fb8ab112451a8ffcc08fe42d0c4
drh ok  *
c.   tclsh th3make session.rc quick.rc -valgrind
th3: 0 errors in 1622789 tests. 7270.819 seconds on bella 64-bit little-endian • th3: SQLite 3.12.0 2016-03-24 14:34:26 beb5ea1439995fb8ab112451a8ffcc08fe42d0c4
drh ok  *
d.   make test (on Windows)
SQLite 2016-03-24 14:34:26 beb5ea1439995fb8ab112451a8ffcc08fe42d0c4 • 0 errors out of 107106 tests on win7dev Windows NT 32-bit little-endian
drh ok  *
e.   make test (on Unix)
0 errors out of 180745 tests on bella Linux 64-bit little-endian
drh ok  *
f.   testfixture test/session.test
SQLite 2016-03-21 15:32:19 3296a0ceedef43c2790f0b36471f91138a575243 • 0 errors out of 49051 tests on bella Linux 64-bit little-endian
drh ok  *
 
34.   Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation. drh ok  *
 
35.   System.Data.SQLite builds and checks out using the SQLite core. mistachkin ok  *
 
a.   Using Microsoft .NET Framework on Windows
f6a88cccbc0c62a0b453f4711298c9d5e1882b18, Debug NetFx46 x86: 0 errors/502 tests, 1246 seconds, Release NetFx46 x86: 0 errors/502 tests, 1174 seconds, Debug NetFx451 x64: 0 errors/502 tests, 1107 seconds, Release NetFx451 x64: 0 errors/502 tests, 1075 seconds, 0 errors/24 tests (Debug NetCF20-ARM/NetCF35-ARM), 0 errors/24 tests (Release NetCF20-ARM/NetCF35-ARM)
mistachkin ok  *
b.   Using Mono on unix
f6a88cccbc0c62a0b453f4711298c9d5e1882b18, Debug Mono 4.23 on Ubuntu 15.10 x86_64: 0 errors/502 tests, 564 seconds, Release Mono 4.23 on Ubuntu 15.10 x86_64: 0 errors/502 tests, 511 seconds
mistachkin ok  *