- Compiler warning checks.
- Linux GCC -Wall -Wextra (the tool/warnings.sh script)
- Mac GCC -Wall -Wextra (the tool/warnings.sh script)
- OpenBSD GCC using options -Wall
- Windows MSVC Win32 /W3
- Windows MSVC Win64 /W3
- sh tool/warnings-clang.sh
- Documentation checks:
- Latest release on the index.html page
- Release announcement in changes.in
- Release accouncement in news.html
- No unresolved hyperlinks in the documentation build
- Requirements marks are up-to-date in both documentation and source code
- The compile-time options are all up-to-date (compile.html)
- Database footprint is up-to-date (features.html)
- Test metrics are up-to-date (testing.html)
- Check new/changed documentation for spelling and gramatical mistakes
- Source code change review. "fossil diff --from release --to trunk"
- No stray changes
- All significant changes are mentioned in the "changes" log of the documentation
- New code complies with style guidelines
- New code complies with design rules
- Comments have been updated to reflect code changes
- Variables and functions have been renamed to reflect changes in their use
- Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean.
- Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*(/
- Verify that source code contains no tabs and that surplus whitespace has been removed.
- Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h)
- OMIT, ENABLE, and DISABLE options:
- tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a
- Tests for platform Linux x86:
- tclsh releasetest.tcl
- tclsh th3make cov.rc (verify 100% branch test coverage)
- tclsh fulltest.tcl fast.rc test.rc
- tclsh th3make fast-ex.rc
- Tests for platform Linux x86_64:
- tclsh th3make cov.rc (verify 100% branch test coverage)
- tclsh th3make cov.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE (verify 100% branch test coverage)
- tclsh th3make cov.rc -DSQLITE_ENABLE_STAT4 (verify 100% branch test coverage)
- tclsh releasetest.tcl
- tclsh fulltest.tcl fast.rc test.rc
- tclsh th3make memdebug.rc
- tclsh th3make test-ex.rc
- tclsh th3make test.rc CC=clang
- tclsh th3make fast.rc CC=clang
- ./mptester x.db mptest/crash01.test
- ./mptester x.db mptest/multiwrite01.test
- Tests for platform Linux ARM (BeagleBoard)
- tclsh th3make min.rc
- Recompile and test Fossil
- Tests for platform Mac OS-X x86:
- tclsh releasetest.tcl
- tclsh fulltest.tcl fast.rc test.rc
- tclsh th3make fast.rc CC=clang
- ./mptester x.db mptest/crash01.test
- ./mptester x.db mptest/multiwrite01.test
- Tests for platform MacOS 10.2 PPC:
- tclsh th3make quick.rc
- Recompile and test Fossil
- Verify that Fossil repositories are cross-platform with x86/x64.
- Tests for platform Win32/64:
- make fulltestonly
- th3make test.rc
- th3make fast.rc
- At least one of the above using MinGW
- At least one of the above using MSVC-32
- At least one of the above using MSVC-64
- At least one of the above on WinRT (x86)
- At least one of the above on WinRT (ARM)
- At least one of the above on Windows Phone 8.0
- At least one of the above on Windows Phone 8.1
- At least one of the above on Windows Embedded Compact 2013
- Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources.
- th3make msvc.rc test.rc /RTC1
- mptester x.db mptest/crash01.test
- mptester x.db mptest/multiwrite01.test
- Tests for platform Android:
- th3make quick.rc
- Tests for platform OpenBSD x86:
- make test
- th3make quick.rc
- Tests for platform Solaris Sparc:
- make test
- th3make test.rc
- th3make fast.rc
- Recompile and test Fossil
- Verify that Fossil repositories are cross-platform with x86/x64
- Other test performed on any available platform:
- th3make alignment2.rc test.rc
- th3make test.rc -DHAVE_LOCALTIME_R
- th3make test.rc -DSQLITE_THREADSAFE=0
- th3make test.rc -ftrapv
- OPTS=-DSQLITE_SMALL_STACK make sqlite3.c; th3make test.rc -DSQLITE_SMALL_STACK
- th3make test.rc CC=clang -fsanitize=undefined
- th3make test.rc -DSQLITE_MAX_ATTACHED=62
- th3make quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
- th3make quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE -DSQLITE_ENABLE_STAT4; valgrind ./th3
- valgrind testfixture permutations.test valgrind
- th3make cov.rc -DSQLITE_TRACE_SIZE_LIMIT=15 (verify coverage)
- th3make quick.rc -DSQLITE_TRACE_SIZE_LIMIT=15
- th3make quick.rc -funsigned-char
- th3make quick.rc -fsigned-char
- th3make quick.rc -DSQLITE_ENABLE_MEMSYS5
- th3make quick.rc -DSQLITE_ENABLE_RTREE -DSQLITE_ENABLE_FTS4
- Sqllogictest:
- Checked in latest SQLite amalgamation
- No compiler warnings
- run-all.sh with no errors
- run-all.bat with no errors
- Build using the configure/make in main source tree.
- Make sure that autoconf has been run to update the configure script.
- Run "make test" to verify that the build works.
- Verify the correct version numbers have been installed.
- Verify that the --disable-amalgamation option to configure works.
- Works on Linux
- Works on Mac
- Works on OpenBSD
- Works on Solaris
- Exported symbol checks: tool/symbols.sh
- No private symbols exported. (This is also checked by releasetest.tcl)
- No undesirable library dependencies
- No private symbols exported in MinGW (check using tool/symbols-mingw.sh)
- No undesirable library dependencies on MinGW
- Fossil updated to use the latest SQLite.
- No compiler warnings
- Used on active websites with no issues
- Firefox recompiled using lastest SQLite.
- No SQLite compiler warnings
- Active use with no issues noted
- CEROD tests in the test/ subdirectory.
- SEE tests using TH3:
- see.c
- see-aes128-ofb.c
- see-aes256-ofb.c
- see-rc4.c
- see-aes128-ccm.c
- At least one of the above using test.rc
- At least one of the above using memdebug.rc
- At least one of the above on Linux
- At least one of the above on Mac
- At least one of the above on Windows
- ZIPVFS tests:
- testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
- th3make zipvfs.rc test.rc
- th3make zipvfs.rc memdebug.rc
- th3make zipvfs.rc quick.rc -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
- th3make quick.rc
- At least one of the above on Linux
- At least one of the above on Mac
- At least one of the above on Windows
- NX-Devkit compiles and runs "tclsh th3make test.rc nx_compress.o" without error.
- Amalgamation autoconf tarball.
- Builds
- Works on Linux
- Works on Mac
- TEA archive builds correctly and runs:
- Linux
- Mac
- Run performance tests comparing the new SQLite release against the previous release and a release from one year ago. Document and justify any performance decrease.
- The TCL speed*.test scripts
- The TH3 speed tests
- The speedtest1 program
-
./speedtest1 --nosync --size 25 --trace 2>x.txt
time ./sqlite3 x.db <x.txt >/dev/null - One or more of the above on linux
- One or more of the above on windows
- One or more of the above on mac
- Run "make wordcount; bash run-wordcount.bash $OPTIONS" with options:
- bash run-wordcount.sh sqlite3.c
- bash run-wordcount.sh sqlite3.c --cachesize 5 --nosync
- Compute the size of a standard build (gcc -Os -c sqlite3.c) and and record the size change in the comments
- Versus the previous release
- Versus the trunk from 12 months ago
- Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms.
- linux
- mac
- openbsd
- windows native mingw
- windows nmake
- sparc solaris using autoconf
- Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
- Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems.
- 32-big to 64-little, database
- 32-big to 64-little, WAL
- 32-big to 64-little, rollback
- 64-little to 32-big, SEE database
- 64-little to 32-big, ZIPVFS database
- 64-little to 32-big, CEROD database
- Build and verify correct operation of sqlite3_analyzer on:
- Linux
- Mac
- Sparc Solaris
- Win32 (MinGW)
- Win32 (MSVC)
- A database containing WITHOUT ROWID tables
- Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK
- tclsh th3make session.rc test.rc (on windows)
- tclsh th3make session.rc test.rc (on unix)
- tclsh th3make session.rc cov.rc
- tclsh th3make session.rc min.rc -norun -DTH3_LOWMEM -DTH3_OMIT_MISUSE; valgrind ./th3
- make test (on windows)
- make test (on unix)
- testfixture test/session.test
- Verify that the sqlite3-all.c build target works and that the resulting sqlite3-all.c file and its include files (sqlite3-?.c) compile and run the same as the single-file amalgamation.
- System.Data.SQLite builds and checks out using the SQLite core