Checklist For SQLite

  1. Compiler warning checks. (Warnings in the Porter stemmer code are allowed.)
    1. Linux GCC -Wall -Wextra (the tool/warnings.sh script)
    2. Mac GCC -Wall -Wextra (the tool/warnings.sh script)
    3. OpenBSD GCC using options -Wall
    4. Windows MSVC Win32 /W3
    5. Windows MSVC Win64 /W3
    6. sh tool/warnings-clang.sh

  2. Documentation checks:
    1. Latest release on the index.html page
    2. Release announcement in changes.in
    3. Release accouncement in news.html
    4. No unresolved hyperlinks in the documentation build
    5. Requirements marks are up-to-date in both documentation and source code
    6. The compile-time options are all up-to-date (compile.html)
    7. Database footprint is up-to-date (features.html)
    8. Test metrics are up-to-date (testing.html)
    9. Check new/changed documentation for spelling and gramatical mistakes

  3. Source code change review. "fossil diff --from release --to trunk"
    1. No stray changes
    2. All significant changes are mentioned in the "changes" log of the documentation
    3. New code complies with style guidelines
    4. New code complies with design rules
    5. Comments have been updated to reflect code changes
    6. Variables and functions have been renamed to reflect changes in their use
    7. Check all multiplications, and especially those involving the offset parameters to sqlite3OsRead() and sqlite3OsWrite() or having operands pageSize or szPage to make sure that 32x32-bit multiplicates that intend to yield a 64-bit result do not instead truncate to 32-bits.
    8. Verify that source code contains no tabs and that surplus whitespace has been removed.
    9. Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h)

  4. OMIT, ENABLE, and DISABLE options:
    1. tclsh ../tool/omittest.tcl -skip_run

  5. Tests for platform Linux x86:
    1. tclsh releasetest.tcl
    2. tclsh th3make cov.rc (verify 100% branch test coverage)
    3. tclsh fulltest.tcl fast.rc test.rc
    4. tclsh th3make fast-ex.rc

  6. Tests for platform Linux x86_64:
    1. tclsh th3make cov.rc (verify 100% branch test coverage)
    2. tclsh th3make cov.rc -DHAVE_MALLOC_H -DHAVE_MALLOC_USABLE_SIZE (verify 100% branch test coverage)
    3. tclsh th3make cov.rc -DSQLITE_ENABLE_STAT3 (verify 100% branch test coverage)
    4. tclsh releasetest.tcl
    5. tclsh fulltest.tcl fast.rc test.rc
    6. tclsh th3make memdebug.rc
    7. tclsh th3make test-ex.rc
    8. tclsh th3make test.rc CC=clang
    9. tclsh th3make fast.rc CC=clang
    10. ./mptester x.db mptest/crash01.test
    11. ./mptester x.db mptest/multiwrite01.test

  7. Tests for platform Mac OS-X x86:
    1. tclsh releasetest.tcl
    2. tclsh fulltest.tcl fast.rc test.rc
    3. tclsh th3make fast.rc CC=clang
    4. ./mptester x.db mptest/crash01.test
    5. ./mptester x.db mptest/multiwrite01.test

  8. Tests for platform Mac OS-X PPC:
    1. tclsh th3make -Os min.rc

  9. Tests for platform Win32/64:
    1. make fulltestonly
    2. th3make test.rc
    3. th3make fast.rc
    4. At least one of the above using MinGW
    5. At least one of the above using MSVC-32
    6. At least one of the above using MSVC-64
    7. At least one of the above on WinRT (x86)
    8. At least one of the above on WinRT (ARM)
    9. At least one of the above on Windows Phone
    10. Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources.
    11. th3make msvc.rc test.rc /RTC1
    12. mptester x.db mptest/crash01.test
    13. mptester x.db mptest/multiwrite01.test

  10. Tests for platform Android:
    1. th3make -Os min.rc

  11. Tests for platform OpenBSD x86:
    1. make test
    2. th3make -Os min.rc

  12. Tests for platform Solaris Sparc:
    1. make test
    2. th3make test.rc
    3. th3make fast.rc

  13. Other test performed on any available platform:
    1. th3make alignment2.rc test.rc
    2. th3make test.rc -DHAVE_LOCALTIME_R
    3. th3make test.rc -DSQLITE_THREADSAFE=0
    4. th3make test.rc -ftrapv
    5. th3make test.rc -DSQLITE_MAX_ATTACHED=62
    6. th3make min.rc -Os -DTH3_LOWMEM; valgrind ./th3
    7. valgrind testfixture permutations.test valgrind
    8. th3make cov.rc -DSQLITE_TRACE_SIZE_LIMIT=15 (verify coverage)
    9. th3make min.rc -DSQLITE_TRACE_SIZE_LIMIT=15 -O6

  14. Sqllogictest:
    1. Checked in latest SQLite amalgamation
    2. No compiler warnings
    3. run-all.sh with no errors
    4. run-all.bat with no errors

  15. Build using the configure/make in main source tree.
    1. Make sure that autoconf has been run to update the configure script.
    2. Run "make test" to verify that the build works.
    3. Verify the correct version numbers have been installed.
    4. Verify that the --disable-amalgamation option to configure works.
    5. Works on Linux
    6. Works on Mac
    7. Works on OpenBSD
    8. Works on Solaris

  16. Exported symbol checks: tool/symbols.sh
    1. No private symbols exported. (This is also checked by releasetest.tcl)
    2. No undesirable library dependencies
    3. No private symbols exported in MinGW (check using tool/symbols-mingw.sh)
    4. No undesirable library dependencies on MinGW

  17. Fossil updated to use the latest SQLite.
    1. No compiler warnings
    2. Used on active websites with no issues

  18. Firefox recompiled using lastest SQLite.
    1. No SQLite compiler warnings
    2. Active use with no issues noted

  19. CEROD tests in the test/ subdirectory.
  20. SEE tests using TH3:
    1. see.c
    2. see-aes128-ofb.c
    3. see-aes256-ofb.c
    4. see-rc4.c
    5. see-aes128-ccm.c
    6. At least one of the above using test.rc
    7. At least one of the above using memdebug.rc
    8. At least one of the above on Linux
    9. At least one of the above on Mac
    10. At least one of the above on Windows

  21. ZIPVFS tests:
    1. testfixture ../zipvfs/test/zipvfs.test (See test/README.txt in the ZIPVFS source tree for details.)
    2. th3make zipvfs.rc test.rc
    3. th3make zipvfs.rc memdebug.rc
    4. th3make zipvfs.rc min.rc -DTH3_LOWMEM; valgrind ./th3
    5. th3make min.rc
    6. At least one of the above on Linux
    7. At least one of the above on Mac
    8. At least one of the above on Windows

  22. NX-Devkit compiles and runs "tclsh th3make test.rc nx_compress.o" without error.
  23. Amalgamation autoconf tarball.
    1. Builds
    2. Works on Linux
    3. Works on Mac

  24. TEA archive builds correctly and runs:
    1. Linux
    2. Mac

  25. Run performance tests comparing the new SQLite release against the previous version. Verify no performance regressions.
    1. The TCL speed*.test scripts
    2. The TH3 speed tests
    3. sqlite3 sqlite.fossil .dump >speed-c.sql
      fossil timeline -R sqlite.fossil -n 300 -sqltrace 2>>speed-c.sql
      fossil rebuild sqlite.fossil -sqltrace 2>>speed-c.sql

  26. Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms.
    1. linux
    2. mac
    3. openbsd
    4. windows native mingw
    5. windows nmake
    6. sparc solaris using autoconf

  27. Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
  28. Cross-platform tests. Verify the ability of databases, WAL files, and rollback journals to be copied and used between 32-bit and 64-bit systems and between big-endian and little-endian systems.
    1. 32-big to 64-little, database
    2. 32-big to 64-little, WAL
    3. 32-big to 64-little, rollback
    4. 64-little to 32-big, SEE database
    5. 64-little to 32-big, ZIPVFS database
    6. 64-little to 32-big, CEROD database

  29. Build and verify correct operation of sqlite3_analyzer on:
    1. Linux
    2. Mac
    3. Sparc Solaris
    4. Win32 (MinGW)
    5. Win32 (MSVC) and verify correct output.

  30. Tests for the sessions branch with macros SQLITE_ENABLE_SESSION and SQLITE_ENABLE_PREUPDATE_HOOK
    1. tclsh th3make session.rc test.rc (on windows)
    2. tclsh th3make session.rc test.rc (on unix)
    3. tclsh th3make session.rc cov.rc
    4. tclsh th3make session.rc min.rc -norun -DTH3_LOWMEM; valgrind ./th3
    5. make test (on windows)
    6. make test (on unix)
    7. testfixture test/session.test

  31. Verify that the sqlite3-all.c build target works and that the resulting sqlite3-all.c file and its include files (sqlite3-?.c) compile and run the same as the single-file amalgamation.
  32. System.Data.SQLite builds and checks out using the SQLite core