Documentation Source Text

Check-in [54090fd49f]
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

Overview
Comment:Update indicative performance numbers for populating a large database in fts3.html.
Downloads: Tarball | ZIP archive
Timelines: family | ancestors | descendants | both | trunk
Files: files | file ages | folders
SHA1: 54090fd49f6c9e0cae43f8a26575f2973fd13c68
User & Date: dan 2009-11-30 15:27:49.000
Context
2009-11-30
15:37
Clarify authorship of the original FTS3 code in fts3.html. (check-in: daf96c0053 user: dan tags: trunk)
15:27
Update indicative performance numbers for populating a large database in fts3.html. (check-in: 54090fd49f user: dan tags: trunk)
13:55
Fix typo on the famous.html page. Other updates prior to publication. (check-in: 5572b2965d user: drh tags: trunk)
Changes
Unified Diff Ignore Whitespace Patch
Changes to pages/fts3.in.
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
  the LIKE query matches rows that contain terms such as "linuxophobe"
  or "EnterpriseLinux" (as it happens, the Enron E-Mail Dataset does not
  actually contain any such terms), whereas the MATCH query on the FTS3 table
  selects only those rows that contain "linux" as a discreet token. Both 
  searches are case-insensitive. The FTS3 table consumes around 2006 MB on
  disk compared to just 1453 MB for the ordinary table. Using the same
  hardware configuration used to perform the SELECT queries above, the FTS3
  table took just over 39 minutes to populate, versus 25 for the ordinary
  table.

<p class=todo> 
  Check if the numbers are still valid using the refactored version.

[h2 "Creating and Destroying FTS3 Tables"]

<p>
  Like other virtual table types, new FTS3 tables are created using a 
  \[CREATE VIRTUAL TABLE\] statement. The module name, which follows
  the USING keyword, is "fts3". The virtual table module arguments may
  be left empty, in which case an FTS3 table with a single user-defined 







|


<
<
<







58
59
60
61
62
63
64
65
66
67



68
69
70
71
72
73
74
  the LIKE query matches rows that contain terms such as "linuxophobe"
  or "EnterpriseLinux" (as it happens, the Enron E-Mail Dataset does not
  actually contain any such terms), whereas the MATCH query on the FTS3 table
  selects only those rows that contain "linux" as a discreet token. Both 
  searches are case-insensitive. The FTS3 table consumes around 2006 MB on
  disk compared to just 1453 MB for the ordinary table. Using the same
  hardware configuration used to perform the SELECT queries above, the FTS3
  table took just under 31 minutes to populate, versus 25 for the ordinary
  table.




[h2 "Creating and Destroying FTS3 Tables"]

<p>
  Like other virtual table types, new FTS3 tables are created using a 
  \[CREATE VIRTUAL TABLE\] statement. The module name, which follows
  the USING keyword, is "fts3". The virtual table module arguments may
  be left empty, in which case an FTS3 table with a single user-defined