Documentation Source Text

Check-in [b47f5ff005]
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

Overview
Comment:Update althttpd.c to exclude HTTrack, which seems to be an abusive spider.
Downloads: Tarball | ZIP archive
Timelines: family | ancestors | descendants | both | trunk
Files: files | file ages | folders
SHA3-256: b47f5ff005cc3a2258a6f3482663086d4225ee535b3e1b0f4e74a86f6431d9ba
User & Date: drh 2017-07-15 15:30:01.615
Context
2017-07-17
10:15
Fix a hyperlink to the STMT extension. (check-in: c9011466c1 user: drh tags: trunk)
2017-07-15
15:30
Update althttpd.c to exclude HTTrack, which seems to be an abusive spider. (check-in: b47f5ff005 user: drh tags: trunk)
2017-07-14
15:38
Update the change log and the SQLITE_STMT documentation to reflect the new table name. (check-in: d2cf72e32f user: drh tags: trunk)
Changes
Unified Diff Ignore Whitespace Patch
Changes to misc/althttpd.c.
︙︙
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204

  }

  /* Disallow requests from certain clients */
  if( zAgent ){
    if( strstr(zAgent, "Windows_9")!=0
     || strstr(zAgent, "Download_Master")!=0
     || strstr(zAgent, "Ezooms/")!=0
   /*|| strstr(zAgent, "bingbot")!=0*/
     || strstr(zAgent, "AhrefsBot")!=0
    ){
      Forbidden(__LINE__);  /* LOG: Disallowed user agent */
    }
  }
#if 0
  if( zReferer ){








|








1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204

  }

  /* Disallow requests from certain clients */
  if( zAgent ){
    if( strstr(zAgent, "Windows_9")!=0
     || strstr(zAgent, "Download_Master")!=0
     || strstr(zAgent, "Ezooms/")!=0
     || strstr(zAgent, "HTTrack")!=0
     || strstr(zAgent, "AhrefsBot")!=0
    ){
      Forbidden(__LINE__);  /* LOG: Disallowed user agent */
    }
  }
#if 0
  if( zReferer ){
︙︙