home dorian moore : (digital media) technologist

  • works Bad Robot [2004.09.14]

    GigaBot/2.0 is hammering over accessing my server...

    Why does it need to request my robots.txt this much? Not to mention all the pages it is indexing as well. hmmmmm. 

    64.62.168.16 - - [12/Sep/2004:05:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:07:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:13:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:14:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:18:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:26:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:27:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:33:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:34:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:07:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:12:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:27:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:28:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:37:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:42:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:42:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:47:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:53:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:54:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:06:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:17:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:25:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:25:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:29:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:30:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:33:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:38:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:39:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:02:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:13:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:15:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:28:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:42:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:43:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:45:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:51:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:55:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:01:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:01:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:07:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:24:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:25:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:32:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:33:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:48:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:53:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:54:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:04:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:13:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:14:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:19:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:19:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:22:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:35:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:44:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:45:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:56:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:56:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:23:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:37:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:39:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:42:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:51:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:51:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:02:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:19:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:20:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:31:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:32:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:39:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:44:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:00:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:00:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:04:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:11:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:11:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:14:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:21:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:22:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:41:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:45:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:52:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:53:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:56:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:03:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:06:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:10:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:22:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:36:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:38:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:42:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:57:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:59:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:02:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:13:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:16:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:27:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:28:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:39:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:46:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:47:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:53:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:01:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:02:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:13:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:17:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:34:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:40:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:52:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:53:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:58:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:59:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:12:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:18:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:19:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:33:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:34:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:34:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:45:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:46:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:49:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:50:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:53:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:54:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:59:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:03:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:09:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:16:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:16:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:21:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:24:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:25:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:28:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:37:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:39:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:44:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:44:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:53:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:57:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:00:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:01:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:06:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:07:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:13:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:17:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:18:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:24:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:25:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:27:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:33:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:47:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:49:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:56:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:57:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:06:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:06:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:13:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:16:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:20:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:21:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:29:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:30:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:37:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:37:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:45:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:48:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:51:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:01:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:08:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:10:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:24:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:28:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:29:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:45:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:48:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:48:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:58:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:59:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:12:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:12:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:19:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:28:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:33:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:54:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:54:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:02:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:07:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:13:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:16:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:32:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:32:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:37:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:43:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:54:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:55:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:01:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:09:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:09:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:14:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:22:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:25:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:27:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:31:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:32:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:37:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:38:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:53:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:53:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:01:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:02:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:12:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:19:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:19:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:33:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:39:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:42:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:52:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:52:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:59:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:07:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:19:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:21:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:28:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:32:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:32:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:55:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:08:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:11:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:15:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:22:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:23:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:28:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:37:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:48:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:49:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:56:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:57:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:02:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:15:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:22:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:26:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:36:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:38:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:56:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:07:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:14:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:14:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:20:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:30:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:32:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:44:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:56:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:04:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:04:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:15:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:15:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:22:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:27:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:27:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:49:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:53:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:54:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:02:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:06:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:18:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:28:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:29:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:36:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:45:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:50:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:51:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:02:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:07:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:18:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:18:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:26:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:26:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:40:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:43:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:44:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:47:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:49:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:02:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:07:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:12:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:18:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:22:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:23:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:33:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:45:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:52:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:57:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:07:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:08:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:11:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:11:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:16:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:20:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:32:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:32:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:41:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:55:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:56:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:01:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:06:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:19:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:30:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:36:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:37:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:01:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:04:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:07:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:10:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:29:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:32:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:55:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:55:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:57:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:03:18:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:30:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:45:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:04:52:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:08:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:05:14:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:16:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:05:34:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:35:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:53:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:13:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:35:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:52:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:07:14:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:10:12:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:12:11:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"

    ... as far as I can tell /robots.txt is valid, and it's a static text file so it's not changing... bah.

    Posted by Dorian Moore on Tuesday, September 14, 2004 at 00:00 GMT
    Last modified Thursday, October 20, 2005 at 20:22 GMT

  • home home
  • page me
  • page page page page page page words
  • page page images
  • page page page page listening
  • page sounds
  • page radio
  • page page page page page page page works
  • page page page page likes
  • page page page page page page page page links
  • page mobile
  • page interfaces
  • page contact

    email

    telephone
    +44 (0)7976 242 805

    post
    Dorian Moore,
    Flat 2, Radnor Villas,
    45b King Henry's Walk,
    London,
    N1 4HQ.
    United Kingdom.

    ichat
    ichat://mtrapr

    aol instant messenger
    aim://mtrapr

    skype
    skype://dorianmoore