{"id":47,"date":"2009-07-05T21:01:41","date_gmt":"2009-07-05T21:01:41","guid":{"rendered":"http:\/\/abcnotation.com\/blog\/?p=47"},"modified":"2010-03-16T19:34:29","modified_gmt":"2010-03-16T19:34:29","slug":"crash","status":"publish","type":"post","link":"https:\/\/abcnotation.com\/blog\/2009\/07\/05\/crash\/","title":{"rendered":"Crash!"},"content":{"rendered":"<p>I knew it would be tempting fate to say that the website hadn&#8217;t crashed.<\/p>\n<p>No sooner had I written the last blog when &#8230; CRASH &#8230; down it came.<\/p>\n<p><!--more-->I tracked it down to an IP address in Italy and I&#8217;m pretty sure it was a <a onclick=\"javascript:pageTracker._trackPageview('\/outgoing\/en.wikipedia.org\/wiki\/Web_crawler');\"  href=\"http:\/\/en.wikipedia.org\/wiki\/Web_crawler\">website crawler<\/a> (or copier) rather than a malicious attack. Nonetheless, it was requesting several pages a second (by contrast the googlebot requests one page every 30-40 seconds) and although the server stayed up for two hours serving pages at a furious rate, eventually it was overloaded.<\/p>\n<p>Anyway, I think I&#8217;ve fixed it now. (And if you are a user whose ISP is Telecom Italia Net and you&#8217;d like to get access again &#8211; please fix your crawler to be a little more <a onclick=\"javascript:pageTracker._trackPageview('\/outgoing\/en.wikipedia.org\/wiki\/Web_crawler#Politeness_policy');\"  href=\"http:\/\/en.wikipedia.org\/wiki\/Web_crawler#Politeness_policy\">polite<\/a> and then get in touch. I don&#8217;t want to exclude anyone who&#8217;s genuinely interested in visiting the site.)<\/p>\n<p>Chris<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I knew it would be tempting fate to say that the website hadn&#8217;t crashed. No sooner had I written the last blog when &#8230; CRASH &#8230; down it came.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[446,112,130,132,445],"_links":{"self":[{"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/posts\/47"}],"collection":[{"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/comments?post=47"}],"version-history":[{"count":7,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/posts\/47\/revisions"}],"predecessor-version":[{"id":56,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/posts\/47\/revisions\/56"}],"wp:attachment":[{"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/media?parent=47"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/categories?post=47"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abcnotation.com\/blog\/wp-json\/wp\/v2\/tags?post=47"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}