Google's big bad appetite
Posted on August 10, 2004 @ 15:33 in Blogosphere
I'm not particularly interested in the stats generated by my website. I have a generous hosting plan and I don't generate that much traffic. Today I looked at the website's stats for the first time in a couple of months. May 2004 saw a huge spike in traffic, almost 900 megabytes, whereas previously the website was generating somewhere between 400 and 500 megabytes of traffic. Since May traffic has fallen a little, but is still at roughly 750 megabytes.
When I looked closer at my stats I saw that the huge spike in traffic was largely generated by Google's webcrawling Googlebots. Until March 2004 my website got about 100-200 hits a month from two or three different Googlebots generating some 2 megabytes of traffic. Not even enough to end in the top 10 of the "Sites by Kilobytes" section of the stats.
Come April 2004 Googlebot traffic is soaring and in May the top 5 is completely taken over by Googlebots, generating 35% of the total number of hits on the website and sucking up 40% of the total consumed bandwith. That's 365 megabytes out of a grand total of 898 megabytes.
I like Google's accurate and up-to-date search results as much as the next guy/gal, but this is getting ridiculous.
I sometimes post more than once a day, but most of the time it's once every couple of days. Indexing my website no more than 4 times a day should be plenty for any search engine. Does anybody know how to tell Google to ease up a little on my poor little website?
Comments and Trackbacks
No comments or trackbacks for this entry yet.
Post a comment
Comments and trackbacks have been closed on this site. My apologies.
Since MT-Blacklist inexplicably stopped working I had no other recourse than close comments and trackbacks to stop the spam. I've been meaning to correct this for quite a while, but life got in the way... in a good way I should add.