My Projects

Tell us about your projects. Update us regularly.
Post Reply
User avatar
BeJay
Maker
Posts: 139
Joined: Mon Jun 23, 2014 6:31 pm
Location: Perth
Contact:

My Projects

Post by BeJay » Sun Jun 07, 2015 12:09 am

May have to rethink my project blog server...

http://bjshed.better-than.tv/blog/?x=en ... 606-151628

parkview
Guru Maker
Posts: 603
Joined: Tue Jun 24, 2014 8:25 pm
Location: Busselton
Contact:

Re: My Projects

Post by parkview » Sun Jun 07, 2015 8:47 pm

Hi Beau,

I feel your pain there. I moved my home external web-server out into the cloud some 6-7 years ago. I was just thinking earlier this year that perhaps I could move it back in house, then some time ago I noticed that the Internet seemed to 'slow down'. Last week I braved Telstra support and found that the Busselton exchange is congested, with no plans to fix/upgrade it, customers/me are currently being shaped down to 6Mb This is back to the old ADSL days :cry:

I do love some of the comments they wrote up about your predicament - very witty. Talking of spiders and scrapers, a number of years ago I spent a weekend playing around with my website logs, looking at Drupal page load times, what the robots where looking/crawling around etc. As you say, on small sites, most of the traffic that we pay for are just them - visiting over and over again. I was pondering :idea: about writing some sort of automated firewall system, that would only allow a crawler in once, after a new page was posted, then they would be blocked/firewalled off till next time.

Come on NBN with a high upload speed!

User avatar
BeJay
Maker
Posts: 139
Joined: Mon Jun 23, 2014 6:31 pm
Location: Perth
Contact:

Re: My Projects

Post by BeJay » Tue Jun 09, 2015 11:17 pm

You are on the money Paul!

The scrapers are the new "bandwidth hogs" ;)

https://www.youtube.com/watch?v=sOL2GZh26pY

https://www.youtube.com/watch?v=aqj7De-0j8M

Post Reply