lighty's life

lighty developer blog

Getting Dugg

digg.com is currently having lighttpd.net on the front-page It looks like del.icio.us got also “infected” and its users joined right away

The rails-based mephisto-blog which is driving this site is generating static content which is served by lighty. Thanks to darix work on clean-url and mod-magnet impact on the site is minimal.

The usual morning starts with a coffee, reading mails and checking the referer-logs. That’s long story … reading log-files. Scrolling log-files are looking like the Matrix and are very relaxing.

As I don’t run a log-file analyzer I use a simple grep to scan the last few lines of the referer log:

$ tail -100000 .../access.log |\
   grep -v 'light_button' | \
   awk -F ' ' '{ print $11 }' |\
   grep -v '\(kneschke\|incremental\|lighttpd\.net\|/#"$\)' |\
   sort |\
   uniq -c |\
   sort -r -n | less

Usually we have mininova or rubyonrails sending us most of the referers over the day, but this morning we get:

   1081 "http://digg.com/"
    963 "http://www.digg.com/"
    615 "http://digg.com/linux_unix/lighttpd_Fast_Secure_and_Flexible_Web_Server"
     84 "http://digg.com/news"
     78 "http://www.digg.com/linux_unix/lighttpd_Fast_Secure_and_Flexible_Web_Server"
     58 "http://www.digg.com/view/technology"
     45 "http://www.digg.com/news"
     42 "http://del.icio.us/"
     35 "http://digg.com/view/technology"
     33 "http://digg.com/view/all"
     30 "http://www.digg.com/view/all"
     21 "http://doggdot.us/"
     15 "http://news.netcraft.com/"
     14 "http://digg.com/linux_unix"
     12 "http://www.digg.com"
      8 "http://www.planetmysql.org/?offset=60"
      8 "http://www.digg.com/linux_unix"
      8 "http://diggriver.com/"