The simplest way to monitor free disk space on Linux serwer, just place it in crontab:
0 8 * * * df -h | awk '/^\// && $5 > 95 { print "missing space", $0 }'
and ensure e-mail to this user is forwarded to you then you will see e-mail when occupied space is higher than 95% on any disk.
Pretty simple.
Most of us are using Web2.0 sites but massive user base that logins every second is a big challenge to system performance. Let’s see how engineers working for MySpace, Facebook and Twitter are doing their job.
Note: all uptime buttons and images below are generated in real-time, you can click on images / baners to see reports with details directly from site-uptime.net.
MySpace

MySpace uptime
(more…)
I just got an email from my monitoring system:
Site: http://twitter.com is down ('502 Bad Gateway')
Looked at main Twitter page and saw this picture:

I checked that Twitter responds very slowly and randomly shows “over capacity” page. You can see details on site-uptime public report. Here’s response graph from last days (measure interval 15 minutes, HEAD requests):

UPDATE (2010-04-15): after few weeks the situation is getting worse:

Próbowałem dziś zalogować się na GL i zauważyłem, że serwis nie działa tak jak powinien (częste “timeouty” w przeglądarce). Postanowiłem przyjrzeć sie bliżej działaniu serwera i założyłem monitor na niego przy użyciu site-uptime.net (interwał 15 minut, metoda: HEAD HTTP/1.0). Oto rezultat po dwóch godzinach monitorowania (ujemna wartość oznacza brak dostępności serwera):
(more…)
Twitter is a “free social networking and microblogging service that enables its users to send and read messages known as tweets”. It’s gaining popularity last months – userbase is growing rapidly. It’s interesting to analyse Twitter’s server infrastructure load by observing service response time over few days.
(more…)