Using Loggly and PagerDuty for threshold alerting
Loggly has a great blog post up about using alert birds to trigger PagerDuty alerts in response to heuristics on your logs:
“..in the example above, if my web servers are spewing 500 exceptions, I want my ops folks to get notified, provided there are more than 10 – I don’t want to wake anyone up over a little blip!”
As someone who gets those 2am phone calls, anything to eliminate false positives is exciting.