Like the common cold, spam would appear to be one of those afflictions that will be with us more or less forever. It’s killing Om, bugging Tim, driving Edward crazy, and is more or less the bane of my own existence these days.
The most common manifestation of the problem, of course, is email. Anyone who has an inbox has encountered it, and while some filtering services are better than others, none are perfect. Even Gmail, which many of the folks I know have begun to proxy their mail through as an ad-hoc filter, is beginning to fail beneath the relentless inventiveness of those pushing penny stocks and other useless crap. Our own email system, Zimbra, is likewise showing its cracks; every morning when I wake up, I’m greeted by one to two dozen unwelcome items. And despite dutifully marking these as Junk, the filters do not appear to be learning particularly well – forcing me to create filter after filter in an attempt to handle what the built in Junk filters miss. The client-side options available, were I inclined to use them, are not that much more impressive.
Unfortunately, spammers have not limited their attention to email systems. Our migration away from Movable Type to WordPress, in fact, became necessary in part because of MT’s increasing inability to handle the greater and greater volumes of spam we’re seeing. What kind of volumes? Well, as discussed before, the volume of traffic coming through our Apache instance on a monthly basis is always north of a million pageviews, and occasionally over 2. While I like to think we’re popular, we’re not that popular. Some of that’s wiki spam, some of that’s blog spam, some of that’s referrer spam, but precisely none of it is welcome.
Given the success of technologies such as Automattic’s Akismet service, I think some of the “spam will kill the web” doomcrying you’ll hear is overblown. Do I lose significant portions of every day and every week dealing with the problem? Yes. But I can still work, and conduct business effectively via the channels mentioned above. But when better than 9 of every 10 emails is spam, it’s time to acknowledge the severity of the problem. The scope of the problem is more obvious every day, and is a good indication that the scope of the solution may need to be similarly comprehensive.
I’m not nearly good enough to have a solution to the spam pandemic, but I know where I’d start looking for ideas: Akismet and Google. They’re not perfect, but they’re better than most.