Of course we all know about FYWP’s problem with words-that-might-be-spam (from casino to soCIALISm) but I did not know that the general dumb-AI-censorship issue had a name:
We all know automatic profanity filters on message boards and elsewhere on the Internet can be ridiculously and unimaginatively strict. But the problem is much worse: Sometimes, it sees swearwords inside other words. Thus, you can get hilarious Malapropers — like “hecko” instead of “hello”, or “teasfecesn” instead of “teaspoon” — or else you get results like “cl***” instead of “class”, ironically making those words more profane, not less. Assuming of course that the filter doesn’t outright censor the whole message and ban you from the board.
This is known as the Scunthorpe Problem, after an incident in 1996 when AOL’s rather simple-minded dirty-word filter prevented residents of several English towns and counties — among them Scunthorpe, Penistone, Lightwater and Middlesex — from creating accounts with AOL because it matched strings within the town names to “banned” words. Since it also checked the town names against the postal codes, users from these towns could not get around it by entering modified versions of the names — they were darned if they did, darned if they didn’t. It’s also known as the “clbuttic mistake“. The ubiquity of the trope suggests that the profanity filter industry employs a lot of very lazy programmers…
Warning: TVTropes is an incredibly addictive time-sink, so much so that I’d hesitate to post a link during normal business hours. You Have Been Warned.
Triva note — When Cole offered me front-pager status here, he said he’d first noticed my comments talking about shoes; at the time, FYWP considered shoe a potent spam word, by some unfathomable WordPress logic. So, if not for that byway of the Scunthorpe Problem, y’all would quite possibly never have known me except as a continual commentor, which will give a couple of my personal trolls even more reason to loathe FYWP…
Dolly Llama
Oh yeah? FUCK you, Anne Laurie.
Just playin’. :)
ETA: First.
Roger Moore
This is why \b (the regular expression code that matches at the beginning or end of a word) was invented. The AOL example is particularly stupid, though; if you’re going to match the postal code against the city name, you should be smart enough to recognize that they’re not trying to slip a dirty word through when they use it.
Tommy
As somebody that works in WordPress for a living I am always stunned by the wide range of plugins. A client will want to do something totally off the wall. I wonder how I will do it. Then of course there is a plugin that does exactly what I need. I say this cause you’d assume somebody would have created something that is better then what we have now.
Tara the Antisocial Social Worker
My favorite was the right-wing website that automatically replaced “gay” with “homosexual,” resulting in a sports story about a runner named “Tyson Homosexual” winning a race.
Roger Moore
It’s like Wikipedia’s frivolous sidekick, and shows the real power of pervasive linking.
Hal
I finally saw an al sharpton/sterling comparison on the book of faces today. Posted by an old school friend who doesn’t get why sterling got banned but al sharpton got a teevee show, since both said racist things. I love what a boogeyman sharpton is to some folks.
Everytime I see a “where’s all sharp ton?” Comment when there is an alleged racial incident involving white victims I always want to say sharpton doesn’t show up until one of us says tawana brawley three times in a mirror.
WereBear
I spent one whole feverish weekend reading through it… and yet! There was MORE!
And it was just as delightful when I was well.
Tommy
@Hal: Al has maybe had something of a checkered past, but talk about somebody I think has reinvented himself successfully. Just with the Martin shooting in FL …. well if it wasn’t for him I am not sure it would have ever gotten the attention he deserved.
MikeJ
The problem isn’t lazy programmers, it’s project managers that don’t want to devote adequate resources to solving a problem.For 90% of the things you see half assed in a computer program, the programmer knows how half assed it is, has told the PM how half assed it is, and told them how long it will take to do it right.
“We’ll fix it in 2.0.”
Tommy
@MikeJ: That is very, very true. I don’t consider what I do programming. HTML, CSS, some light PHP. But I’ve worked as a program/project manager and I almost never had an issue with the people writing the code. For me it was always feature creep from the top management. A set of specs would be agreed upon. A timeline. Then next thing you know the boss wanted another 100 things done. No additional resources and usually the same timeline. Not sure how you work in an environment like that.
PsiFighter37
Waiting for GoT, Silicon Valley, and Veep. Fuck y’all because HBO 9-11 PM EDT rox0rs
MikeJ
@Tommy: I should have mentioned that when I worked at AOL, it was as a PM, not a codeslinger.
Mustang Bobby
Rick Perry says he’s thinking about running for president in 2016. (Happy dance!) Because there’s always room for one more in the Klown Kar.
Tommy
@Mustang Bobby: I’ll never understand, outside you have to have a pretty big ego to run for the top offices, why anybody would want to be POTUS. I get the power. You go down in the history books. I’d also have to think there is a thrill to it.
But Perry (and many others) could work a few hours a week at a think think or say SMU. Get paid a ton of money to give speeches.
Again I just don’t know why you’d want to run when folks like them have all the options they do.
Tommy
@PsiFighter37: Same here. I wasn’t sure what to expect from Silicon Valley but it one of the few shows on TV, at last for me, that makes me laugh out loud.
WaterGirl
@MikeJ: I had no idea AOL had a Prime Minister. Learn something new every day!
Culture of Truth
So true
AOL should have used human beings to read every single thing on the site and check it for profanity like others providers did.
SiubhanDuinne
@MikeJ:
The project manager’s motto:
TheMightyTrowel
Oh Hey! I’ve been to Scunthorpe (don’t bother)!
SiubhanDuinne
@Mustang Bobby:
Uh huh. Uh huh.
Breezeblock
I am a Scunthorpe Iron supporter (World Football) and even have the jersey.
NotMax
GIGO is as ancient as the human brain.
Mnemosyne
@Tommy:
I like that it’s a workplace comedy that’s actually about, well, work, not just everyone’s latest romance.
Anne Laurie
@SiubhanDuinne: I’ve actually heard “Good, fast, cheap — pick any two” referred to as the Economists’ Golden Triangle. The way it was explained to me, as you weight any corner of the triangle, the others become proportionally smaller in response… so you can get fast food cheaply but it won’t be very good, or you can get good food cheaply but it’ll take forever to prepare/cook, or you can get good food quickly but it’ll cost more. The google image page is… rather entertaining.
Nanette
Ha ha… reminds me of a chatroom filter that kept censoring me, only it took me a while to notice what was going on. Everyone was talking ancestry and I couldn’t figure out why people kept asking me mine, when I’d posted over and over that I was half Nigerian, the rest a bunch of other stuff. Well, you can guess what the filter thought I was *trying* to say and it wasn’t going to let me say anything even resembling that. No asterisks or warnings–it just didn’t let the comment thru at all.
I forget what I did to get around it, but I did, eventually.
Nanette
lol, and that same thing may be why my comment went straight to moderation, too.
WaterGirl
@Anne Laurie: Thanks for the link to the image page. I liked the one where GOOD was already checked, and you could choose between FAST and CHEAP. And what was up with the image of what looked like a big lady bending over from behind???
Currants
Yes but no garden threads if no AL. So win for us.
Comrade Mary
Courtesy of Billy Bragg, a classic English joke:
What three football teams have swearwords hidden inside their names?
Arsenal, Scunthorpe and Manchester Fucking United.
mattH
“Nobody’d wear Kicker boots if they were made in Scunthorpe!”
Every time I hear Scunthorpe. Every. Time.
Omnes Omnibus
@Comrade Mary: Awesome.
divF
@efgoldman: Haven’t you ever been at a project meeting where you just wanted to start yelling “Ok, that’s it, I’ve had enough ! All of you Klowns, back in the Kar, and stay there!”
PurpleGirl
When I worked in publishing we also used the three “fast, cheap, good” as criteria for levels of proofreading and copy editing assignments.
ETA: Anne Laurie — I think you’re fantastic. I look forward to your posts.
A Humble Lurker
To answer the question about why shoes trips the filter, a much more savvy relative of mine informed me it’s because of the word ‘hoes’ being in shoes.
JGabriel
TVTropes:
One would think that anybody who wants to devote their career to filtering dirty words from the internet probably didn’t have a lot ambition to begin with.
Chet
@Tara the Antisocial Social Worker:
Enola Homosexual
Homosexual Talese
Marcia Homosexual Harden
Don we now our homosexual apparel
We’ll have a homosexual old time
HeartlandLiberal
For a hoot and a holler, enter the acronym FYWP in Google, and scan the first page of results.
Almost all the entries except the first are for First Year Writing Programs at various universities, who are using the acronym for the programs, apparently,
Quelle Ironie.
WaterGirl
@JGabriel: You’ll probably never see this, but you made me laugh out loud, within 10 minutes of waking up this morning. Win!
Sondra
You’re right. TVTropes is genius and a real fun timewaster . Bravo.