Google is using machine learning to go after online trolls.
In partnership with Alphabet subsidiary Jigsaw, Google has launched Perspective, a tool intended to identify toxic online comments. It's available as an API, so news organizations and publishers can use it to weed out abuse.
Perspective will score comments on how likely they are to be abusive, comparing them to comments that have been rated by human reviewers. "Each time Perspective finds new examples of potentially toxic comments, or is provided with corrections from users, it can get better at scoring future comments," Jigsaw President Jared Cohen wrote in a blog post.
Publishers that use Perspective can decide how to handle comments the system identifies as toxic.
"For example, a publisher could flag comments for its own moderators to review and decide whether to include them in a conversation," Cohen wrote. "Or a publisher could provide tools to help their community understand the impact of what they are writing—by, for example, letting the commenter see the potential toxicity of their comment as they write it. Publishers could even just allow readers to sort comments by toxicity themselves, making it easier to find great discussions hidden under toxic ones."
Google has been testing Perspective with the New York Times, which currently only allows comments on about 10 percent of its articles since it's so time-consuming to monitor them. Even at 10 percent, the publication still fields about 11,000 comments every day.
"We've worked together to train models that allows Times moderators to sort through comments more quickly, and we'll work with them to enable comments on more articles every day," Cohen wrote.
Related
- Nearly Half of Internet Users Have Been Harassed OnlineNearly Half of Internet Users Have Been Harassed Online
Google acknowledged that its technology is "still developing," but the more publishers that use it, the more Perspective will "develop a better understanding of what makes certain comments toxic," Cohen said.
Going forward, Google plans to add support for more languages and the ability to identify other patterns, like comments that are off-topic or spammy. "In the long run, Perspective is about more than just improving comments. We hope we can help improve conversations online," Cohen wrote.
Google might want to share some of Perspective's insight with Twitter, which is still grappling with how to battle trolls. Most recently, Twitter pledged to identify and collapse "potentially abusive and low-quality replies" so you don't see them as you scroll.
Google's parent company is learning how to identify bad comments so publications can foster better conversations.
Abusive users can now enjoy a cozier echo chamber than ever before.
Several privacy and technical concerns need to be addressed before that can happen.
The hackers said that about half the data stored on the affected servers was child pornography.
Relax Google 'Perspective' Attacks Trolls With Machine Learning stories
'I have been proven completely wrong,' the former Google CEO told the crowd at RSA.
But will they have their own numbers or simply act as an extension of your smartphone?
You can share your lists with others, and follow the lists your friends and family share with you.
Play the Google doodle game and think about pledging your support to pangolins.
Android Wear 2.0 adds standalone apps and a new user interface. Both are really good things.
Basically, bad moods breed trolling and trolling leads to more trolling.
Twitter will collapse 'potentially abusive and low-quality replies' so you don't see them as you scroll.
It's not always a straightforward process, but it's always a good thing to do on occasion.
Mention from the influencers legions of people respect is the biggest boost a marketer can get.
Kim Kardashian briefly removed 'West' from her name on social media accounts this week, and the Internet went INSANE. She is a West once more, but if you need to uncouple yourself on Twitter, Instagram, or Facebook, here's how.
The search giant released its top queries of the year.
Even a close watch on Election Day social posts couldn't see the Republican candidate's victory coming.
Stay safe when shopping for the holidays with these helpful tips.
Google's safety-minded car-mode software is no longer restricted to cars with compatible infotainment systems. Here's how to use it in any vehicle on nearly any Android phone.
Craigslist is a great place to look for a new place to live, if you're quick enough. Most the great listings get gone in a hurry. But with this trick, you can be among the first to know when a new listing meets your criteria.
Twitter is shutting down the Vine app -- the 6-second videos will remain as they are, but not forever...
If your dream is to work from home, and you don't know where to start, this list has something for you. Guaranteed.
The YouTube network will focus on 300 of its most popular creators going forward.
As the company suffers blow after blow to its reputation, users are deleting the app.
Setting a positive, productive tone for the day is all about giving yourself time to get your wits together. Prepare for your entry into the work arena, if you want to win there.
Waymo, the Alphabet subsidiary that took over Google's self-driving car project, says its trade secrets are now in Uber's hands.
There are an incredible number of people moving and shaking the existing global business environment. Here are some of them.
One of gaming's earliest Kickstarter flops is back from the dead.
Google's parent company is learning how to identify bad comments so publications can foster better conversations.
The device has cleared the FCC with better WiFi capability.
There's still time to catch up before Sunday's Academy Awards.