Facebook's Rosetta AI is perusing your images

A figurine is seen in front of the Facebook logo in this illustration taken

While tools to transcribe text are nothing new, the company faces different challenges because of the size, the sheer volume of photos shared each day on Facebook and Instagram, and the number of languages supported on its global platform.

To handle this monumental task, the company has built a sophisticated artificial intelligence which is known by the name as Rosetta. The system can analyze the contents of not only standalone files, but also individual frames within videos. First, the machine learning systems detects retangular regions that could potentially contain text.

According to a post published on its official blog, Facebook has identified offensive memes and small videos with text overlays as the target, and has developed an AI called Rosetta to sift through billions of images in real-time - uploaded on Facebook and Instagram - for identifying hate speech and offensive content. It scans all the images with the help of a technique that differs from those employed by traditional text recognition software. Facebook said that the approach would enable the Rosetta which can recognize any type of words of any length which is even the ones that it was not exposed to during the training phase of development.

"Once In A Lifetime" Hurricane Florence Weakens, Begins Lashing Eastern US
And while she hadn't thought about what she'll do if Hurricane Florence floods her neighborhood again, Hardin's here to stay. Emergency declarations were in force in Georgia, South and North Carolina, Virginia, Maryland and the District of Columbia.

"Once we obtain the bounding boxes for word locations on an image, they are cropped and resized to a height of 32 pixels with the aspect ratio maintained", detailed the Facebook engineers who worked on Rosetta. It then uses text recognition technology to understand the context of the text and the image together.

Censorship has been a huge topic in the tech industry lately, with Facebook, Apple, Twitter, and several other major platforms banning Infowars radio host Alex Jones from using their services. It will be extended to more areas in the future. As great as the technology is, Facebook is seeking something better: the ability to pull text from images and understand the text. So while Rosetta isn't committed to images, their pervasiveness on Facebook and Instagram will without a doubt make them a noteworthy utilize case, particularly in Facebook's discovery of hostile material.

Related News:

  • Nintendo Switch firmware update 6.0.0 detailed ahead of Online launch

    Nintendo Switch firmware update 6.0.0 detailed ahead of Online launch

    Nintendo says is a separate article that the Switch eShop will go offline for maintenance after this firmware update is released. Nintendo is also promising a new Animal Crossing title in the same year, as well as Yoshi's Crafted World .
    Check out the official iPhone XS, XS Max and XR promo videos

    Check out the official iPhone XS, XS Max and XR promo videos

    If you're an iPhone 6s devotee, you can still buy the devices through your carrier, or find refurbished versions online. Apple's annual hardware event may have been an exciting day for gadget lovers, as three new iPhones were introduced.
    CDC Issues Guidance to Travelers as Influenza Season Nears

    CDC Issues Guidance to Travelers as Influenza Season Nears

    So, the best time to get a flu shot is as soon as possible - and you might even be able to get it for free through your insurance. Almost 80 percent of the children who died of flu past year for example, were not vaccinated against flu .
  • Mobile Sprint merger review delayed by FCC

    Mobile Sprint merger review delayed by FCC

    The companies had tried to merge twice in the past, but regulators and internal disagreements prevented it from happening. Sprint and T-Mobile in April announced a deal to form a new company and push development of a super-fast 5G network.
    United Nations  chief pushes for protection of civilians in Syria's Idlib

    United Nations chief pushes for protection of civilians in Syria's Idlib

    But Russian and Syrian regime air raids on Idlib have intensified in recent days, with a hospital among the targets. Turkey is concerned that HTS could seek to use civilians as human shields and prevent them from reaching Afrin.
    CoreLogic Estimates $170.2B in Potential Damage From Hurricane Florence

    CoreLogic Estimates $170.2B in Potential Damage From Hurricane Florence

    States of emergency have been declared in North Carolina, South Carolina and Virginia in preparation for Florence's arrival. Hyde County officials announced that all Ocracoke Island visitors have been ordered to evacuate starting noon on Monday.
  • Scientists discover new fish species in ocean's terrifying depths

    Scientists discover new fish species in ocean's terrifying depths

    Apart from snailfish, they also found various freaky creatures in the environment such as long-legged isopods or Munnopsids . The creatures can swim backwards and upside down, have long legs like a spider, and paddles to help them swim.
    Emery challenges Ozil to do more

    Emery challenges Ozil to do more

    Chief executive Ivan Gazidis' future looks less certain, though, with AC Milan having re-opened negotiations with him . Sports Mole looks at how Arsenal could line up for Saturday's trip to Newcastle United in the Premier League .
    United States  companies in China say tariffs are hurting

    United States companies in China say tariffs are hurting

    But Kudlow was non-committal over the chances of a breakthrough, adding: "I guarantee nothing". This latest tweet underscores that concern.
  • Andy Dalton finds a way to light up the Ravens this time

    Andy Dalton finds a way to light up the Ravens this time

    Flacco's new weapons-Michael Crabtree, John Brown and Willie Snead-all caught touchdowns from Joe Flacco in Week 1 . Most fans are aware that the Ravens are more known for their defense rather than they are for their offense.
    Seahawks react to Seattle Storm's third WNBA championship

    Seahawks react to Seattle Storm's third WNBA championship

    Bird has played on all three championship teams. "Obviously, this finals didn't go the way we wanted it". Despite the misfires, Washington rallied from down 18 points to trailing 72-67 with 6:49 remaining.

    Task Force 1 establishes base camp in advance of Hurricane Florence

    And the storm surge , which could be as much as 12 feet in some areas, will be on top of sea level rise from climate change. On Thursday morning, South 17th Street, usually teeming with commuter traffic by 6:30 a.m., was almost devoid of cars.


Most liked

Final Fantasy Is Being Well Represented On Switch
Final Fantasy 15: Pocket Edition is kicking off this string of Final Fantasy releases for the Switch, and it is available now. Additionally, what about all of those Final Fantasy games that appeared on Nintendo hardware?

Hurricane Florence shifts south; Georgia and Carolinas hunker down
The hurricane center said Florence will approach the coast Friday and linger for a while before rolling ashore. More than 1 million people have been ordered to evacuate the coastlines of the Carolinas and Virginia.

Ubisoft Reveals Massive Assassin's Creed
Assassin's Creed: Odyssey will have something for everyone as Ubisoft brings more content to the table. At the time of its release, Assassin's Creed III was considered to be something of a disappointment.

Bomb explosion kills 50 people in Afghanistan, say TV channels
A suicide bomber on Tuesday targeted a protest in Mohmand Dara district in Nangarhar province. Reports earlier on Tuesday spoke about a chain of explosions near three schools in Nangarhar.

Georgia Declares Emergency as Hurricane Florence Approaches
Wednesday, Florence was 435 miles from Wilmington, N.C., moving northwest at 16 mph, according to the National Hurricane Center . Even miles away from the Atlantic, North Carolina residents in low-lying areas were boarding up and emptying stores.

Here's When You Can Pre-Order Your New iPhone From Telstra
With curved corners, it's also slightly thinner, has more reliable reception and two times faster, thanks to a new processor. The XS and XS Max have dual 12-megapixel rear cameras and a dual 7-megapixel selfie camera - just like the iPhone X .

Hurricane Florence hours away from Carolinas
Water kills more people in hurricanes than wind, and he said it will still be an extremely unsafe storm for rain and storm surge. Up to 10 inches of rain is predicted as far west from the Atlantic Ocean as Charlotte, N.C., the NHC's Ken Graham said Thursday.

The biggest announcements from Apple's iPhone Xs event
Perhaps the most shocking news to come out of the iPhone event was that Apple has chose to kill off the iPhone X . The two phones are nearly identical in design and features, with the XS being a refinement of last year's phone.

Tottenham’s Hugo Lloris out for ‘several weeks’ with thigh injury
Foyth has now returned to training, however, but Sissoko is not expected to resume training with the group again until next week. The news is a bitter blow for boss Mauricio Pochettino, who was hopeful of selecting the pair for this weekend.

Governor Deal issues State of Emergency across Georgia
Flooding well inland could wreak environmental havoc by washing over industrial waste sites and hog farms . Florence is being trailed in the Atlantic by two other storms - Hurricane Helene and Tropical Storm Isaac.

Hurricane Florence: Mapping the thousands of animal waste lagoons, nuclear sites threatened
His remarks fell flat in Puerto Rico where islanders are continuing to struggle to recover a year after the Category 4 storm. Robinson noted that some of the forecasts are expecting rainfall of 800 to 1000 mm over a 30-hour period.

Hurricane Florence has weakened but it will still be devastating
After landfall, the storm is expected to linger over the area for a few days, which would result in rising river levels and lakes. State officials and the National Weather Service warned the storm's weakening only relates to wind speed, not surges or flooding.

IPhone XS, XS Max: First Impression
The last time it discontinued an iPhone model a year after announcing it was the iPhone 5, released in 2012 and canned in 2013. Apple hasn't publicly said why, though CEO Tim Cook may explain the firm's thinking in a future earnings call.

Mets' Wright to return for final game September 29
Wright will be activated from the disabled list on September 25 for the Mets' final homestand, and he'll start on September 29. The Mets just held a press conference to announce what they're doing with third baseman and captain David Wright .

Yoshi game for Switch titled Yoshi’s Crafted World according to Nintendo website
The 7.0 magnitude quake has claimed the lives of at least seven people and buried many homes under landslides. Many Nintendo fans are begging the company for a new Animal Crossing installment for Nintendo Switch .