Memes can now be described to blind people by the AI photo-recognition program.
- Researchers have developed a tool to help the visually impaired enjoy memes
- Software splits memes into templates to describe image and text
- The project aims to make social media accessible to 1.3 billion visually impaired people
Memes have invaded the internet, but for visually impaired people it can be hard to understand.
A new research project has developed a system for translating memes into an easier format for 1.3 billion people on the planet with some form of visual impairment.
The project analyzes visual memes and divides them into three different models that will make them easier for the visually impaired to understand.
Researchers can split a meme into three different models, making it easier for visually impaired people to understand context and meaning.
The tool, developed by Carnegie Mellon and Columbia University researchersIt takes advantage of a little-known feature of Facebook, Instagram and Twitter that allows users to add alternative text to images.
The software compares the new image with those found in its stored meme database and then applies one of three translation templates to it.
One model can split the meme into audio information, a second uses the alternate text feature to describe the image in the meme, and a third separates the overlapping meme text from the background image.
New images are added to the existing meme catalog, making it easier to identify future memes.
Text can be split from the image to make it available for braille devices or audio services.
According to the team, 80% of the 1.7 million images shared on Twitter during the survey period were not original.
Current estimates are that only 0.1% of online images are accessible to visually impaired people.
Memes are stored in a catalog that can be accessed and updated when new variations in memes appear.
Recently, there have been several different attempts to use the Internet to bridge the gap between visually impaired and visually impaired people.
A small portable device called the Bonocle was announced this spring to help translate text on laptops and tablets into brail.
A medical group in London has produced a series of GIFS to simulate the effects of vision with various visual impairments, including cataract, glaucoma and diabetic retinopathy.
WHAT IS BRAILLE?
Braille is a raised point system that can be read with fingers by blind or low vision people.
Braille is not a language, but a code by which many languages, such as English, Spanish, Arabic, Chinese, and dozens of others, can be written and read.
Braille is used by thousands of people around the world in their native languages.
Braille symbols are formed within braille cells.
A complete braille cell consists of six raised points arranged in two parallel lines, each with three points.
Point positions are identified by numbers one through six and sixty-four combinations are possible using one or more of these six points.
A single cell can be used to represent an alphabet letter, number, punctuation mark or even an entire word.
Share or comment on this article: