Researchers test artificial intelligence: the ability to understand comics is far less than humans

According to foreign media reports, the latest research shows that although artificial intelligence (AI) is enough to replace human beings in many aspects, it is still far from human beings at least in terms of reading comic books.

Researchers test artificial intelligence: the ability to understand comics is far less than humans

At present, artificial intelligence is surpassing humans in many aspects, and has even surpassed humans, such as face recognition, object recognition, chess, Go, video games, and many other tasks.

People can't help but ask: In what ways is artificial intelligence not as good as humans? Or, at least for now, it is difficult to surpass humans? Thanks to a study by the University of Maryland, College Park (UMCP), we seem to find the answer.

Recently, University of Maryland professor Mohit Iyyer and colleagues tested the ability of artificial intelligence to understand comic books. The results show that artificial intelligence is far less capable than humans in this respect.

As we all know, comics are made up of a series of pictures, accompanied by text to annotate. Text and images work so closely together that it is difficult to understand the meaning of the picture alone or by looking at the text alone.

Moreover, depending on the creator, there are great differences in the styles of painting, language, and typography between different comics. More importantly, unlike video, the time and space between different frames (pictures) of comics are inconsistent, and the transitional plots in the middle often require the reader to imagine.

Ayer's test results show that this ability, which is natural in humans, is difficult for artificial intelligence.

In order to understand the ability of artificial intelligence to understand comic plots, Ayer and his colleagues first constructed a data set of 1.2 million comics (pictures) using 4000 high-quality comic books, each of which is also equipped with There is a corresponding text dialog to transcribe the data, making the overall data set size up to 120GB. For copyright reasons, these data sets are all from comics from the 1930s to the 1950s.

To test the ability of artificial intelligence to understand comics, the researchers designed experiments that let artificial intelligence programs predict the next frame based on previously seen images. First of all, let artificial intelligence learn the operation process of comics. The research team cast a frame and its text in the comic to different machine algorithms, letting them learn how each frame in a set of comics is connected to each other.

After training, the researchers used a set of comics (made up of multiple images) that had not been seen before artificial intelligence to test the artificial intelligence machines and asked them to predict the next image, or the text behind it.

The results are astounding. Humans predict that the correct plot or content of comics can reach 80%, but the accuracy of artificial intelligence is difficult to reach human level. Ayier said: "In this test, artificial intelligence is not as good as humans in any aspect."

In fact, the result is not particularly surprising. Although machine learning has made significant advances in image and text recognition, it still lacks the common sense and logic of the human brain. Therefore, human beings are still better at understanding comics, or at least for now.

Electronic Resistor And Capacitor

HAODA ELECTRONIC CO.,LIMITED , https://www.pcbhdi.com