ELABORATING ON TEXT-IMAGE RELATIONSHIPS THROUGH INTERFACE

Missing in the current digital landscape are well-developed strategies for annotating already- authored information. In many cases, annotations are compiled chronologically, not by topic, author, or relevance to a particular search or use of information. This investigation specifically examined Internet memes and how users could explore text-text, image-image or other image-text associations.

HOW CAN A USER EXPLORE THE INTERSECTION OF TEXT AND IMAGE (MEMES) ON WEBPAGES AND FORM RELATIONSHIPS AND ASSOCIATIONS IN A LARGER CONTEXT THROUGH THE USE OF A BROWSER PLUG-IN?

 

Video depicting how a user can explore memes or text-image relationships on Buzzfeed through the use of a mapping tool.

  Storyboard of association mapping between text-text, image-image, and text-image.

Storyboard of association mapping between text-text, image-image, and text-image.

 

SINCE CONTENT IS GENERATED AT AN EXTRAORDINARY PACE ON THE INTERNET — IMAGE, TEXT, IMAGE-TEXT GENERATE DIFFERENT MEANING FOR DIFFERENT USERS BASED ON THEIR OWN CULTURAL, SOCIAL, POLITICAL, HISTORICAL AND ECONOMIC EXPERIENCES.

The interface solution explored the meme website, Buzzfeed. These concept maps illustrate how one text-image mashup can have many user interpretations thereby allowing for many associations and future text-image creations.

Inferring meaning from images is complicated. According to Roland Barthes in Rhetoric of the Image, Image, Music, Text, when reading images we can establish a system for understanding signs and signifiers in text and image:

  • The Denoted: the literal image
  • The Connoted: the symbolic image
  • The Linguistic: words in, near or around the image
 
  Key frames

Key frames

The interface solution is a plugin library and association map. Users can explore relationships
of text-text, image-image and text-image. The interface explores how users could add content—new image-text creations.