Synesthesia in art

The phrase synesthesia in art has historically referred to a wide variety of artistic experiments in order to synthesize different art disciplines (i.e. music and painting) as can be observed in the genres of visual music, abstract film, computer animation, symbolist poetry, multimedia and intermedial art (Campen 2007, 1999, Berman 1999, Maur 1999, Gage 1994, 1999). The usage of the term in the arts should, however, be differentiated from “genuine” synesthesia in scientific research. By no means unique to artists or musicians, synesthesia has been identified by psychologists as a specific condition that occurs when an individual who receives a stimulus in one sense modality simultaneously experiences a sensation in another. Only in the last decades scientific methods have become available to assess synesthesia in persons. For synesthesia in artists before that time one has to interpret (auto)biographical information. For instance, there has been debate on the “genuine” synesthesia of historical artists like Kandinsky and Scriabin if they were genuine or pseudo synesthetes (cf. Jewanski & Sidler 2006, Ione 2004, Dann 1999, Galeyev 2001). In general, it has shown to be extremely difficult to categorize artists as synesthetes without scientific criteria or assessment.

Additionally, Synesthetic art may refer to either art created by synesthetes or art created to convey the synesthetic experience. It is an attempt to understand the relation between the experiences of congenital congenital – or “genuine” - synesthetes, the experiences of non-synesthetes, and an appreciation of such art by both synesthetes and non-synesthetes.

Distinctions

When discussing synesthesia in art, a distinction needs to be made between three possible meanings:
# Art by synesthetes, in which they draw on their personal synesthetic perceptions to create works of art.
# Art that is meant to evoke synesthetic associations in a non-synesthetic audience.

These distinctions are not mutually exclusive, as, for example, art by a synesthete might also evoke synesthesia-like experiences in the viewer. However, it should not be assumed that all "synesthetic" art accurately reflects the synesthetic experience. For more on artists who either were synesthetes themselves, or who attempted to create synesthesia-like mappings in their art, see the list of people with synesthesia.

Art by synesthetes

Several contemporary visual artists have discussed their artistic process, and how synesthesia helps them in this, at length.Steen, C. (2001). Visions Shared: A Firsthand Look into Synesthesia and Art, Leonardo, Vol. 34, No. 3, Pages 203-208 (doi:10.1162/002409401750286949)]

Carol Steen experiences multiple forms of synesthesia, including grapheme → color synesthesia, music → color synesthesia, and touch → color synesthesia. She most often uses her music → color synesthesia and touch → color synesthesia in creating her works of art, which often involves attempting to capture, select, and transmit her synesthetic experiences into her paintings. Steen describes how her synesthetic experience during an acupuncture session lead to the creation of the painting "Vision".

Rather than trying to create depictions of what she experiences, "Reflectionist" Marcia Smilack uses her synesthetic experience in guiding her towards creating images that are aesthetically pleasing and appealing to her. Smilack takes pictures of reflected objects, mostly using the surface of the water, and says of her photography style:

Anne Salz, a Dutch musician and visual artist, perceives music in colored patterns. She describes her painting inspired by Vivaldi’s "Concerto for Four Violins":

She explains that the painting is not a copy of what she hears; rather, when she listens to music, she perceives more colorful textures than she normally perceives and she is able to depict them in the painting. She also expresses the movement of the music, as its energy influences the pictorial composition. She explains how she perceives the painting:

Art meant to evoke synesthetic associations

Perhaps the most famous work which might be thought to evoke synesthesia-like experiences in a non-synesthete audience is the Disney film Fantasia, although it is unknown if this was intentional or not. Another classical example is the use of the color organ which would project colored lights along with the musical notes, to create a synesthetic experience in the audience (Campen 2007, Jewanski & Sidler 2006).

Wassily Kandinsky working in the 1920's, may not have been a synesthete, despite his fame for his synesthetic artwork. Many of his paintings and stage pieces were based upon a set and established system of correspondences between colors and the timbres of specific musical instruments. Kandinsky himself, however, stated that his correspondences between colors and musical timbres have no "scientific" basis, but were founded upon a combination of his own personal feelings, current prevailing cultural biases, and mysticism (Harvnb|Kandinsky|1994; Harvnb|Dann|1998; Harvnb|Riccò|1999|pp=138-142 Jewanski & Sidler 2006, Campen 2007).

History

The interest in synesthesia is at least as old as Greek philosophy. One of the questions that the classic philosophers asked was if color (chroia, what we now call timbre) of music was a physical quality that could be quantified (Campen 2007, Gage 1994, Ferwerda & Struycken 2001, Jewanski 1999). The first known experiment to test correspondences between sound and color was conducted by the Milanese artist Giuseppe Arcimboldo at the end of the sixteenth century. He consulted with a musician at the court of Rudolph II in Prague to create a new experiment that sought to show the colors that accompany music. He decided to place different colored strips of painted paper on the gravicembalo, a keyboard instrument (Gage, 1994). The problem of finding a mathematical system to explain the connection between music and color has both inspired and frustrated artists and scientists throughout the ages. The seventeenth-century physicist Isaac Newton tried to solve the problem by assuming that musical tones and color tones have frequencies in common. He attempted to link sound oscillations to respective light waves. According to Newton, the distribution of white light in a spectrum of colors is analogous to the musical distribution of tones in an octave. So, he identified seven discrete light entities, that he then matched to the seven discrete notes of an octave (Campen 2007, Peacock 1988).

Color organs

Inspired by Newton’s theory of music-color correspondences, the French Jesuit Louis-Bertrand Castel designed a color harpsichord (clavecin oculaire) with colored strips of paper which rose above the cover of the harpsichord whenever a particular key was hit (Campen 2007, Franssen 1991). Renowned masters like Telemann and Rameau were actively engaged in the development of a clavecins oculaire. The invention of the gas light in the nineteenth century created new technical possibilities for the color organ. In England between 1869 and 1873, the inventor Frederick Kastner developed an organ that he named a Pyrophone. The British inventor Alexander Rimington, a professor in fine arts in London, documented the phrase ‘Colour-Organ’ for the first time in a patent application in 1893. Inspired by Newton’s idea that music and color are both grounded in vibrations, he divided the color spectrum into intervals analogous to musical octaves and attributed colors to notes. The same notes in a higher octave produced the same color tone but then in a lighter value (Peacock 1988). Around the turn of the century, concerts with light and musical instruments were given quite regularly. As most technical problems had been conquered, the psychological questions concerning the effects of these performances came to the fore. The Russian composer Alexander Scriabin was particularly interested in the psychological effects on the audience when they experienced sound and color simultaneously. His theory was that when the correct color was perceived with the correct sound, ‘a powerful psychological resonator for the listener’ would be created. His most famous synesthetic work, which is still performed today, is Prometheus, Poem of Fire. On the score of Prometheus, he wrote next to the instruments separate parts for the tastiere per luce, the color organ (Campen 2007, Galeyev 2001, Gleich 1963).

Musical paintings

In the second half the nineteenth century, a tradition of musical paintings began to appear that influenced symbolist painters (Campen 2007, Van Uitert 1978). In the first decades of the twentieth century, a German artist group called The Blue Rider (Der blaue Reiter) executed synesthetic experiments that involved a composite group of painters, composers, dancers and theater producers. The aims of the group were focused on three goals: the unification of the arts by means of Total Works of Art (Gesamtkunstwerke) (Von Maur 2001, Hahl-Koch 1985, Ione 2004). Kandinsky's theory of synesthesia, as formulated in booklet On the Spiritual in Art (1910), helped to shape the ground for these experiments. He described synesthesia as a phenomenon of transposition of experience from one sense modality to another, as in unisonous musical tones (Kandinsky 1910, Düchting 1996). Kandinsky was not the only artist at this time with an interest in synesthetic perception. A study of the art at the turn of the century reveals in the work of almost every progressive or avant-garde artist an interest in the correspondences of music and visual art. Modern artists experimented with multi-sensory perception like the simultaneous perception of movement in music and film (Von Maur 2001, Heyrman 2003).

Visual music

Starting in the late 1950s, electronic music and electronic visual art have co-existed in the same digital medium (Campen 2007, Collopy 2000, Jewanski & Sidler 2006, Moritz 2003). Since that time, the interaction of these fields of art has increased tremendously. Nowadays, students of art and music have digital software at their disposal that uses both musical and visual imagery. Given the capability of the Internet to publish and share digital productions, this has led to an enormous avalanche of synesthesia-inspired art on the Internet (Campen 2007) (cf. website RhythmicLight.com on the history of visual music). For instance, Stephen Malinowski and Lisa Turetsky from Berkeley, California wrote a software program, entitled the Music Animation Machine that translates and shows music pieces in colored measures.

ynesthetic artists

With today’s knowledge and testing apparatus, it can be determined with more certainty if contemporary artists are synesthetic. By interviewing these artists, one gets some insights into the process of painting music (cf. Steen, Smilack, Salz). The lines of artistic explorations of synesthesia and scientific research into the subject have become closely intertwined in the last decade. Some contemporary artists are active members of synesthesia associations in the United States, United Kingdom, Germany, Italy, Spain, Belgium and other countries (cf. Arte Citta [http://www.artecitta.es] . In and outside these associations that house scientists and artists, the exchange of ideas and collaborations between artists and scientist has grown rapidly in the last decades (cf. the Leonardo online bibliography Synesthesia in Art and Science) [http://lbs.mit.edu/isast/spec.projects/synesthesiabib.html] . And this is only a small selection of synesthetic work in the arts. New artistic projects on synesthesia are appearing every year. These painters, sculptors, designers and musicians have shown to be well-informed on the latest scientific insights in synesthesia. They combine this scientific knowledge and personal intuition in a range of artistic expressions. For instance they capture their synesthetic perceptions in painting, photographs, textile work, and sculptures. Beside these ‘classical’ materials of making art, an even larger production of synesthesia-inspired works is noticed in the field of digital art (Campen 2007).

References and notes

*Berman, Greta. "Synesthesia and the Arts," "Leonardo" 32, no. 1 (1999) 15-22.
*Campen, Cretien van. "The Hidden Sense. Synesthesia in Art and Science." Cambridge: MIT Press, 2007. [http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=11303]
*Campen, Cretien van "Artistic and psychological experiments with synesthesia." "Leonardo" vol. 32, no. 1 (1999) 9-14.
*Collopy, F. “Color, Form, and Motion. Dimensions of a Musical Art of Light.” "Leonardo" 33, no. 5 (2000): 355-360.
*Harvard reference|Surname1= Dann|Given1= K. T. |Year=1998|Title= Bright Colors Falsely Seen: Synaesthesia and the Search for Transcendent Knowledge |Publisher= Yale University Press
ID=ISBN 0-300-06619-8|URL=
*Düchting, H. "Farbe am Bauhaus. Synthese und Synästhesie". Berlin: Gebr. Mann, 1996.
*Evers, F. “Muziek en de eenheid der kunsten.” In "Muziekpsychologie", edited by F. Evers, M. Jansma and B. de Vries, 313-338. Assen: Van Gorcum, 1995.
*Ferwerda, R. and P. Struycken. ‘"Aristoteles’ Over kleuren". Budel: Damon, 2001.
*Franssen, M. “The Ocular Harpsichord of Louis-Bertrand Castel. The Science and Aesthetics of an Eighteenth-Century Cause Célèbre.” "Tractrix" 3 (1991): 15-77.
*Gage, J. “Making Sense of Colour. The Synaesthetic Dimension.” In "Colour and meaning. Art, science and symbolism", 261-268. Oxford: Thames & Hudson, 1999.
*Gage, J. "Colour and Culture. Practice and Meaning from Antiquity to Abstraction". London: Thames & Hudson, 1993.
*Galeyev, B. and I.L. Vanechkina. “Was Scriabin a Synesthete?” "Leonardo" 34, no. 4 (2001): 357-361.
*Hahl-Koch, J. “Kandinsky, Schönberg und der ‘Blaue Reiter” In "Vom Klang der Bilder", edited by K. von Maur. München: Prestel, 1985.
*Heyrman, H. "Art and Synesthesia: In Search of the Synesthetic Experience" paper presented at the First International Conference on Art and Synesthesia in Europe, University of Almería, Spain, 25-28 July 2005.
*Ione, A. and C.W. Tyler. "Neuroscience, History and the Arts. Synesthesia: Is F-sharp Colored Violet?" "Journal of the History of the Neurosciences" 13 (2004): 58-65.
*Ione A. and C.W. Tyler. “ Was Kandinsky a Synesthete?” "Journal of the History of the Neurosciences" 12 (2003): 223–226.
*Ione, A. "Kandinsky and Klee: Chromatic Chords, Polyphonic Painting and Synesthesia.” "Journal of Consciousness Studies" 11, no. 3-4 (2004): 148-58.
*Jewanski, J. and N. Sidler (Eds.). "Farbe - Licht - Musik. Synaesthesie und Farblichtmusik." Bern: Peter Lang, 2006.
*Jewanski, J. "What is the Color of the Tone?" "Leonardo" 32, no. 3 (1999): 227-228.
*Kandinsky, W. “Der gelbe Klang: Eine Bühnenkomposition von Kandinsky.” In "Der blaue Reiter", edited by W. Kandinsky and F. Marc. München: Piper, 1912.
*Klein, A.B. "Colour Music'. The Art of Light." London, 1926.
*Maur, K. von. "The Sound of Painting". München: Prestel, 1999.
*Moritz, W. "Optical Poetry. The Life and Work of Oskar Fischinger". Indiana University Press, 2003.
*Peacock, K. “Instruments to Perform Color-Music: Two Centuries of Technological Experimentation.” "Leonardo" 21, no. 4 (1988): 397-406.
*Uitert, E. van. “Beeldende kunst en muziek: de muziek van het schilderij.” In "Kunstenaren der idee: symbolistische tendenzen in Nederland", edited by C. Blotkamp. Den Haag: Haags Gemeentemuseum, 1978.
*Peacock, K. "Instruments to Perform Color-Music: Two Centuries of Technological Experimentation," "Leonardo" 21, no. 4 (1988) 397-406.
*Harvard reference|Surname1= Riccò|Given1= Dina|Year= 1999|Title= Sinestesie per il design . Le interazioni sensoriali nell'epoca dei multimedia|Publisher= Etas, Milano|URL=

External links

* [http://home.comcast.net/~sean.day/html/famous_synesthetes.html Famous synesthetes] - List maintained by Sean A. Day, President of the American Synesthesia Association
* [http://lbs.mit.edu/isast/spec.projects/synesthesiabib.html Leonardo Online Bibliography Synesthesia in Science and Art] - contains references to general web portals, websites of artists and hundreds of scientific articles and books on the subject of the last decades.
* [http://www.seedmagazine.com/news/2006/12/the_most_beautiful_painting_yo.php The Most Beautiful Painting You've Ever Heard] From Seed magazine.
* [http://RhythmicLight.com Rhythmic Light] - Website on the history of visual music, edited by Fred Collopy.
* [http://www.doctorhugo.org/synaesthesia/index.htm Synesthesia] - Survey of documents on synesthesia in art, compiled by Dr. Hugo Heyrman.
* [http://synesthesie.nl Synesthetics] - Resources, articles and weblinks on synesthesia in art and science, compiled by Cretien van Campen.
* [http://www.seeingwithsound.com/asynesth.htm Artificial synesthesia (for the blind)]
* [http://www.synestesia.fi/ Synesthesia Music] - Music generated from any pictures in 5 seconds
* [http://www.artecitta.es Arte Citta] - European organization of art and synesthesia