Visible Melody

40
Visible Melody Wang Qianfei ——the transformation between aural language and visional language

description

A design project about translate music to the deaf-mute people.

Transcript of Visible Melody

Page 1: Visible Melody

Visible Melody

Wang Qianfei

——the transformation between aural language and visional language

Page 2: Visible Melody

02Visible Melody

The days when I spent in CAFAEvery teacherEvery mateEvery minuteall of which were fabulous and unforgetable

Growth and progresswere increased like the time

Before my making decision about the motif of my graduation designI am aware that it is not enough if I only use my professional knowledge about designIt is the responsibility and duty of the society that I should pay more attention toSo that during the hundreds of days which I spent on my graduation designI devoted myself to find the most suitable method to explain my motif and design to audience and viewersI would like to express my deeply thankful to my professors, parents and friends with this book

Page 3: Visible Melody

02Visible Melody

The days when I spent in CAFAEvery teacherEvery mateEvery minuteall of which were fabulous and unforgetable

Growth and progresswere increased like the time

Before my making decision about the motif of my graduation designI am aware that it is not enough if I only use my professional knowledge about designIt is the responsibility and duty of the society that I should pay more attention toSo that during the hundreds of days which I spent on my graduation designI devoted myself to find the most suitable method to explain my motif and design to audience and viewersI would like to express my deeply thankful to my professors, parents and friends with this book

Page 4: Visible Melody

���� �� �� ����

� �

���� �����������������

�� � � ���

� � � �

� �

� �

� �

� �

� ��

�� � �

� ����

� � �

� ���� � ��� �

���� �

� � �

� �

� � � �

���� � �����

� �

� �

� � �

� � � �

� � �

� � � �

� � � � �

� �

� �

�� � ��

� �� � �

���� � ���� �

���� �

���� �

� �

� �

���� � ��� � ��

� �� �

� �

� ��� � �

� �

�� � �

��� �� � �

� �

� �

� � �

� �

� �

�� �

��� �

���� �

� �

� �

� � �

� � �

� �

� ��

� �

� � �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� �

� �

� � �

� �

� �

� �

� �

� �

� �

� �

� � �

� �

� �

��

�� � �

� �� �

� ��

� �

� �

� �

� �

� �

� �

� � �

� �

� �� �

� �

� �

� �� �

� �

� �

� �

� �

� �

� � � �

� �

� � �

� �

� � ��

� � �

� �

� � �

����

�� �� �

� �

����

����

� �

� �

� �

�� �

� �

� �

� �

� �

� �

� �

� � �

� �

�� � �

���� �� ��

���� � �� �

� ��

� � �� � �

� ���������

� �

���� �

� �

� � � �

�� �

� � �

� �

� �

� � �

���

����� �� � �

� � �

� �� ���

� �

� � �

� �

� �

� �

� �

� � � �

� � �

� � ��

��� �� �

� �

� �

���� � �� �

� ��� �

� �

� � �

� � � �

� ���

� ��

� � �

� �

� �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� �

� � �

�� �

�� �

� � �

� � �

� �

� � �

� �

����

� �

� � �

� �

� �

� �

� � �

� �

� �

� � �

� � �

� �

� �

�� �

� �

� �

� �

� �

� � �

� �

� � �

� �

� �

� �

� � �

� � �

� �

� �

� � ��� �

� � �

� � �

� �

� �

� �

� �

� �

� �

� �

� � �

� � ��

� �

� � �

� �

� �

� � �

� �

� �

� �

� � �

� � �

� �

� �

� �

Image_report about deaf-mute's lives on China Education Daily

04Visible Melody

Loving music,not only I,but also the main part of people own this kind of interest,which is an amazing and powerful way to express art.

Music,like the air,is needed by everyone.

It is said by Schopenhauer that music is the jewel of the artistic crown.Music is one of the symbol of sound and the expression of people's mind.It is music that owns aim and connotation, as well as including experience and thought of musician.Music could bring wonderful feeling to people and express their emotion.Music is one of the significant action, though which everybody can communicate with each other freely.

However,there are more than three hundred millions people who cannot feel the beautiful melody on the earth.

What can we do for them?

they are deaf-mute,their world are coulorless, helpless and monotonous.The demand of splendid life is needed by deaf-mute, as well as the normal ones. It is not unnecessary for deaf-mute to live in a colorful world and with various ways of art.The most important issue is that they also need music.

As for a designer-to-be,It is the social responsibility that I always remember by heart.With the help of design,I would bring the strong engery from music to deaf-mute,that's all my original intention.

Nowdays,the groups and organizations aim to help and cure the deaf-mute to hear with the help of some special facilities.

The Reason of Choosing The Motif

However,before they can hear,or during their restoration from sickness,How can they live?For those people who cannot hear forever, is it means that they would never feel music?

Design serve for everyone.Design serve for deaf-mute.

Using all my knowledge about design and art,and all my abilities to thansfer visional language into aural language,I tried to use several sences to explain music.So that the deaf-mute can understand the main part of music as much as possible.When they could feel the power of music,it is sure that they will live much happier and more relaxed

Page 5: Visible Melody

���� �� �� ����

� �

���� �����������������

�� � � ���

� � � �

� �

� �

� �

� �

� ��

�� � �

� ����

� � �

� ���� � ��� �

���� �

� � �

� �

� � � �

���� � �����

� �

� �

� � �

� � � �

� � �

� � � �

� � � � �

� �

� �

�� � ��

� �� � �

���� � ���� �

���� �

���� �

� �

� �

���� � ��� � ��

� �� �

� �

� ��� � �

� �

�� � �

��� �� � �

� �

� �

� � �

� �

� �

�� �

��� �

���� �

� �

� �

� � �

� � �

� �

� ��

� �

� � �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� �

� �

� � �

� �

� �

� �

� �

� �

� �

� �

� � �

� �

� �

��

�� � �

� �� �

� ��

� �

� �

� �

� �

� �

� �

� � �

� �

� �� �

� �

� �

� �� �

� �

� �

� �

� �

� �

� � � �

� �

� � �

� �

� � ��

� � �

� �

� � �

����

�� �� �

� �

����

����

� �

� �

� �

�� �

� �

� �

� �

� �

� �

� �

� � �

� �

�� � �

���� �� ��

���� � �� �

� ��

� � �� � �

� ���������

� �

���� �

� �

� � � �

�� �

� � �

� �

� �

� � �

���

����� �� � �

� � �

� �� ���

� �

� � �

� �

� �

� �

� �

� � � �

� � �

� � ��

��� �� �

� �

� �

���� � �� �

� ��� �

� �

� � �

� � � �

� ���

� ��

� � �

� �

� �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� � �

� �

� �

� �

� �

� � �

�� �

�� �

� � �

� � �

� �

� � �

� �

����

� �

� � �

� �

� �

� �

� � �

� �

� �

� � �

� � �

� �

� �

�� �

� �

� �

� �

� �

� � �

� �

� � �

� �

� �

� �

� � �

� � �

� �

� �

� � ��� �

� � �

� � �

� �

� �

� �

� �

� �

� �

� �

� � �

� � ��

� �

� � �

� �

� �

� � �

� �

� �

� �

� � �

� � �

� �

� �

� �

Image_report about deaf-mute's lives on China Education Daily

04Visible Melody

Loving music,not only I,but also the main part of people own this kind of interest,which is an amazing and powerful way to express art.

Music,like the air,is needed by everyone.

It is said by Schopenhauer that music is the jewel of the artistic crown.Music is one of the symbol of sound and the expression of people's mind.It is music that owns aim and connotation, as well as including experience and thought of musician.Music could bring wonderful feeling to people and express their emotion.Music is one of the significant action, though which everybody can communicate with each other freely.

However,there are more than three hundred millions people who cannot feel the beautiful melody on the earth.

What can we do for them?

they are deaf-mute,their world are coulorless, helpless and monotonous.The demand of splendid life is needed by deaf-mute, as well as the normal ones. It is not unnecessary for deaf-mute to live in a colorful world and with various ways of art.The most important issue is that they also need music.

As for a designer-to-be,It is the social responsibility that I always remember by heart.With the help of design,I would bring the strong engery from music to deaf-mute,that's all my original intention.

Nowdays,the groups and organizations aim to help and cure the deaf-mute to hear with the help of some special facilities.

The Reason of Choosing The Motif

However,before they can hear,or during their restoration from sickness,How can they live?For those people who cannot hear forever, is it means that they would never feel music?

Design serve for everyone.Design serve for deaf-mute.

Using all my knowledge about design and art,and all my abilities to thansfer visional language into aural language,I tried to use several sences to explain music.So that the deaf-mute can understand the main part of music as much as possible.When they could feel the power of music,it is sure that they will live much happier and more relaxed

Page 6: Visible Melody

1 2 3 4 5 6 7

44

1=D

1=C

1=D

1=E

1=F

1=G

1=A

1=B

1 2 3 4 5 6 7

摇篮曲44

1=G

1 2 3 4 5 6 7 北风吹

3424

1=G

06Visible Melody

The First Experiment

Useing seven colors to represent seven scales, I tried to mix colors to find out the emotion which comes from the music.

one unit

the height of one unit is 12mmand the width is 8mm.

Following this rule, the music socre will turn to a fabulous color combination.

Cradlesong

White-Haired Girl

Ode To Joy

RULE

The shortage:Although every scale owned its speical color values, the different tones had no links, what is meant by this is that this experience was failed.

Give every scale a color value under a system in defferent tones, which is more accurate and useful.

The result was not perfect, therefore; I would like to change the order and place among these scales.

1=C

1=D

1=E

1=F

1=G

1=A

1=B

Page 7: Visible Melody

1 2 3 4 5 6 7

44

1=D

1=C

1=D

1=E

1=F

1=G

1=A

1=B

1 2 3 4 5 6 7

摇篮曲44

1=G

1 2 3 4 5 6 7 北风吹

3424

1=G

06Visible Melody

The First Experiment

Useing seven colors to represent seven scales, I tried to mix colors to find out the emotion which comes from the music.

one unit

the height of one unit is 12mmand the width is 8mm.

Following this rule, the music socre will turn to a fabulous color combination.

Cradlesong

White-Haired Girl

Ode To Joy

RULE

The shortage:Although every scale owned its speical color values, the different tones had no links, what is meant by this is that this experience was failed.

Give every scale a color value under a system in defferent tones, which is more accurate and useful.

The result was not perfect, therefore; I would like to change the order and place among these scales.

1=C

1=D

1=E

1=F

1=G

1=A

1=B

Page 8: Visible Melody

1 2 3 4 5 6 7

摇篮曲44

1=G

欢乐颂44

1=D

北风吹3424

1=G

1 2 3 4 5 6 7

1 2 3 4 5 6 7

欢乐颂44

1=D

摇篮曲44

1=G

北风吹3424

1=G

1 2 3 4 5 6 7

模板一模板二 模板三

摇篮曲44

1=G

1 2 3 4 5 6 7

1 2 3 4 5 6 7 欢乐颂

44

1=D

北风吹3424

1=G

08Visible Melody

RULE ONE RULE TWO RULE THREECradlesong Cradlesong Cradlesong

White-Haired Girl White-Haired Girl White-Haired Girl

Ode To Joy Ode To Joy Ode To Joy

Page 9: Visible Melody

1 2 3 4 5 6 7

摇篮曲44

1=G

欢乐颂44

1=D

北风吹3424

1=G

1 2 3 4 5 6 7

1 2 3 4 5 6 7

欢乐颂44

1=D

摇篮曲44

1=G

北风吹3424

1=G

1 2 3 4 5 6 7

模板一模板二 模板三

摇篮曲44

1=G

1 2 3 4 5 6 7

1 2 3 4 5 6 7 欢乐颂

44

1=D

北风吹3424

1=G

08Visible Melody

RULE ONE RULE TWO RULE THREECradlesong Cradlesong Cradlesong

White-Haired Girl White-Haired Girl White-Haired Girl

Ode To Joy Ode To Joy Ode To Joy

Page 10: Visible Melody

What is the main part of music?interview Prof. Qu Xuexuan come from China Conservatory

Time: March 9, 2010Place: China Conservatoryinteviewee: Prof. Qu Xuexuanbackground of interviewee: Qu Xuexuan is the professor of China Conservatory and a member of Chinese Musicians Association. He graduated from Shenyang Conservatory Middle School and China Conservatory. Professor Jin Tielin is his teacher. After graduation from China Conservatory in 1992, he began to teach sudents in China Conservatory and China Conservatory Middle School. Prof. Qu Xuexuan held several national solo competitions and concerts, including 1997 National Minority Nationality Solo Competition. He won a number of prize. Prof. Qu has been invited to Japan, Hong Kong, Thailand, Singapore, Korea and so on. Prof. Qu always is the judge of National Vocal Music Competition. A couple of his students won many prize in defferent competitions. Prof. Qu took part in China Central TeleVision (CCTV) new years party several times.http://www.ccmusic.edu.cn/sdjsw/xjpx/200706/t20070612_1859.html

10Visible Melody

Result:

After using three RULEs, the results were not perfect, as well.Few obvious difference or emotion appeared.The first experience was failed.

Analysis for the reasons of failure

I tried to express the emtion of each song,but the fact proves that it was not accurate.So this time I began to analysis the reason of failure.

First of all,it is necessary to make sure that who is the audience.

In addition,the object which was required to design is music.

Moreover,the way of transform is between visional language and aural language.

As a result,I had to find out the following significant issues:1.What is the inwardness of music?2.What is needed by deaf-mute?3.To find a suitable method to transfer aural language into visional language.

Giving up to only use theory,I turned to work with theory and practice,and faced every issue with a variety of aspects.

Find out theory as soon as parctice

The summary of interviewMusic is very sentimental.Music can cure sickness.It is necessary to feel music from the beginning.Every musical note has its own emotion, thus; they can move people.The measure must be simple, so that the deaf-mute could understand directly.To find out a method, by which deaf-mute would be moved at first time then they will feel as follow.Find a way which is suitable for deaf-mute.It is benefical to be concrete and sentimental before being abstract and rational.It is possible to use seven colors to express, but it is needed to think about transition.It is accepted by deaf-mute at first then design for them.Designing music, you should not be limited by old rules, neither too abstract.It must be interesting.Never stillness.Never design music from a professional person's view, just to be a layman.Feel music by heart.The soul of music is emotion.

The last sentence affected me deeply,as a result,I made sure the main part of my design.

Page 11: Visible Melody

What is the main part of music?interview Prof. Qu Xuexuan come from China Conservatory

Time: March 9, 2010Place: China Conservatoryinteviewee: Prof. Qu Xuexuanbackground of interviewee: Qu Xuexuan is the professor of China Conservatory and a member of Chinese Musicians Association. He graduated from Shenyang Conservatory Middle School and China Conservatory. Professor Jin Tielin is his teacher. After graduation from China Conservatory in 1992, he began to teach sudents in China Conservatory and China Conservatory Middle School. Prof. Qu Xuexuan held several national solo competitions and concerts, including 1997 National Minority Nationality Solo Competition. He won a number of prize. Prof. Qu has been invited to Japan, Hong Kong, Thailand, Singapore, Korea and so on. Prof. Qu always is the judge of National Vocal Music Competition. A couple of his students won many prize in defferent competitions. Prof. Qu took part in China Central TeleVision (CCTV) new years party several times.http://www.ccmusic.edu.cn/sdjsw/xjpx/200706/t20070612_1859.html

10Visible Melody

Result:

After using three RULEs, the results were not perfect, as well.Few obvious difference or emotion appeared.The first experience was failed.

Analysis for the reasons of failure

I tried to express the emtion of each song,but the fact proves that it was not accurate.So this time I began to analysis the reason of failure.

First of all,it is necessary to make sure that who is the audience.

In addition,the object which was required to design is music.

Moreover,the way of transform is between visional language and aural language.

As a result,I had to find out the following significant issues:1.What is the inwardness of music?2.What is needed by deaf-mute?3.To find a suitable method to transfer aural language into visional language.

Giving up to only use theory,I turned to work with theory and practice,and faced every issue with a variety of aspects.

Find out theory as soon as parctice

The summary of interviewMusic is very sentimental.Music can cure sickness.It is necessary to feel music from the beginning.Every musical note has its own emotion, thus; they can move people.The measure must be simple, so that the deaf-mute could understand directly.To find out a method, by which deaf-mute would be moved at first time then they will feel as follow.Find a way which is suitable for deaf-mute.It is benefical to be concrete and sentimental before being abstract and rational.It is possible to use seven colors to express, but it is needed to think about transition.It is accepted by deaf-mute at first then design for them.Designing music, you should not be limited by old rules, neither too abstract.It must be interesting.Never stillness.Never design music from a professional person's view, just to be a layman.Feel music by heart.The soul of music is emotion.

The last sentence affected me deeply,as a result,I made sure the main part of my design.

Page 12: Visible Melody

Image_explain my design motif for Prof. Qu

12Visible Melody

Page 13: Visible Melody

Image_explain my design motif for Prof. Qu

12Visible Melody

Page 14: Visible Melody

After understanding the main part of music, I focused on the deaf-mute.

What 's the demand of deaf-mute?Interview Director Yang Guanyuan in Beijing Second School of the Deaf

Image_interview Dirctor Yang Guangyuan

14Visible Melody

Interview record

Time: March 11, 2010Place: No.32 Huayuan Beilu, Beijing Second School of the Deaf

Q: Is there any contacts between deaf-mute students and music?A: No, very few. Our school doesn't have this subject. However, we have dancing lessons. Students followed teachers' direction instead of listening music.

Q: What are the subjects that deaf-mute students always have? And how?A: The lessons which our students have are the same as the normal ones. Only the method is different. Our teachers are teaching their students by sign language.

Q: What is the interest of deaf-mute students?A: Their interests are familiar with normal students, such as web and computers. While their visions are very acute. They are interested in motional issues.

Q: What is the most favorite subject for your students? Which subject your students dislike?A: They like Art very much. It is hard for them to understand subject like political lesson.

Q: What are differents for your students to understand abstract and concrete?A: It is too difficult for our students to understand abstract things. Concrete ones are fine. However, they have few communication in daily life, so their minds are simple.

Q: Please talk about the subject of art.A: Deaf-mute students like copy and they own the special understandings about colors, which are totally different from us. They have their individual minds to face art and color.

Q: Do they feel happy everyday?A: It is benefical for a person who can hear, it will decrease amount of worry. But deaf-mute students have their own trouble, that is the reason why there are students in the psycho consulting room.

Page 15: Visible Melody

After understanding the main part of music, I focused on the deaf-mute.

What 's the demand of deaf-mute?Interview Director Yang Guanyuan in Beijing Second School of the Deaf

Image_interview Dirctor Yang Guangyuan

14Visible Melody

Interview record

Time: March 11, 2010Place: No.32 Huayuan Beilu, Beijing Second School of the Deaf

Q: Is there any contacts between deaf-mute students and music?A: No, very few. Our school doesn't have this subject. However, we have dancing lessons. Students followed teachers' direction instead of listening music.

Q: What are the subjects that deaf-mute students always have? And how?A: The lessons which our students have are the same as the normal ones. Only the method is different. Our teachers are teaching their students by sign language.

Q: What is the interest of deaf-mute students?A: Their interests are familiar with normal students, such as web and computers. While their visions are very acute. They are interested in motional issues.

Q: What is the most favorite subject for your students? Which subject your students dislike?A: They like Art very much. It is hard for them to understand subject like political lesson.

Q: What are differents for your students to understand abstract and concrete?A: It is too difficult for our students to understand abstract things. Concrete ones are fine. However, they have few communication in daily life, so their minds are simple.

Q: Please talk about the subject of art.A: Deaf-mute students like copy and they own the special understandings about colors, which are totally different from us. They have their individual minds to face art and color.

Q: Do they feel happy everyday?A: It is benefical for a person who can hear, it will decrease amount of worry. But deaf-mute students have their own trouble, that is the reason why there are students in the psycho consulting room.

Page 16: Visible Melody

热情热情

热情

热情

热情

热心

激动热情

暖和

温暖

生气

火热

怒火简单

冷酷深沉

冷酷

夜晚

可怕

冷漠

冷漠

冷淡

盲人

乌云

简单

失落

失落

成熟

成熟

高贵

简单

温顺浪漫

纯净

高贵

华丽

浪漫

默默

悲伤

默默

简单

开朗

开朗

天空

凉爽

豪迈

纯净

文静

天真 ——

平常

文静

温暖希望

牙疼

纯净

正大光明

明亮

活泼

冷漠

鲜明

平淡

黄土

快乐

高洁

橙色衣服

迟钝

善良文静

平凡

干净

温暖舒服

高洁

活泼可爱

可爱

活力

王卓群

徐圣齐

蔡泽鹏

任晓婷

王皓

叶飞

李孟力

姚佳洁

刘烨

洁白

可爱

——

——

——

舒适

自然清新

高洁

高大

遥远

洁白飞翔

清新

舒畅

享受

保护环境

纯洁

生命力精神

大海

鲜艳

开朗

具有生命力

叶子

冷静

没感觉沉闷

简单

无聊

纯净

可爱漂亮

温暖

害羞单纯

有志向

天空

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

—— ——

——

——

——

——

——

—— ——

——

——

——

——

———

——

——

——

——

王娇燕

孙立佰

何欣蕊

柏志强

祁仲辉

宁琪

青年人

可爱

纯净

气盛

美好

洁白

鲜艳 柔和可爱

美丽

可爱活泼

青春新奇

Image_poster design the color cannot be saidImage_students � nish the questionnaire

The first questionnaire about understanding of music

16Visible Melody

Investigation

Time: March 15, 2010Place: No.32 Huayuan Beilu, Beijing Second School of the DeafInterviewee: All students and teacher in Class One Grade One

Interview contents:the understanding about color,the basic knowledge about music,the feeling about musical instruments,the understanding about music,how long and how oftendo they connect with music?

The result:No matter the students are inborn deaf or postnatal deaf, few students have the connection with music or musical instruments.But it is worth to say that all of students love music,as well as art.The only thing which they feel worried is that there is no way for them to study or learn music and art.They all hope to have a chance to feel music someday.

Page 17: Visible Melody

热情热情

热情

热情

热情

热心

激动热情

暖和

温暖

生气

火热

怒火简单

冷酷深沉

冷酷

夜晚

可怕

冷漠

冷漠

冷淡

盲人

乌云

简单

失落

失落

成熟

成熟

高贵

简单

温顺浪漫

纯净

高贵

华丽

浪漫

默默

悲伤

默默

简单

开朗

开朗

天空

凉爽

豪迈

纯净

文静

天真 ——

平常

文静

温暖希望

牙疼

纯净

正大光明

明亮

活泼

冷漠

鲜明

平淡

黄土

快乐

高洁

橙色衣服

迟钝

善良文静

平凡

干净

温暖舒服

高洁

活泼可爱

可爱

活力

王卓群

徐圣齐

蔡泽鹏

任晓婷

王皓

叶飞

李孟力

姚佳洁

刘烨

洁白

可爱

——

——

——

舒适

自然清新

高洁

高大

遥远

洁白飞翔

清新

舒畅

享受

保护环境

纯洁

生命力精神

大海

鲜艳

开朗

具有生命力

叶子

冷静

没感觉沉闷

简单

无聊

纯净

可爱漂亮

温暖

害羞单纯

有志向

天空

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

——

—— ——

——

——

——

——

——

—— ——

——

——

——

——

———

——

——

——

——

王娇燕

孙立佰

何欣蕊

柏志强

祁仲辉

宁琪

青年人

可爱

纯净

气盛

美好

洁白

鲜艳 柔和可爱

美丽

可爱活泼

青春新奇

Image_poster design the color cannot be saidImage_students � nish the questionnaire

The first questionnaire about understanding of music

16Visible Melody

Investigation

Time: March 15, 2010Place: No.32 Huayuan Beilu, Beijing Second School of the DeafInterviewee: All students and teacher in Class One Grade One

Interview contents:the understanding about color,the basic knowledge about music,the feeling about musical instruments,the understanding about music,how long and how oftendo they connect with music?

The result:No matter the students are inborn deaf or postnatal deaf, few students have the connection with music or musical instruments.But it is worth to say that all of students love music,as well as art.The only thing which they feel worried is that there is no way for them to study or learn music and art.They all hope to have a chance to feel music someday.

Page 18: Visible Melody

Image_Beijing Association for the Handicapped

18Visible Melody

Questionnaire summary

Because deaf-mute are good at understand concrete issues,and are sensitive with active things,so I made a decision to use active video to expain music.With the help of active videos,the deaf-mute could understand the emotion of music rapidly.Due to the limitation of my first questionnaire,it is not unnecessary to make a second questionnaire with a large number of people who are in different ages, own various jobs and experiences,so that the result will be correct.

Time: March 30, 2010Place: No.318 Guanganmennei, Xuanwu District, Beijing Association for the HandicappedNumber: 150

Interview contents:Which kind of TV programs and movies do they usually watch?The demand for them to active videos.

The second questionnaire about active videos

Active videos

Active videos script

From the results of two questionnaires,It is obvious that the deaf-mute need for music,and they are very sensitive about the form of active videos.Thus, with the emotion which is the soul of music,I designed four active videos with four emotions.They are happiness, sadness, anger and fear.

happiness

sadness

Page 19: Visible Melody

Image_Beijing Association for the Handicapped

18Visible Melody

Questionnaire summary

Because deaf-mute are good at understand concrete issues,and are sensitive with active things,so I made a decision to use active video to expain music.With the help of active videos,the deaf-mute could understand the emotion of music rapidly.Due to the limitation of my first questionnaire,it is not unnecessary to make a second questionnaire with a large number of people who are in different ages, own various jobs and experiences,so that the result will be correct.

Time: March 30, 2010Place: No.318 Guanganmennei, Xuanwu District, Beijing Association for the HandicappedNumber: 150

Interview contents:Which kind of TV programs and movies do they usually watch?The demand for them to active videos.

The second questionnaire about active videos

Active videos

Active videos script

From the results of two questionnaires,It is obvious that the deaf-mute need for music,and they are very sensitive about the form of active videos.Thus, with the emotion which is the soul of music,I designed four active videos with four emotions.They are happiness, sadness, anger and fear.

happiness

sadness

Page 20: Visible Melody

20Visible Melody

anger

fear

anger

fear

happiness

sadness

Active videos screenshots

Page 21: Visible Melody

20Visible Melody

anger

fear

anger

fear

happiness

sadness

Active videos screenshots

Page 22: Visible Melody

22Visible Melody

Active videos feedback

Image_Miss Gao explain the titles of questionnaire

Image_operations area Image_deaf students are finishing the questionnaire

Image_deaf students are watching active video

Image_deaf students are thinking

During the questionnaire,more than 78% of deaf-mute could understand all the information in the active videos, only 22% could understand half of the main points.Active videos get success.

Page 23: Visible Melody

22Visible Melody

Active videos feedback

Image_Miss Gao explain the titles of questionnaire

Image_operations area Image_deaf students are finishing the questionnaire

Image_deaf students are watching active video

Image_deaf students are thinking

During the questionnaire,more than 78% of deaf-mute could understand all the information in the active videos, only 22% could understand half of the main points.Active videos get success.

Page 24: Visible Melody

24Visible Melody

The use of other sensesFrom the feedback which got from the deaf-mute, active videos make sence.So in the following parts, I decided to use more sense to express music, as a result, deaf-mute could understand more effectively.

Method ONE: through the painters' minds and actionsI invited two painters to draw as soon as listen the music.There is no limit of paper size, composition of a picture and material of drawing.During a period of time, painters had to express their feelings about music.

Image_two painters are drawing

Image_feeling 01

Image_feeling 15

Page 25: Visible Melody

24Visible Melody

The use of other sensesFrom the feedback which got from the deaf-mute, active videos make sence.So in the following parts, I decided to use more sense to express music, as a result, deaf-mute could understand more effectively.

Method ONE: through the painters' minds and actionsI invited two painters to draw as soon as listen the music.There is no limit of paper size, composition of a picture and material of drawing.During a period of time, painters had to express their feelings about music.

Image_two painters are drawing

Image_feeling 01

Image_feeling 15

Page 26: Visible Melody

26Visible Melody

Image_feeling 18

Image_feeling 17

Image_feeling 04

Image_feeling 24

Page 27: Visible Melody

26Visible Melody

Image_feeling 18

Image_feeling 17

Image_feeling 04

Image_feeling 24

Page 28: Visible Melody

28Visible Melody

Method TWO: with the help of medical equipment, I recorded normal people's heartbeat when they hear different emotion of music

Record ten of normal people's heartbeat when they listen music. With these images, deaf-mute can feel the tempo of music.

Image_electrocardiogram

Page 29: Visible Melody

28Visible Melody

Method TWO: with the help of medical equipment, I recorded normal people's heartbeat when they hear different emotion of music

Record ten of normal people's heartbeat when they listen music. With these images, deaf-mute can feel the tempo of music.

Image_electrocardiogram

Page 30: Visible Melody

30Visible Melody

Method THREE: with the help of touch, I made emotional sculptures

Basing on the analysis done of the music score, I got special points.Use di� erent materials to express happiness, sadness, anger and fear.With the help of touch, deaf-mute could feel directly and e� ectively,

happiness

sadness

anger

anger

fear

Page 31: Visible Melody

30Visible Melody

Method THREE: with the help of touch, I made emotional sculptures

Basing on the analysis done of the music score, I got special points.Use di� erent materials to express happiness, sadness, anger and fear.With the help of touch, deaf-mute could feel directly and e� ectively,

happiness

sadness

anger

anger

fear

Page 32: Visible Melody

长笛

Flauti

A调单簧管

Clarinetti(A)

F调圆号 1

Corni(F) 1

F调圆号 2

Corni(F) 2

双簧管

Oboi

大管

Fagotti

Tam-tam

Bb调圆号

Trombe(Bb)

长号 2

Tromboni 2

鼓板

Gu Ban

Piatti

竖琴 1

Arpa 1

钢琴 1

Piano 1

第一小提琴

Violini 1

中提琴

Viole

低音提琴

Contrabassi

长号 1

Tromboni 1

定音鼓

Timpani

竖琴 2

Arpa 2

钢琴 2

Piano 2

独奏小提琴

Violino solo

第二小提琴

Violini 2

大提琴

Violoncelli

32Visible Melody

Fore movement: grace & cheer

New way of expressing symphony and music score

By using more senses to express music, deaf-mute could feel and understand music,it is a progress of both form and e� ect.Moreover, I began to explore a new way to express symphony, as well as music score.

Fresh form about music score of symphony of butterfly lovers

Introduction of music score

Music score was divided into three movements: fall in love, refuse to marry and change into butterfly

Fresh form of music score used the results and feedback, both of which came from the investgation before. It was the continue of active videos and emotional sculptures.

Nowdays, staff and numbered musical notation are required people to own the knowledge of music when they use and read them. For deaf-mute, it is hard to communicate with others, thus; they need a method to comprehend music score directly and simply. In my design of music score, it is easier for deaf-mute and normal people to read and see, indeed, I added more information into music score, such as, emotion and musical instrument, both of which are never appear in the music score before.

There were 23 types of musical instruments that plaied in music score of symphony of butter� y lovers, I used 23 kinds of � gures to represent with di� erent colors.

According to development of story, there are different musical instruments with various tempo, pitch and frequency. All of these difference can be found in this music score, which can help deaf-mute to feel and understand music and symphony easily.

Page 33: Visible Melody

长笛

Flauti

A调单簧管

Clarinetti(A)

F调圆号 1

Corni(F) 1

F调圆号 2

Corni(F) 2

双簧管

Oboi

大管

Fagotti

Tam-tam

Bb调圆号

Trombe(Bb)

长号 2

Tromboni 2

鼓板

Gu Ban

Piatti

竖琴 1

Arpa 1

钢琴 1

Piano 1

第一小提琴

Violini 1

中提琴

Viole

低音提琴

Contrabassi

长号 1

Tromboni 1

定音鼓

Timpani

竖琴 2

Arpa 2

钢琴 2

Piano 2

独奏小提琴

Violino solo

第二小提琴

Violini 2

大提琴

Violoncelli

32Visible Melody

Fore movement: grace & cheer

New way of expressing symphony and music score

By using more senses to express music, deaf-mute could feel and understand music,it is a progress of both form and e� ect.Moreover, I began to explore a new way to express symphony, as well as music score.

Fresh form about music score of symphony of butterfly lovers

Introduction of music score

Music score was divided into three movements: fall in love, refuse to marry and change into butterfly

Fresh form of music score used the results and feedback, both of which came from the investgation before. It was the continue of active videos and emotional sculptures.

Nowdays, staff and numbered musical notation are required people to own the knowledge of music when they use and read them. For deaf-mute, it is hard to communicate with others, thus; they need a method to comprehend music score directly and simply. In my design of music score, it is easier for deaf-mute and normal people to read and see, indeed, I added more information into music score, such as, emotion and musical instrument, both of which are never appear in the music score before.

There were 23 types of musical instruments that plaied in music score of symphony of butter� y lovers, I used 23 kinds of � gures to represent with di� erent colors.

According to development of story, there are different musical instruments with various tempo, pitch and frequency. All of these difference can be found in this music score, which can help deaf-mute to feel and understand music and symphony easily.

Page 34: Visible Melody

Middle movement: anxiety & indignation

看得见的旋律—

梁祝交响乐总谱

展开部

看得见的旋律—

梁祝交响乐总谱

再现部

看得见的旋律—

梁祝交响乐总谱

再现部

34Visible Melody

screenshot of active music score

Last movement: sorrow & miserableness

Interactive Design

Finshing the new style of music score, I turned to design an active way, by which deaf-mute could take part in and create their music by themselves with this Interactive Design.

There were several given buttons to represent di� erent musical instruments, audience could choose the musical instrument which they prefer to use them to perform a concert.

According to a variety of musical instruments which own their speical characteristics, the image and movement are totally di� erent. So that not onlt the deaf-mute, but also the normal people could feel the energy in music and know more about musical instruments.

Page 35: Visible Melody

Middle movement: anxiety & indignation

看得见的旋律—

梁祝交响乐总谱

展开部

看得见的旋律—

梁祝交响乐总谱

再现部

看得见的旋律—

梁祝交响乐总谱

再现部

34Visible Melody

screenshot of active music score

Last movement: sorrow & miserableness

Interactive Design

Finshing the new style of music score, I turned to design an active way, by which deaf-mute could take part in and create their music by themselves with this Interactive Design.

There were several given buttons to represent di� erent musical instruments, audience could choose the musical instrument which they prefer to use them to perform a concert.

According to a variety of musical instruments which own their speical characteristics, the image and movement are totally di� erent. So that not onlt the deaf-mute, but also the normal people could feel the energy in music and know more about musical instruments.

Page 36: Visible Melody

Visible Melody

Image_books in the exhibition Image_screen and keyboard of Interactive Design

The final exhibition

After hundreds of days and nights, on May 23, 2010, my graduation design visiable melody was showed on the 7th floor in No.7 building of CAFA. In the exhibition, emotional sculptures, active videos, music score of symphony butterfly lovers and interactive design were exhibited, some questionnaires were also put as a part of my design.

36

Page 37: Visible Melody

Visible Melody

Image_books in the exhibition Image_screen and keyboard of Interactive Design

The final exhibition

After hundreds of days and nights, on May 23, 2010, my graduation design visiable melody was showed on the 7th floor in No.7 building of CAFA. In the exhibition, emotional sculptures, active videos, music score of symphony butterfly lovers and interactive design were exhibited, some questionnaires were also put as a part of my design.

36

Page 38: Visible Melody

Image_musical symbol in the exhibition

38Visible Melody

The direction of research in the future

Although the transformation obtained a couple of achievements at this time,for deaf-mute and their soundless world, there is a new way for them to relax and feel life.It was just a beginning, a starting point of a poject.Music is a measure which owns many aspects,if I want to express the whole part of music,more things have to be done. With the result I have got this time,in the future, I can add more issues, such as musical instrument, by which I can classify them into di� erent parts.Olfactory is also a great way to express my design.More angle, more phase and more orientation I will use.I hope that with the help of my design, the deaf-mute could possess a life which is full of happiness and delight.

Page 39: Visible Melody

Image_musical symbol in the exhibition

38Visible Melody

The direction of research in the future

Although the transformation obtained a couple of achievements at this time,for deaf-mute and their soundless world, there is a new way for them to relax and feel life.It was just a beginning, a starting point of a poject.Music is a measure which owns many aspects,if I want to express the whole part of music,more things have to be done. With the result I have got this time,in the future, I can add more issues, such as musical instrument, by which I can classify them into di� erent parts.Olfactory is also a great way to express my design.More angle, more phase and more orientation I will use.I hope that with the help of my design, the deaf-mute could possess a life which is full of happiness and delight.

Page 40: Visible Melody

Visible Melody