IAMAS 2010 Graduation Exhibition

February 18, 2010

The IAMAS 2010 Graduation Exhibition opened this morning. Graduating students from the Academy and the Institute will be showing their works until Sunday February 21st.

After the traditional ribbon ceremony, a bus-full of high school students poured into Softopia’s Sophia Hall.

Mitsuru Tokisato ? What Could Have or Can Happen?

Mitsuru Tokisato ? What Could Have or Can Happen?

DSP course student Mitsuru Tokisato’s piece “What Could Have or Can Happen?” is a photographic record of his surrounding random objects with white tape.

Yuuya Ito ? Cell #00

Yuuya Ito ? Cell #00

Yuuya Ito, the other DSP student exhibiting, created and performed in a short play titled “Cell #0”. He is exhibiting the device he built for his performance: a large faucet that he plants in the sand. He is able to control video projections by turning the faucet and planting the pipe in various places.

Reinhard Gupfinger ? Singing Robot Cricket

Reinhard Gupfinger ? Singing Robot Cricket

Reinhard Gupfinger, an exchange student from the University of Art and Industrial Design Linz, in Austria built a robotic chirping cricket.

IAMAS DSP Course First-year Students Show their Works

February 2, 2010

Following last week’s graduation work presentation, first-year students of the Academy showed their end-of-year projects. Unfortunately, these won’t be at the upcoming graduation exhibition, but it will be possible to see some of them at a show we’re planning for next March.

Kei Shiratori ? Isolated Island

Kei Shiratori ? Isolated Island

Kei Shiratori presented an iPhone multiplayer musical game. Players, using the accelerometer, throw around a ball to each other, which generates sound depending on their actions.

Kazuomi Eshima ? Remind

Kazuomi Eshima ? Remind

Guitarist Kazuo Eshima built two heavy-duty controllers: a minimalist knob device and a monome-like foot controller. Both are built like tanks.
Kim Jong-Un created a sound piece meant to be listened to while riding a bicycle. As you go faster, the sounds of the piece blend in with the sound of the wind in your ears.

Leo Kikuchi ? Landscape in my Arms

Leo Kikuchi ? Landscape in my Arms

In Leo Kikuchi’s video installation, you get to observe the world from the perspective of the author’s swinging arms, as he walks around the landscape.

Bak Young-Hyo ? Cube

Bak Young-Hyo ? Cube

This installation by Bak Young-Hyo is a prototype for a larger outdoor piece in which a giant cubic video balloon floats in the sky.
Daichi Misawa’s “Skies” is a web-based piece in which photographs he took at O?wi?cim (Auschwitz) are modified to create endless variations, in a commentary on plurality and identity.

Shinobu Toma ? Ghost in the Space

This sound installation by Shinobu Toma uses several iPhones in a pitch-dark room. A simple interface allows visitors to specify parameters of loop length and loop repetition. Sounds are simply recorded and played back a number of times, but unexpected sounds arise from the complicated feedback that occurs.

Kanna Komaki ? Show-room

In this video piece, Kanna Komaki transforms an everyday space (a staircase at IAMAS) through the use of a large number of lightbulbs.
Kaori Takemoto’s “Hunter-Gatherer Colorist” is a portable device that uses a colour sensor to allow the user to create colour palettes by literally gathering colours from the external world.

IAMAS DSP Course Students Show their Graduation Work

January 25, 2010

Today and tomorrow, second-year Academy students show their graduation work to teachers and fellow students. The general public will get a chance to experience the works during the IAMAS 2010 exhibition, which will be held from February 18 to 21.

Hideyuki Oda wearing Hoonida-Kim's "C_"

Hoonida-Kim ? "C_"

Yuuya Ito ? "Cell #00"

Mitsuru Tokisato ? "Surround" (Temporary title)

Mitsuru Tokisato ? "Surround" (Temporary title)

Yutaka Kitamura ? "Form. Design + Personal fabrication"

Yutaka Kitamura ? "Form. Design + Personal fabrication"

A Ruby script for generating Jitter attributes

January 3, 2010

Writing your own Max or Jitter externals in C or C++ isn’t terribly hard, once you’ve wrapped your head around the API’s C approach to object oriented programming. However, it does involve a fair bit of boilerplate. This is especially true for adding attributes to an object ? an triply so if this attribute has custom getter and setter methods.

The cv.jit collection now contains more than a few externals and I find myself spending more time trying to find ways to automate some of the repetitive tasks that are required for keeping it up to date. One of the tools I just made is a nifty Ruby script for automatically generating all the necessary attribute-related boilerplate. Simply invoke it at the command line with only a few arguments and it generates a .c file containing the necessary code. It parses the arguments “-c”, “-l”, “-f”, “-d”, “-s” and “-a” as “char”, “long”, “float32”, “float64”, “symbol and “atom” types. Numbers (if there are any) as the number of elements in a list. The arguments “-get” and “-set” specify that the attribute has a custom getter and setter, while “-clip” will add a filter to clip argument values. Any other argument is going to be parsed as the name of the attribute, unless it begins with a “-“, in which case, it’s interpreted as your external’s name (periods are automatically converted to underscores.)

For example:

ruby ./jitargs.rb -f -cv.jit.bigbrother foo

This generates a file “jitter_args.c” in the current directory that looks like this:

//setter/getter declarations

//attribute variables
float foo;


//attribute registration
attr = (t_jit_object *)jit_object_new(_jit_sym_jit_attr_offset,"foo",_jit_sym_float32,

//attribute initialization
x->foo = 0;

If you wish to add more attributes, just run the script again with different arguments, new code will be inserted in the appropriate place. For example, by running the following:

ruby ./jitargs.rb -a -get -set 2 -cv.jit.bigbrother bar

The file above is modified to:

//setter/getter declarations
t_jit_err cv_jit_bigbrother_set_bar(t_cv_jit_bigbrother *x, void *attr, long ac, t_atom *av);
t_jit_err cv_jit_bigbrother_get_bar(t_cv_jit_bigbrother *x, void *attr, long *ac, t_atom **av);

//attribute variables
long barcount;
t_atom bar[2];
float foo;

t_jit_err cv_jit_bigbrother_set_bar(t_cv_jit_bigbrother *x, void *attr, long ac, t_atom *av){
if(ac < 2){ //Not enough parameters? return JIT_ERR_NONE; } return JIT_ERR_NONE; } t_jit_err cv_jit_bigbrother_get_bar(t_cv_jit_bigbrother *x, void *attr, long *ac, t_atom **av){ int i; if ((*ac)&&(*av)) { //memory passed in, use it } else { //otherwise allocate memory *ac = 2; if (!(*av = jit_getbytes(sizeof(t_atom)*(*ac)))) { *ac = 0; return JIT_ERR_OUT_OF_MEM; } } for(i=0;i<2;i++)av[i] = x->bar[i];

return JIT_ERR_NONE;

//attribute registration
attr = (t_jit_object *)jit_object_new(_jit_sym_jit_attr_offset_array, "bar", _jit_sym_atom, 2,
attrflags, (method)cv_jit_bigbrother_get_bar,(method)cv_jit_bigbrother_set_bar,
calcoffset(t_cv_jit_bigbrother, barcount),calcoffset(t_cv_jit_bigbrother,bar));

attr = (t_jit_object *)jit_object_new(_jit_sym_jit_attr_offset,"foo",_jit_sym_float32,

//attribute initialization
x->foo = 0;

All you need to do now is copy and paste the code at the appropriate places. Of course, if I was really crazy, I would write a script that parses and modifies the actual external source but I’ll leave that as an exercise for the reader.

Download the script.

Jane Rigler at IAMAS

November 30, 2009

Flutist and composer Jane Rigler visited us at IAMAS last friday for a lecture and performance of a few of her pieces for flute and live electronics. Jane talked about how traditional musical traditions of places like the Solomon Islands influenced her work as a composer and performer, and showed us some of the Max patches she uses for her performances. She also talked about Music Cre8tor, a system for allowing physically and cognitively challenged children to play music together.

Jane and I, providing the Japanese translation

Jane Rigler and I, providing the Japanese translation


Photographs by Yosuke Kawamura.

Landschaft 1.0

August 18, 2009


This is a synthetic early Japanese summer soundscape. All the material used here was generated from a video of a cicada song-drenched brook that runs near my workplace.

[audio: Landschaft1_0.mp3]

IAMAS Open House 2009

August 1, 2009

The Birth of the Synthetic Voice

July 29, 2009

On the evening of February 15th 1931, four journalists were invited at the London offices of the Producers Distributing Company, an American film distributor. They were introduced to a young engineer by the name of Eric Allan Humphriss, who had just recently joined the company. Previously, Humphriss had been working for RCA on their Photophone sound-on-film technology. The Photophone system produces a variable-width sound track, in which sound waves are represented by a black and white trace of varying width. The other approach to optical soundtracks, variable-density, has ripple-like patterns of varying opacity on the sound track.

Variable width vs. variable density

Variable width vs. variable density

In both approaches, light from the projector shines through a slit before passing through the sound track. Depending on how much of the sound track is obscured, the amount of light that reaches a photoreceptor will fluctuate, producing an audio signal.

One of the significant features of the variable-width approach is that it leaves a trace that is somewhat more legible to the human eye than variable-density ripples; different sounds leave distinctly different marks. While the optical patterns of the sound track originate from someone speaking into a microphone, wouldn’t it be possible to make ink markings directly on film, or to photograph visual motifs to make sound? It appears that the notion of manually drawing a sound track was an obvious idea that was waiting to be found. Indeed, it occurred to several people at more or less the same time.

In the Soviet Union, the composer Arseny Avraamov, the inventor Evgeny Sholpo, along with the animator Mikhail Tsekhanovsky, working on the first Soviet sound film, The Plan for Great Works (The Five Year Plan) – dir. Abran Room, were struck by the ornamental nature of the variable-width sound track. It seemed obvious to them to attempt to draw a sound track by hand. Tsekhanovsky wondered if hidden music could be heard by photographing ancient ornaments onto the soundtrack. Precisely the same idea occurred to the German animator Oscar Fischinger, whose experiments in “sound ornaments” were preceded by fellow German Rudolph Pfenninger’s hand-drawn music.

In all cases, it was the musical potential of drawn sound that appealed to the inventors above. Eric Allan Humphriss, however, was interested in the spoken voice. It is almost certainly during his time at RCA that Humphriss had the idea of improving, or correcting, the sound track manually. After what must have been long hours of studying the “peaks and valleys” of optical sound tracks, Humphriss claimed he became able to readily recognize the shape of the various sounds of the English language, to the point where he was able to read a sound track just like one would read a book. Whether this claim was exaggerated or not, it did lead him to attempt to not only read, but also write, in ink, spoken text.

Eric Allan Humphriss

Eric Allan Humphriss

The four journalists who were led to Humphriss’ office were there to witness the result of his experiments. Humphriss had chosen the phrase “All of a tremble.” On a strip of cardboard, forty feet long, he painted in ink the wave form that would speak those words, which he then photographed onto the sound track of a blank film. He claimed that the whole task took him about 100 hours, but that having done it once, he could now repeat the experiment much more rapidly.

The journalists were apparently impressed by the demonstration. They praised the natural English accent of the “robot voice,” and the articles they wrote were widely published. The Associated Press and the Central Press syndicated the story throughout North America, while the report that appeared in the New York Times is the most often quoted. The London Daily Express, however, ran the lengthiest article, on its front page, no less.

It may be difficult for us to imagine just how shocking Humphriss’ synthetic voice was to people of the 1930s. Cecil Thompson, of the Daily Express wrote:

A deep bass voice it was, clear as a bell, sufficient to please the ears of any Oxford don. “All . . . of . . . a . . . tremble . . .” it said.

There was silence. The “robot” voice had spoken. It was terrifying for the moment, almost horrible. I felt a tingle down my spine. I had heard a voice that was not a voice, words that had never been spoken.

Humphriss told the reporters that on the next day he would start work on creating a female synthetic voice. In fact, it may not be unreasonable to assume that this was the true reason of his joining the Producers Distributing Company. In the following years, a few newspaper stories reported a curious application of Humphriss’ skills. The story went as follows: a new “talkie” starring Constance Bennett (the leading female star in Hollywood at the time) was scheduled to be shown in London. However, because the name of one of the characters happened to coincide with that of a real British peer, the film failed to pass censorship. Since there was no time to have the actors re-record the offending lines, Humphriss was called in to paint in, by hand, a different name, in Constance Bennett’s “own” voice.

"In a recent film, Constance Bennett was heard to utter the name of a fictious British peer. But Miss Bennett never spoke the word. NEITHER DID ANYONE ELSE!" - Central Press 1932

"In a recent film, Constance Bennett was heard to utter the name of a fictious British peer. But Miss Bennett never spoke the word. NEITHER DID ANYONE ELSE!" - Central Press 1932

This story appears to have been fairly well-known at the time. For instance, in a 1933 article, film columnist Alice L. Tildesley wrote: “Some of you may have read of the cardboard voice bestowed on Connie Bennett by a young magician in England.” Despite the story being relatively well-circulated, the details were always quite vague. What was the movie? Who was the British peer? This is never mentioned. In all likeliness, the film in question was titled “Born to Love.” The story was set in England and starred English actors such as Paul Cavanagh, without any doubt it would have been expected to be a hit in London. Indeed, it was shown for several weeks in at least three London theatres, which was more than any other Bennett film that year. One of the characters in “Born to Love” was named Lord Ponsonby, and there was indeed a British peer by the name of Arthur Ponsonby, who, as a writer and politician would have been known to anyone in London at the time.

Constance Bennett and Frederick Kerr, in the role of Lord Ponsonby

Constance Bennett and Frederick Kerr, in the role of Lord Ponsonby. (Publicity still for Born to Love.)

Born to Love” was produced by RKO-Path?, which had adopted RCA’s Photophone technology and its films were distributed in England by the Poducers Distributing Company. It would not be surprising that Humphriss was hired by the Producers Distributing Company with the express purpose of working on the “Born to Love” soundtrack. It is, after all, somewhat odd that a distribution company would hire a full-time sound technical supervisor, as he was credited. Indeed, in the following years he was appointed as production manager.

Humphriss left the Producers Distributing Company in 1936 to head a small production company, Viking Films, a position he held until his death in 1982. Viking films, which owned small sound stages in Kensington, started out making a few low-budget movies that have since been completely forgotten. At least two of them, “Take off that Hat” (1936) and “Shooting Stars” (1937) were directed by Humphriss himself. He didn’t completely stop his technical work as in 1942 he was granted a patent for a film-feeding mechanism for sound cameras. In later years, the Viking Studios were used as television studios, notably by the BBC, under the nickname of “Studio M.”

Eric Allan Humphriss’ obscurity is in part due to the fact that the New York Times mis-reported his name; he was introduced as EA Humphries, a spelling that was copied in every subsequent text that mentioned his experiments. Humphriss is, however, the correct spelling, as attested by several documents, such as his birth and death records, the Daily Express story, his patent, and entries in the British Film and Television Yearbook.

There is very little this remarkable young man can’t do with voices. Give him ink, a pen and a brush and he can draw a super-Caruso, lions and tigers howling in the jungle, or a wailing tragedienne. – John Kobler Jr., Central Press


There were a few stories published the day after the 1931 demonstration, as mentioned the most complete description is in the Daily Express:

Thompson, Cecil. “Artificial Voices Made in a Film Studio – Unspoken Words Heard from a Screen – Celluloid Marvel – An Englishman’s Eerie Invention.” The Daily Express London, February 16 1931: pages 1-2

“Synthetic Speech Demonstrated in London; Engineer Creates Voice Which Never Existed.” The New York Times, February 16 1931: page 2

Associated Press. “Synthetic Voice is Demonstrated.” in Monitor-Index and Democrat, Moberly, MO: page 2

Some later stories, which mention the Constance Bennett movie:

Kobler, John Jr. (Central Press) “Young Engineer Startles By Manufacturing Voice From Piece of Cardboard” in Winnipeg Free Press, December 16 1932: page 6

Tildesley, Alice L. “Who Makes or Unmakes the STARS?” in Oakland Tribune, March 5 1933

Humphriss’ patent:

Humphriss, E. A. Improvements in or relating to sound recording film cameras. Great Britain patent GB549315, November 16 1942. Viking Films Ltd.

A short biography can be found in this reference:

Price, D., Lockwood, M., Simmons, J. Eds. “Humphriss Eric” in British Film and Television Yearbook. British and American Film Press. 1949. p. 579

This excellent paper treats in great length drawn sound work by Rudolph Pfenninger. Humphriss is also mentioned, but the author appears to have taken most of his information from the New York Times story, and he uses the mistaken spelling:

Levin, T. Y. Tones from out of Nowhere. In Grey Room Summer 2003, No. 12: 32-79

This web page about the history of television studios in London has a section on the Viking Studios, which were headed by Eric Allan Humphriss:

History of TV studios in London

International Computer Music Conference 2009

July 24, 2009

16-21 August 2009, McGill University, Montr?al, Canada

I will be doing a poster presentation for my paper?Perceptually Motivated Sonification of Moving Images. I will bring audio and video demonstrations of my approach to creating sounds from images.

Visit?the official ICMC 2009 site.

OpenCV and Computer Vision in Art Workshop

28 April 2009, Soogsil University, Seoul, Korea

This was a four hour workshop in which I presented a historical overview of how computer vision has been used in the arts. I introduced both technical and aesthetic aspects of several important works and we followed with a short introduction to the OpenCV library. You can find?also a simple tutorial I made for this workshop.


This workshop was part of a bigger event,?Home Party, organised jointly by the DSP Couse of IAMAS and the BK21 Media Division of Soongsil University.