New Disquietude podcast episode: music by Lesley Flanigan, Dave Seidel, KMRU, Celia Hollander, and John Hooper; interview with Flanigan; commentary; short essay on reading waveforms. • F.A.Q.Key Tags: #saw2for33third, #field-recording, #classical, #juntoElsewhere: Twitter, SoundCloud, Instagram
This Week in Sound

Listening to art. Playing with audio. Sounding out technology. Composing in code. Rewinding the soundscape.

“‘Seeing’ Music from Manga”

Synesthesia thesis

Many years ago, I spent a solid half decade publishing manga, eventually becoming the editor-in-chief of the U.S. edition of the magazine Shonen Jump. It was an amazing experience, one I treasure to this day. However, my work on manga rarely overlapped with my interest in sound.

Traveling to Japan for work over the years did give me the opportunity to attend concerts at Tokyo venues I’d otherwise never have even heard about. Also, there were times while preparing an issue of the magazine when we got to debate how to translate sound effects, or how to effectively help a young reader (this was back from 2004 to 2009, before manga was as mainstream as it became outside Japan) understand things like the vertical ellipses that signify an extended silent pause. Most of the shonen comics I worked on were about fighting (e.g., Naruto, One Piece), the main exception being, as one reader put it, “the one about moving stones around a board.” (The latter was a joke at the expense of Hikaru no Go, which was one of my favorite things we published.)

And so it was with great interest that I read a new academic study from two authors based at National Taiwan University, Taipei: “‘Seeing’ music from manga: visualizing music with embodied mechanisms of musical experience.” The article looks specifically at how music is represented in manga (for the uninitiated, the word is both singular and plural, as is the norm in the Japanese language) that take music as their subject. Iju Hsu and Wen-Yu Chiang, the article’s authors, study such highly recommended series as Nodame Cantabile (about a classical music student ) and Detroit Metal City (the title is self-explanatory), among others.

Are You Experienced?: This diagram from the article maps “how music is transformed into visualized music”

The article, which came out in the recent volume 21 of the journal Visual Communication, explores visual metaphors for sound in various manners, notably the Visual Metaphor Identification Procedure, or VISMIP. Another approach explores “six embodied mechanisms that induce emotion.” In the words of the authors: “this study sheds light on our overall understanding of audio-visual cross-modality, musical experience, metaphor and embodied experience.” It’s dense stuff, and I’m still making my way through it for a second time — and beginning to explore the trove of articles and books cited as references. (Thanks, Gene Kannenberg Jr. and Bart Beaty!)

By Marc Weidenbaum

Tag: / Leave a comment ]

Post a Comment

Your email is never published nor shared. Required fields are marked *

You may use these HTML tags and attributes <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>


Subscribe without commenting

  • about

  • Marc Weidenbaum founded the website in 1996 at the intersection of sound, art, and technology, and since 2012 has moderated the Disquiet Junto, an active online community of weekly music/sonic projects. He has written for Nature, Boing Boing, The Wire, Pitchfork, and NewMusicBox, among other periodicals. He is the author of the 33 1⁄3 book on Aphex Twin’s classic album Selected Ambient Works Volume II. Read more about his sonic consultancy, teaching, sound art, and work in film, comics, and other media

  • Field Notes

    News, essays, surveillance

  • Interviews

    Conversations with musicians/artists/coders

  • Studio Journal

    Video, audio, patch notes

  • Projects

    Select collaborations and commissions

  • Subscribe

  • Current Activities

  • Upcoming
    • December 13, 2022: This day marks the 26th anniversary of the founding of
    • January 6, 2023: This day marked the 11th anniversary of the start of the Disquiet Junto music community.

  • Recent
    • April 16, 2022: I participated in an online "talk show" by The Big Conversation Space (Niki Korth and Clémence de Montgolfier).
    • March 11, 2022: I hosted a panel discussion between Mark Fell, Rian Treanor and James Bradbury in San Francisco as part of the Algorithmic Art Assembly ( at Gray Area (
    • December 28, 2021: This day marked the 10th (!) anniversary of the Instagr/am/bient compilation.
    • January 6, 2021: This day marked the 10th (!) anniversary of the start of the Disquiet Junto music community.
    • December 13, 2021: This day marked the 25th (!) anniversary of the start of the Disquiet Junto music community.
    • There are entries on the Disquiet Junto in the book The Music Production Cookbook: Ready-made Recipes for the Classroom (Oxford University Press), edited by Adam Patrick Bell. Ethan Hein wrote one, and I did, too.
    • A chapter on the Disquiet Junto ("The Disquiet Junto as an Online Community of Practice," by Ethan Hein) appears in the book The Oxford Handbook of Social Media and Music Learning (Oxford University Press), edited by Stephanie Horsley, Janice Waldron, and Kari Veblen. (Details at

  • My book on Aphex Twin's landmark 1994 album, Selected Ambient Works Vol. II, was published as part of the 33 1/3 series, an imprint of Bloomsbury. It has been translated into Japanese (2019) and Spanish (2018).

  • disquiet junto

  • Background
    Since January 2012, the Disquiet Junto has been an ongoing weekly collaborative music-making community that employs creative constraints as a springboard for creativity. Subscribe to the announcement list (each Thursday), listen to tracks by participants from around the world, read the FAQ, and join in.

    Recent Projects

  • This is an image of three colorful rulers against a plain background. The rulers look normal at first, and then you realize they're sort of oddly colored. That's because they were made by an AI.
  • 0567 / Three Meters / The Assignment: Make music in 5/8, 6/8, and 7/8 time signatures.
    0566 / Outdoor Furniture Music / The Assignment: Imagine the ur-ambient Erik Satie musique d’ameublement concept en plein air
    0565 / Musical Folly / The Assignment: Make a piece of music inspired by this architectural concept.
    0564 / Octave Lept / The Assignment: Work an octave leap — or more than one — into a piece of music.
    0563 / Digital Magical Realism / The Assignment: What does this imaginary genre sound like?

  • Full Index
    And there is a complete list of past projects, 567 consecutive weeks to date.

  • Archives

    By month and by topic

  • [email protected]

    [email protected]

  • Downstream

    Recommended listening each weekday

  • Recent Posts