Computer Science Tag

Matt Lewis on the Choreography of Attention

Matt Lewis is a computer scientist and collaborator on Synchronous Objects. His work in generative drawing was an inspiration for the generative drawing tool available on the site. If you have not played with this tool yet, give it a try, it uses data from the dance to drive the motion of the “paint brushes” and create interesting animations and ultimately drawings. Let us know what you think! –Norah

Here are some thoughts from Matt:

MATT: In addition to making choreographic concepts more comprehensible to other disciplines, we are very interested in ways in which choreographic knowledge is useful in other contexts. Exposure to such ideas should provide new ways of seeing, communicating, and evaluating relationships among elements in complex dynamic systems. Having not had much exposure previously to contemporary dance, I now have a much greater awareness of its complexity and breadth of conceptual material. It’s intriguing to me that I see much richer relationships between dancers and their movements than I had before being introduced to these concepts. Continue Reading

Share/Save/Bookmark

Benjamin Schroeder on the counterpoint tool

“One Flat Thing, reproduced” is contrapuntal, both in its effect – there are many kinds of alignment in time over the course of the piece – and in its construction, in that there are several themes and kinds of movement material that are repeated and re-combined throughout the dance. The result is a complex, beautiful dance. There is something mathematically interesting about this, in the same way that there is in a Bach fugue; both have complexity (but not disorder) built up from individually simple things. This is worthy of study on its own, but also has practical application: in procedural graphics systems, we are often interested in creating complexity out of simple building blocks, as we see with Reynolds flocking or Perlin noise.

I did not know much about dance before starting to work on this project. I have gained a great appreciation for what one might call the formal beauty of dance – the mathematical structures behind the interplay of dancers, and the geometry of motion. This in turn has helped my more visceral appreciation of dance as well as my understanding of related fields.
In the course of the project, I have had a chance to work with people from many different backgrounds, including dance, animation, computer science, geography, and architecture. Having such an interdisciplinary team has made for a very rich research environment.

When we were developing the interactive counterpoint tool, we tried several different systems in an effort to understand what visual counterpoint was, how it arose, and how best to explain it to others. (We had many discussions around this subject – trying to understand counterpoint from the perspectives of dance, animation and design, and computer science. These early conversations and experiments would be a good subject for another post.) I think the system we have today works well because it is based on simple rules, but has a structure with many opportunities for different kinds of alignments and symmetries. At the same time it is not too regular – the pattern of alignments is unpredictable.

The widget shapes in the tool are based on twelve “clock face” positions. The position for each widget arm is selected randomly from among the twelve. Widgets move from shape to shape within a set timing structure, with times for movement chosen from four different speeds, similar to musical quarter, half, dotted quarter, and whole notes.

Leaving aside movement around the “stage” for the moment, we can see many possibilities for interesting motion and alignments within this structure. Widgets might of course take on matching or symmetric shapes, or move in exactly the same direction at exactly the same speed, and this will happen irregularly due to the random choice involved in the process.

More interestingly, we might see widgets take on similar shapes which are not the same, or follow one another’s shapes with a slight delay, or take on shapes which are related but do not have strict symmetry. (I believe that the choice of twelve positions is a fortunate one – there are many pleasing symmetries within the clock face.) The timing system plays a big role here as we can see layers of shape alignment and speed alignment weave into and around each other.

Even within one creature we can see some small counterpoint. Perhaps two arms move together in one direction at the same speed, while the other arm moves in the other direction, twice as fast – then everything reverses and the arms take new roles. Perhaps two arms form a right angle and are still while the third moves slowly from an acute angle to form a “T”.

Motion about the stage is determined in a similar way, with positions and speeds chosen freely from a structured set. At this level we can work with larger groups of objects and watch for alignments in the way they move together.

The structure of the performing widget system lends itself well to contrapuntal motion. The sliders let us give broad choreographic direction to the widgets, encouraging more or less unison in shape, speed, or movement, or calling for more or less stillness. This gives the user a way to explore and traverse the space of motion, using it to learn and to construct beautiful counterpoint.

Share/Save/Bookmark

Matthew Lewis on Dance and Computer Science

NORAH: For this e-symposium, could you talk a little about your involvement in the project and your interests as a generative designer and computer scientist?

crumbs-copy

MATT: Sure. As is often the case at ACCAD, many of us served in several roles during different stages of this very interdisciplinary project. Earlier in our process I provided both computer science and generative art and design perspectives as our multidisciplinary team worked to synthesize an understanding of the complex concepts used in Bill’s choreographic approaches in “One Flat Thing, reproduced”. Throughout, I have been able to advise on aspects of our technical development, with respect to both “what is possible and practical” and the inevitable problem solving.

In order to understand and communicate Bill’s concepts and processes (and consider how these could be applied in other fields) we worked to produce qualitative and quantitative data as a step toward investigating Bill’s question, “what else does this look like?” Given the opportunity to explore different ways of visually presenting several aspects of rich source material, I first made use of overhead video of the dance, and then later from the emerging database being constructed to catalog the choreographic events.  I tried to reduce complexity by extracting and displaying individual qualities like gestures, paths, and interactions, and then ultimately applied concepts learned from the project to my own generative systems.

I made use of image processing, computer vision, 3D computer graphics, and interactive online algorithms as different ways of exploring the data. My computer science background was also helpful as we tried to systematically formalize the components and parameters of the abstract systems we are representing. I particularly enjoyed participating in discussions between representatives from different disciplines analyzing shifts from centralized control, to bottom-up complex distributed systems. It has also been fascinating for me to consider Bill’s iterative choreographic processes through a lens of optimization concepts like genetic algorithms and fitness landscapes.

In addition to making choreographic concepts more comprehensible to other disciplines, we are very interested in ways in which choreographic knowledge is useful in other contexts. Exposure to such ideas should provide new ways of seeing, communicating, and evaluating relationships among elements in complex dynamic systems. Having not had much exposure previously to contemporary dance, I now have a much greater awareness of its complexity and breadth of conceptual material.  It’s intriguing to me that I see much richer relationships between dancers and their movements than I had before being introduced to these concepts.

Our design process made me consider that the choreography of attention, combined with disciplinary knowledge, can control what a viewer perceives. More specifically, it seems that new visual relationship concepts might change what can be seen. I’m still contemplating the relationship between what I think of as more “horizontal” alignments, and the more “vertical” processes of reduction and synthesis. As one might hope for in an academic environment, the project’s framework has emphasized this continuous inquiry, instead of seeking a single correct solution. It also has provided a unique model for collaboration between designers, artists, and scientists that should serve as a valuable benchmark for our projects in the future.

—Matthew Lewis, Advanced Computing Center for the Arts and Design (ACCAD)

Share/Save/Bookmark

Choreographic Objects e-Symposium

niceslicesynco

As we go live with our Beta version of the site we’re also kicking off the blog with contributions from the participants in our symposium held here in Columbus, OH at the Wexner Center for the Arts from 3-5pm on April 1. We’re thinking of these posts as our “e-symposium” for audiences outside of Ohio and we invite your comments and questions.

You can also view the live web-cast of the event at by clicking here.

Here is some more info about the symposium:
As an American working internationally for the last thirty years, William Forsythe is recognized as one of the world’s foremost choreographers. His work is celebrated for reorienting the practice of ballet from its identification with classical repertoire into a dynamic 21st-century art form. In recent years and with the establishment of The Forsythe Company, he has extended his choreographic thinking into new forms such as digital media productions, installations for gallery and public spaces, video, and publications. For Forsythe, these projects are part of a larger sphere of interest he terms “choreographic objects.” The idea of a choreographic object allows for the transformation of a dance from one manifestation (the performance on stage) into an array of other possibilities (such as information, animation or installation). This transformation requires cross-disciplinary collaboration and makes space for new connections between art and science, practice and theory.

In this symposium, Forsythe and his collaborators will discuss how the idea of “choreographic objects” took form in Synchronous Objects for One Flat Thing, reproduced, a new interactive web project created collaboratively by Forsythe with Ohio State’s Maria Palazzi (Advanced Computing Center for the Arts and Design) and Norah Zuniga Shaw (Department of Dance) and an interdisciplinary team of collaborators from across the arts and sciences. To celebrate the launch of the project, invited outside experts will contextualize the project in terms of its relevance to current trends in the philosophy of cognition and architecture. Participants will respond to posts and comments on the blog.

We look forward to hearing from you!
—Norah Zuniga Shaw

Share/Save/Bookmark