• Embed Doc
  • Readcast
  • Collections
  • CommentGo Back
 
Aaron Lieb02 . 05 . 09Thesis StatementConcept
(ProZeuxis) Live Visual Effects Table 
– a compositing system controlledby a tangible user interface and extended reality techniques that manipulatesprojected graphics supporting a live performance.
Statement
The ProZeuxis system will be a compositing system to generate visual effectsfor the purpose of enhancing a live performance of any type. The system will beflexible and easily allow the user to create expressive visuals that incorporateaspects of the performance including live beat detection, and motion tracking to driveeffects. Using these features, my concentration will be to implement a reactivenessto improvisation from the actions of the user and performers.
 
Synopsis
 
ProZeuxis is a system that will be designed to control projected graphicsfor live performances. Much like in existing systems, a VJ using ProZeuxis will need to prepareeffects and select video file clips before the performances. However, unlike existing software,the user will have at their disposal a full tool set for combining their video loops and still imageswith procedural effects that are controlled by audio and video stimuli coming from live performerson a stage. This will allow for interesting interactive effects to be created improvisationally. Thenature of using a table interface will also permit for multiple people to use the system at once. Thisfeature adds to the depth of complexity and uniqueness of each performance that is uncommon inother VJ software.This technology would work best in medium sized clubs, somewhat larger sized venues,and theaters. Setting up the system would require there be a space for the VJ performer orperformers to stand and be able to view the entire stage. Some hardware including the stageprojector, camera, and microphones will also need to be installed in the venue space before theperformance. These are important components that will need to communicate with a laptop runningProZeuxis in order to incorporate live audio and motion detection.The system will be able to support different configurations of audio and video input feeds.This flexibility will be an added feature as different performances may have different requirementsfor setting up the system. For example, for a trio of of instrumentalists performing at a smallervenue, it might make sense to have one camera and each persons' instrument separately micedand running to a mixer. This would allow the system to track each band member's position onstage from the camera and also have access to a custom mixed signal of what each are playing.Imagine if you will, that the trio is a drummer, upright bass and sax player. When thesystem detects that each is playing at a relatively similar volume, at an even mix, one visualbackground or environment will be shown, and be able to be manipulated by the VJ changing theposition of reactTable markers. Now the drummer has launched into a maddening drum solo, whilethe other players remain silent. The system could detect this audio activity, and morph the visual toa particle field of sparks exploding in relative time to the drummer, while also tracking the particleemitter to his camera tracked position.Another scenario might include a prerecorded music piece with twelve dancers on a largerstage. With this setup, you would not need a mixer between your audio input and the system, but
 
you would need to have two cameras to cover the wider stage for proper tracking. Many interestingcombinations of visual effects could be accomplished with such a setup. For example, abackground layer of visuals may be purely controlled by the prerecorded score, to establish areactive environment. For foreground animations, you could coordinate a color tracking effect toanalyze the movement of the dancers. Perhaps the dancers are representative of two rivalingforces, and half are clad in red, while the others are in white. As the movement of red dancersoutweighs the movement of the white, a projected red avatar could be set to react with a set of animated movements. When the white dancers respond, an avatar acting as their character couldalso retort.Essentially, the system would be able to support many conceivable stage andperformance configurations taking into account the size of the space, number of performers, andthe types of performances being given. It would also encourage experimentation on the part of theuser for preparing custom visualizations that would be able to withstand improvisational situations.This aspect holds a great importance to the concept of this project, as many of the existing waysof performing projected stage shows make it quite difficult to achieve this level of expressiveness.Without brining in the aspect of laser light shows, for the projected concert visuals strictly, there iscurrently this issue of the lack of expressiveness which could be viewed as a spectrum.At one end, you have your visuals for pop concerts. Every video clip is laboriously timedout with some extra frames at the head and tail to account for timing slippage. As the songprogresses, video clips are triggered to sync up with the various parts of the songs in sections.Transitions such as fading between the looped clips are utilized to smooth out sections that do notwarrant a jarring cut.The reverse of this, are the “eye candy” visuals that are more common in technoperformances that you might see at a rave. These visuals are typically linked to the music's tempo,but usually provide very little in terms of story telling as they usually consist of quickly flashingcolors and shapes. This can be seen as an updated and automated version of the wet showtraditions from psychedelic music in which overhead projectors would be used to display a dish of swirling colored oil paints. In both of these techniques, there is certainly the ability to improvise andenhance a performance, but visually, not much more is being said than, “look at the colors”.In the center of this spectrum you have VJ's who utilize both of these in a manualapproach of transitioning between manipulated video clips and reactive, eye candy type visuals by
of 00

Leave a Comment

You must be to leave a comment.
Submit
Characters: ...
You must be to leave a comment.
Submit
Characters: ...