An Interactive Programming System for Media Computation

This paper presents PAVES, a direct manipulation system that combines aspects of visualization and multimedia systems to form an interactive video programming environment. PAVES extends the VuSystem media processing toolkit with dataflow-style views for controlling compute-intensive media applications as they run. Thus video may be manipulated graphically and interactively --- both program and data are visual and live. PAVES is also novel in its approach to extensibility. Users may freely combine graphical and underlying VuSystem textual programming methods to restructure and reuse applications. This cooperative programming is available across sessions as well as within them. It is implemented with an object-oriented programming foundation that automatically translates between multiple program representations and maintains them in synchrony. 1 Introduction As digital video is manipulated by increasingly powerful computers, new applications that perform significant computation on media ..