Abstract: Mediated reality describes the concept of filtering our vision of reality, typically using a head-mounted video mixing display. We can redefine this idea in a more constructive context, applying dynamic changes to the appearance and geometry of objects in a real scene using computer graphics. In this paper, we propose new tools for interactively mediated reality. After describing a new generic framework for achieving this goal, we present a prototype system for painting, grabbing and glueing together real and virtual elements. We also conducted an informal evaluation that provides an initial analysis of the level of interest, usability and current technical limitations of this approach. See http://artis.inrialpes.fr/Publications/2005/GBGS05