In this paper we propose a comprehensive framework that allows existing local appearance methods to collaborate in order to overcome their mutual drawbacks. Our approach tends to use the best suited local descriptors for a recognition task, and is capable of combining evidence of different methods in the case where no clearly superior type of descriptor exists. We achieve this collaboration by locally matching geometric configurations and let each match contribute to the computation of the apparent motion between a model image and the unknown query image. We show in this paper that, if we have a set of local methods conforming to a small set of conditions, they can share information about evidence of objects in a scene. This shared evidence results in recognition performances that lie beyond the capacities of any of the currently used individual methods.