This paper presents a method for matching two perspective images from a well defined indoor scene. The method insists on exploring both geometric constraints and perceptual grouping for reducing the search space. The geometric constraints used are principally perspective information, such as vanishing point, horizon line and projective coordinates. The perceptual groups are such as directional, rays and collinear groups. Our method succeeds in analyzing successively the rotational and translational effect. which makes geometric constraints more direct and easier to explore. The matching strategy is coarse-to-fine, based on the hierarchical perceptual grouping. The hypotheses are then propagated and verified to the whole image by neighboring, relationship without backtracking. The matching results are also presented.