This paper considers the problem of three dimensional surface reconstruction of non polyhedral objects through series of images taken from a moving camera. We propose a direct method of surface reconstruction which is based on regularized uniform bicubic B-spline surface patches [35]. This reconstruction is achieved by observing the motion of occluding contours [1, 9, 33], i.e., where the view lines graze the surface. It has been shown that reconstruction of such a three dimensional surface is possible when the camera motion is known, with the exception of those fully concave parts where no view line can be tangential to the surface. Once a set of overlapping B-spline surface patches which constitute the three dimensional surface of an object are reconstructed. We propose an efficient method of fusing them to obtain a global surface. This approach is based on triangular mesh and surface interpolation by using regularized uniform bicubic B-spline surface patches.