In this paper we discuss the framework for a realistic walkthrough of cultural heritage sites. The framework includes 3D data acquisition, different data processing steps, coarse to fine 3D reconstruction and rendering to generate realistic walkthrough. Digital preservation of cultural heritage sites is an important area of research since the accessibility of state of the art techniques in computer vision and graphics. We propose a coarse to fine 3D reconstruction of heritage sites using different 3D data acquisition techniques. We have developed geometry based data processing algorithms for 3D data super resolution and hole filling using Riemannian metric tensor and Christoffel symbols as a novel set of features. We generate a walkthrough of the cultural heritage sites using the coarse to fine 3D reconstructed models. We demonstrate the proposed framework using a walkthrough generated for the Vittala Temple at Hampi.