Archaeologists and historians of South Asia have long emphasized the significance of large-scale irrigation reservoirs to historical developments and precolonial land use. However, comparatively little attention has been directed at an extensive corpus of small-scale water-retention features, such as culturally modified weathering pans and rock pools. In this contribution, we provide the first geoarchaeological evidence from such features in southern India. Geochronological assessments, depositional models, and sediment and micromorphological analyses from two sites in northern Karnataka indicate that inhabitants used and modified these features in at least the first millennium BCE. Throughout later historical periods, even after the development of large-scale, primarily elite-sponsored, irrigation reservoirs, inhabitants continued to rely on small, dispersed water-retention features. Our findings have implications for current debates concerning the introduction of water-management practices in southern India, which appear to begin in association with dispersed land-use practices rather than intensive irrigated agriculture, and also corroborate the importance of decentralized water management to historical processes more globally.