Unlike those who grew up in railway towns, the majority of Indians would have a hard time locating towns with quaint names on the Indian map that signified adventure, romance and the Raj. Kharagpur is one such colonial railway town whose history has been overwritten by one of the ‘temples’ of the postcolonial nation state, the prestigious Indian Institute of Technology. But Kharagpur, about 110 km away from Kolkata, is remembered as home in Anglo-Indian memory and finds a mention in histories and fiction dealing with the Anglo-Indian community. Senior residents of Kharagpur corroborate these memories of a vibrant Anglo-Indian community thriving in Kharagpur until the early 1960s when the exodus began. Little remains of that remembered past in the Anglo-Indian neighbourhoods where about 200 Anglo-Indian individuals struggle to resettle in the new constitutional and social space comprising independent India. Yet, the nostalgia of the Kharagpur diasporas produces it as an idyllic colonial outpost with a quintessential Raj lifestyle. Through examining the narratives and oral histories of the Kharagpur diaspora, this article complicates the way that the remembered railway town is produced as home by the community displaced by the new dynamics of power in independent India.