Within the past few decades, Ghana’s mining sector specifically the small scale mining subsector has been marred by controversies mainly due to its threat to sustainable development. This paper provides some insights into the inextricable linkage between sustainable development and illegal gold mining popularly referred to as “galamsey” and examines the effectiveness of political response and processes at the local and national level. While acknowledging the incommensurable role of the mining sector in poverty reduction through employment generation, the adverse impact on the environmental, economic and social fabric of society cannot be ignored. Notwithstanding this hard evidence at hand, successive governments are handicapped to reverse the devastating effects partly due to the complicated and multifaceted nature of the small scale mining sub-sector. Semi-structured interviews were conducted in three illegal mining communities comprised 12 illegal miners and officials task to monitor mining activities. We also extensively utilized official government reports and relevant academic literature to draw attention to the multiplicity and diversity of illegal mining. By examining livelihood strategies and reviewing successive government policies on mining and sustainability, we discovered gaps in the area of policy implementation and systemic marginalization of majority of communities where illegal mining occurs. In this paper, we advocate for a broader multidimensional and sectoral collaboration as a fundamental approach to confront illegal small scale mining activities