The mid-6th century was one of the coldest periods of the last 2000 years as characterized by great societal changes. Here, we study the effect of the volcanic double event in 536 CE and 540 CE on climate and society in southern Norway. The combined climate and growing degree day models and high-resolution pollen and archaeological records reveal that the northern and western sites are vulnerable to crop failure with possible abandonment of farms, whereas the southeastern site is more resilient.