Artificial intelligence

New technologies present new opportunities for good, yet they are often also associated with novel risks. We believe advanced artificial intelligence (AI), particularly the prospect of artificial general intelligence (AGI), may be an important turning point for humanity. With open problems in AI alignment, the development of AGI could lead to extreme risks where humanity loses control of its future. We expect solving these problems ahead of time will require a concerted effort from researchers, policymakers and others in the decades to come.