Social media has drastically restructured the way we communicate in an incredibly short period of time. We can discover, \u201cLike,\u201d click on, and share information faster than ever before, guided by algorithms most of us don\u2019t quite understand.<\/p>\n
And while some social scientists, journalists, and activists have been raising concerns about how this is affecting our democracy, mental health, and relationships, we haven\u2019t seen biologists and ecologists weighing in as much.<\/p>\n
That\u2019s changed with a new paper published in the prestigious science journal PNAS<\/em> earlier this month, titled \u201cStewardship of global collective behavior.\u201d<\/p>\n Seventeen researchers who specialize in widely different fields, from climate science to philosophy, make the case that academics should treat the study of technology\u2019s large-scale impact on society as a \u201ccrisis discipline.\u201d A crisis discipline is a field in which scientists across different fields work quickly to address an urgent societal problem \u2014 like how conservation biology tries to protect endangered species or climate science research aims to stop global warming. <\/p>\n The paper argues that our lack of understanding about the collective behavioral effects of new technology is a danger to democracy and scientific progress. For example, the paper says that tech companies have \u201cfumbled their way through the ongoing coronavirus pandemic, unable to stem the \u2018infodemic\u2019 of misinformation\u201d that has hindered widespread acceptance of masks and vaccines. The authors warn that if left misunderstood and unchecked, we could see unintended consequences of new technology contributing to phenomena such as \u201celection tampering, disease, violent extremism, famine, racism, and war.\u201d<\/p>\n It\u2019s a grave warning and call to action by an unusually diverse swath of scholars across disciplines \u2014 and their collaboration indicates how concerned they are.<\/p>\n Recode spoke with the lead author of the paper, Joe Bak-Coleman, a postdoctoral fellow at the University of Washington Center for an Informed Public\u2028, as well as co-author Carl Bergstrom, a biology professor at the University of Washington, to better understand this call for a paradigm shift in how scientists study the technology we use every day. <\/p>\n The two interviews have been combined and lightly edited for length and clarity.<\/p>\n Shirin Ghaffary<\/p>\n You tweeted that this paper is one of the most important ones you\u2019ve published yet. Why?<\/p>\n Carl Bergstrom<\/p>\n My original background is in infectious disease epidemiology, respiratory viruses. And so I was able to do some stuff that\u2019s reasonably important during Covid. What I\u2019m doing there is really filling in the details in a well-established framework. So it\u2019s more, you know, dotting the i\u2019s and crossing the t\u2019s. <\/p>\n And I think what\u2019s really important about this paper is that it\u2019s not doing that at all. It\u2019s saying, \u201cHere\u2019s a massive problem, and the way to conceptualize it, that is critically important for the future. \u201c<\/p>\n And, you know, it\u2019s suggesting an alarm going off upstairs. It\u2019s a call to arms. It\u2019s saying, \u201cHey, we\u2019ve got to solve this problem, and we don\u2019t have a lot of time.\u201d<\/p>\n Shirin Ghaffary<\/p>\n And what is that problem? What are you sounding the alarm bell on?<\/p>\n Carl Bergstrom<\/p>\n My sense is that social media in particular \u2014 as well as a broader range of internet technologies, including algorithmically driven search and click-based advertising \u2014 have changed the way that people get information and form opinions about the world. <\/p>\n And they seem to have done so in a manner that makes people particularly vulnerable to the spread of misinformation and disinformation. <\/p>\n Just as one example: A paper \u2014 a poorly done research paper \u2014 can come out suggesting that hydroxychloroquine might be a treatment for Covid. And in a matter of days, you have world leaders promoting it, and people struggling to get [this medicine], and it being no longer available to people who need it for treatment of other conditions. Which is actually a serious health problem. <\/p>\n So you can have these bits of misinformation that explode at unprecedented velocity in ways that they wouldn\u2019t have prior to this information ecosystem.<\/p>\n [Now], you can create large communities of people that hold constellations of beliefs that are not grounded in reality, such as [the conspiracy theory] QAnon. You can have ideas like anti-vaccination ideas spread in new ways. You can create polarization in new ways. <\/p>\n And [you can] create an information environment where misinformation seems to spread organically. And also [these communities can] be extremely vulnerable to targeted disinformation. We don\u2019t even know the scope of that yet. <\/p>\n Joe Bak-Coleman<\/p>\n The question we were trying to answer was, \u201cWhat can we infer about the course of society at scale, given what we know about complex systems?\u201d <\/p>\n It\u2019s kind of how we use mice models or flies to understand neuroscience. Part of this came back to animal societies \u2014 namely groups \u2014 to understand what they tell us about collective behavior in general, but also complex systems more broadly. <\/p>\n So our goal is to take that perspective and then look at human society with that. And one of the things about complex systems is they have a finite limit to perturbation. If you disturb them too much, they change. And they often tend to fail catastrophically, unexpectedly, without warning.<\/p>\n We see this in financial markets \u2014 all of a sudden, they crash out of nowhere. <\/p>\n Carl Bergstrom<\/p>\n My hope is very much that this [paper] will sort of galvanize people. The issues that are in this paper are ones that people have been thinking about from many, many different fields. It\u2019s not like these are new issues entirely. <\/p>\n It\u2019s rather that I think this paper will hopefully really highlight the magnitude of what\u2019s happened and the urgency of fixing it. Hopefully, it\u2019ll galvanize some kind of transdisciplinary collaborations.<\/p>\n So it\u2019s important because it says this needs to be a crisis discipline, this is something that we don\u2019t understand. We don\u2019t have a theory for how all of these changes are affecting the way that people come to form their beliefs and opinions, and then use those to make decisions. And yet, that\u2019s all changing. It\u2019s happening. …<\/p>\n There\u2019s a misperception that we\u2019re saying, \u201cExposure to ads is bad \u2014 that\u2019s causing the harm.\u201d That\u2019s not what we\u2019re saying. Exposure to ads may or may not be bad. What we\u2019re concerned about is the fact that this information ecosystem has developed to optimize something orthogonal to things that we think are extremely important, like being concerned about the veracity of information or the effect of information on human well-being, on democracy, on health, on the ecosystem. <\/p>\n Those issues are just being left to sort themselves out, without a whole lot of thought or guidance around them.<\/p>\n That puts it in this crisis discipline space. It\u2019s like climate science where you don\u2019t have time to sit down and work out everything definitively. This paper is essentially saying something quite similar \u2014 that we don\u2019t have time to wait. We need to start addressing these problems now.<\/p>\n Shirin Ghaffary<\/p>\n What do you say to the people who think this is not really a crisis and argue that people had similar concerns when the printing press came out that now seem alarmist?<\/p>\n Carl Bergstrom<\/p>\n Well, with the printing press, I would push back. The printing press came out and upended history. We\u2019re still recovering from the capacity that the printing press gave to Martin Luther. The printing press radically changed the political landscape in Europe. And, you know, depending on whose histories you go by, you had decades if not centuries of war [after it was introduced]. <\/p>\n So, did we somehow recover? Sure we did. Would it have been better to do it in a stewarded way? I don\u2019t know. Maybe. These major transitions in information technology often cause collateral damage. We tend to hope that they also bring about a tremendous amount of good as we move toward human knowledge and all of that. But even the fact that you\u2019ve survived doesn\u2019t mean that it\u2019s not worth thinking about how to get through it smoothly.<\/p>\n It reminds me of one of the least intelligent critiques of the [Covid-19] vaccines that we\u2019re using now: \u201cWe didn\u2019t have vaccines during the Black Death plague. And we\u2019re still here.\u201d We are, but it took out a third of the population of Europe.<\/p>\n Shirin Ghaffary<\/p>\n Right, so there is pain and suffering that happened with all those transformational technologies as well.<\/p>\n Carl Bergstrom<\/p>\n Yeah. So I think it\u2019s important to recognize that. It\u2019s still possible to mitigate harm as you go through a transformation, even if you know you\u2019re going to be fine. I also don\u2019t think it\u2019s completely obvious that we are going to be fine on the other end. <\/p>\n One of the really key messages of the paper is that there tends to be this general trust that everything will work out, that people will eventually learn to screen sources of information, that the market will take care of it. <\/p>\n And I think one of the things that the paper is saying is that we\u2019ve got no particular reason to think that that\u2019s right. There\u2019s no reason why good information will rise to the top of any ecosystem we\u2019ve designed. So we\u2019re very concerned about that.<\/p>\n Shirin Ghaffary<\/p>\n One important defense of social media is that Facebook and Twitter can be places where people share new ideas that are not mainstream that end up being right. Sometimes media gatekeepers can get things wrong and social media can allow better information to come out. For example, some people like Zeynep Tufekci were sounding the alarm on the pandemic early, largely on Twitter, back in February 2020, far ahead of the CDC and most journalists.<\/p>\n Carl Bergstrom<\/p>\n Yeah, to look at the net, you have to look at the net influence of the system, right? If somebody on social media has things right but if the net influence on social media is to promote anti-vaccination sentiment in the United States to the point that we\u2019re not going to be able to reach herd immunity, it doesn\u2019t let social media off the hook. …<\/p>\n I was enormously optimistic about the internet in the \u201990s. [I thought] this really was going to remove the gatekeepers and allow people who did not have financial, social, and political capital to get their stories out there.<\/p>\n And it\u2019s certainly possible for all that to be true and for the concerns that we express in our paper to also be correct.<\/p>\n Joe Bak-Coleman<\/p>\n Democratizing information has had profound effects, especially for marginalized, underrepresented communities. It gives them the ability to rally online, have a platform, and have a voice. And that is fantastic. At the same time, we have things like genocide of Rohingya Muslims and an insurrection at the Capitol happening as well. And I hope that it\u2019s a false statement to say we have to have those growing pains to have the benefits.<\/p>\n Shirin Ghaffary<\/p>\n How much do we know about whether [misinformation] has increased in the past year or five years, 10 years, and by how much?<\/p>\n Carl Bergstrom<\/p>\n That\u2019s one of the real challenges that we\u2019re facing, actually, is that we don\u2019t have a lot of information. We need to figure out how, to what degree, people have been exposed to misinformation, to what degree is that influencing subsequent online behavior. All of this information is held exclusively by the tech companies that are running these platforms. <\/p>\n [Editor\u2019s note: Most major social media companies work with academics who research their platforms\u2019 effects on society, but the companies restrict and control how much information researchers can use.] <\/p>\n Shirin Ghaffary<\/p>\n What does treating the impact of social media as a crisis discipline mean? <\/p>\n Carl Bergstrom<\/p>\n For me, a crisis discipline is a situation where you don\u2019t have all of the information that you need to know exactly what to do, but you don\u2019t have time to wait to figure it out. <\/p>\n This was the situation with Covid in February or March 2020. We\u2019re definitely in that position with global climate change. We\u2019ve got better models than we did 20 years ago, but we still don\u2019t have a complete description of how that system works. And yet, we certainly don\u2019t have time to wait around and figure all that out.<\/p>\n And here, I think that the speed with which social media, combined with a whole number of other things, has led to very widespread disinformation \u2014 [that] here in the United States [is] causing major political upheaval \u2014 is striking. How many more elections do you think we have before things get substantially worse? <\/p>\n So there are these super-hard problems that take radical transdisciplinary work. We need to figure out how to come together and talk about all that. But at the same time, we have to be taking actions.<\/p>\n Shirin Ghaffary<\/p>\n How do you respond to the chicken-and-egg argument? You hear defenders of technology say, \u201cWe\u2019re just seeing real-world polarization reflected online,\u201d but there\u2019s no proof that the internet is causing polarization. <\/p>\n Carl Bergstrom<\/p>\n This should be a familiar argument. This is what Big Tobacco used, right? This is Merchants of Doubt stuff. They said, \u201cWell, you know, yeah, sure, lung cancer rates are going up, especially among smokers \u2014 but there\u2019s no proof it\u2019s been caused by that.\u201d <\/p>\n And now we\u2019re hearing the same thing about misinformation: \u201cYeah, sure, there\u2019s a lot of misinformation online, but it doesn\u2019t change anyone\u2019s behavior.\u201d But then all of a sudden you got a guy in a loincloth with buffalo horns running around the Capitol building. <\/p>\n Shirin Ghaffary<\/p>\n The paper calls for people to more urgently understand the impacts of these new rapid advancements in communication technology in the past 15 years. Do you think that this isn\u2019t being addressed enough by academic scientists, government leaders, or companies?<\/p>\n Joe Bak-Coleman<\/p>\n There\u2019s been a lot of work that\u2019s been done here, and I don\u2019t think we\u2019re trying to reinvent that wheel at all. But I think what we\u2019re really trying to do is just highlight the need for urgent action and draw these parallels to climate change and to conservation biology, where they\u2019ve been dealing with really similar problems. And the way they\u2019ve structured themselves, like climate change now involves everything from chemists to ecologists. And I think social science tends to be fairly fragmented in subdisciplines, without a lot of connection between them. And trying to bring that together was a major goal of this paper.<\/p>\n Shirin Ghaffary<\/p>\n I\u2019m biased to be very aware of this problem because my job is to report on social media, but it feels like there is a lot of fear and concern about social media\u2019s impact. Misinformation, phone addiction \u2014 these seem to be issues that everyday people worry about. Why do you think there still isn\u2019t enough attention on this? <\/p>\n Carl Bergstrom<\/p>\n When I talk to people about social media, yes, there\u2019s a lot of concern, there\u2019s a lot of negativity, and then there\u2019s bias by being a parent as well. But the focus is often on the individual-level effects. So it\u2019s, \u201cMy kids are developing negative issues around self-esteem because of the way that Instagram is structured to get \u2018Likes\u2019 for being perfect and showing more of your body.\u201d <\/p>\n But there\u2019s less talk about the entire large-scale structural changes that this is inducing. So what we\u2019re saying is, we really want people to look at the large-scale structural changes that these technologies are driving in society.<\/p>\n