RIP Twitter API: A eulogy to its vast research contributions

Ryan Murtfeldt,Naomi Alterman,Ihsan Kahveci,Jevin D. West

2024-04-11

Abstract:Since 2006, Twitter's Application Programming Interface (API) has been a treasure trove of high-quality data for researchers studying everything from the spread of misinformation, to social psychology and emergency management. However, in the spring of 2023, Twitter (now called X) began changing $42,000/month for its Enterprise access level, an essential death knell for researcher use. Lacking sufficient funds to pay this monthly fee, academics are now scrambling to continue their research without this important data source. This study collects and tabulates the number of studies, number of citations, dates, major disciplines, and major topic areas of studies that used Twitter data between 2006 and 2023. While we cannot know for certain what will be lost now that Twitter data is cost prohibitive, we can illustrate its research value during the time it was available. A search of 8 databases and 3 related APIs found that since 2006, a total of 27,453 studies have been published in 7,432 publication venues, with 1,303,142 citations, across 14 disciplines. Major disciplines include: computational social science, engineering, data science, social media studies, public health, and medicine. Major topics include: information dissemination, assessing the credibility of tweets, strategies for conducting data research, detecting and analyzing major events, and studying human behavior. Twitter data studies have increased every year since 2006, but following Twitter's decision to begin charging for data in the spring of 2023, the number of studies published in 2023 decreased by 13% compared to 2022. We assume that much of the data used for studies published in 2023 were collected prior to Twitter's shutdown, and thus the number of new studies are likely to decline further in subsequent years.

Computers and Society

What problem does this paper attempt to address?

### What problems does this paper attempt to solve?

This paper aims to explore and quantify the great contributions of Twitter's API (Application Programming Interface) to academic research from 2006 to 2023, and to reveal the possible impacts after it closes the enterprise - level access and starts charging. Specifically, the paper attempts to answer the following key questions:

1. **The importance of Twitter data in academic research**:
- Since 2006, Twitter's API has provided researchers with rich high - quality data resources, covering multiple fields from misinformation dissemination, social psychology to emergency management.
- The paper shows the great value of these data to the academic community by collecting and counting the number of studies using Twitter data, the number of citations, the discipline distribution, and the main research topics.

2. **The impact of Twitter API charging policy**:
- In the spring of 2023, Twitter (now known as X) began to charge $42,000 per month for its enterprise - level API access, which is an unaffordable high cost for many researchers.
- Researchers without financial support have to find alternative data sources or adjust their research directions, resulting in a significant reduction in research activities relying on Twitter data.

3. **Prediction of future research trends**:
- The paper analyzes the research publications in 2023 and finds that compared with 2022, the number of studies using Twitter data has decreased by 13%.
- Researchers speculate that this downward trend may continue in the coming years because many new studies can no longer obtain the necessary Twitter data.

4. **Research distribution from a multi - disciplinary perspective**:
- By searching 8 databases and 3 related APIs, the paper identifies 27,453 unique research papers, involving 14 major disciplines, such as computational social science, engineering, data science, social media research, public health, and medicine.
- The main topics of these studies include information dissemination, evaluating the credibility of tweets, data analysis strategies, major event detection, and human behavior research.

5. **Policy recommendations and social impacts**:
- The paper calls on policymakers to attach importance to the importance of open - access social media data to avoid losing valuable knowledge and research results due to data access barriers.
- At the same time, the paper hopes to promote legislative bodies (such as the Digital Services Act in the European Union) to encourage technology companies to provide more open data access by showing the value of Twitter data.

In short, this paper not only summarizes the important contributions of Twitter data to academic research in the past 18 years, but also warns about the future research environment and calls for measures to ensure that researchers can continue to obtain the necessary data resources.