Research Software Engineering in 2030

Daniel S. Katz,Simon Hettrick

DOI: https://doi.org/10.1109/e-Science58273.2023.10254813

2023-09-28

Abstract:This position paper for an invited talk on the "Future of eScience" discusses the Research Software Engineering Movement and where it might be in 2030. Because of the authors' experiences, it is aimed globally but with examples that focus on the United States and United Kingdom.

Software Engineering

What problem does this paper attempt to address?

The future of software engineering: Visions of 2025 and beyond

Yunyoung Nam,Firoz Khan,Seifedine Kadry,R. L. Kumar

DOI: https://doi.org/10.11591/IJECE.V11I4.PP3443-3450

2021-08-01

International Journal of Electrical and Computer Engineering (IJECE)

Abstract:In the current technological scenario of the industry and businesses, there has been increasing need of software within systems and also an increasing demand being put onto software-intensive systems. This in effect will lead to a significant evolution of software engineering processes over the next twenty years. This is due to the fact of emerging technological advancements like Industry 4.0 and Internet of Things in the IT field, among other new developments. This paper addresses and tries to analyses the key research challenges being faced by the software engineering field and articulates information that is derived from the key research specializations within software engineering. The paper analyses the past and current trends in software engineering. The future of software engineering is also looked with respect to Industry 4.0 which including emerging technological platforms like Internet of Things. The societal impact aspect of future trends in software engineering is also addressed in this paper.

Engineering,Computer Science
The Four Pillars of Research Software Engineering

J. Cohen,D. S. Katz,M. Barker,N. Chue Hong,R. Haines,C. Jay

DOI: https://doi.org/10.1109/MS.2020.2973362

2023-01-26

Abstract:Building software that can support the huge growth in data and computation required by modern research needs individuals with increasingly specialist skill sets that take time to develop and maintain. The Research Software Engineering movement, which started in the UK and has been built up over recent years, aims to recognise and support these individuals. Why does research software matter to professional software development practitioners outside the research community? Research software can have great impact on the wider world and recent progress means the area can now be considered as a more realistic option for a professional software development career. In this article we present a structure, along with supporting evidence of real-world activities, that defines four elements that we believe are key to providing comprehensive and sustainable support for Research Software Engineering. We also highlight ways that the wider developer community can learn from, and engage with, these activities.

Software Engineering
Research Software Science: Expanding the Impact of Research Software Engineering

Michael A. Heroux

DOI: https://doi.org/10.48550/arXiv.2211.09034

2022-11-17

Abstract:Software plays a central role in scientific discovery. Improving how we develop and use software for research can have both broad and deep impacts on a spectrum of challenges and opportunities society faces today. The emergence of Research Software Engineer (RSE) as a role correlates with the growing complexity of scientific challenges and diversity of software team skills. In this paper, we describe research software science (RSS), an idea related to RSE, and particularly suited to research software teams. RSS promotes the use of scientific methodologies to explore and establish broadly applicable knowledge. Using RSS, we can pursue sustainable, repeatable, and reproducible software improvements that positively impact research software toward improved scientific discovery.

Software Engineering
Software Engineering for Robotics: Future Research Directions; Report from the 2023 Workshop on Software Engineering for Robotics

Claire Le Goues,Sebastian Elbaum,David Anthony,Z. Berkay Celik,Mauricio Castillo-Effen,Nikolaus Correll,Pooyan Jamshidi,Morgan Quigley,Trenton Tabor,Qi Zhu

2024-01-23

Abstract:Robots are experiencing a revolution as they permeate many aspects of our daily lives, from performing house maintenance to infrastructure inspection, from efficiently warehousing goods to autonomous vehicles, and more. This technical progress and its impact are astounding. This revolution, however, is outstripping the capabilities of existing software development processes, techniques, and tools, which largely have remained unchanged for decades. These capabilities are ill-suited to handling the challenges unique to robotics software such as dealing with a wide diversity of domains, heterogeneous hardware, programmed and learned components, complex physical environments captured and modeled with uncertainty, emergent behaviors that include human interactions, and scalability demands that span across multiple dimensions.

Robotics,Software Engineering
Foundational Competencies and Responsibilities of a Research Software Engineer

Florian Goth,Renato Alves,Matthias Braun,Leyla Jael Castro,Gerasimos Chourdakis,Simon Christ,Jeremy Cohen,Stephan Druskat,Fredo Erxleben,Jean-Noël Grad,Magnus Hagdorn,Toby Hodges,Guido Juckeland,Dominic Kempf,Anna-Lena Lamprecht,Jan Linxweiler,Frank Löffler,Michele Martone,Moritz Schwarzmeier,Heidi Seibold,Jan Philipp Thiele,Harald von Waldow,Samantha Wittke

2024-08-13

Abstract:The term Research Software Engineer, or RSE, emerged a little over 10 years ago as a way to represent individuals working in the research community but focusing on software development. The term has been widely adopted and there are a number of high-level definitions of what an RSE is. However, the roles of RSEs vary depending on the institutional context they work in. At one end of the spectrum, RSE roles may look similar to a traditional research role. At the other extreme, they resemble that of a software engineer in industry. Most RSE roles inhabit the space between these two extremes. Therefore, providing a straightforward, comprehensive definition of what an RSE does and what experience, skills and competencies are required to become one is challenging. In this community paper we define the broad notion of what an RSE is, explore the different types of work they undertake, and define a list of fundamental competencies as well as values that define the general profile of an RSE. On this basis, we elaborate on the progression of these skills along different dimensions, looking at specific types of RSE roles, proposing recommendations for organisations, and giving examples of future specialisations. An appendix details how existing curricula fit into this framework.

Software Engineering,Computers and Society,Computational Physics
Sustaining Research Software via Research Software Engineers and Professional Associations

Jeffrey C. Carver,Ian A. Cosden,Chris Hill,Sandra Gesing,Daniel S. Katz

DOI: https://doi.org/10.1109/bokss52540.2021.00016

2021-06-01

Abstract:Research software is a class of software developed to support research. Today a wealth of such software is created daily in universities, government, and commercial research enterprises worldwide. The sustainability of this software faces particular challenges due, at least in part, to the type of people who develop it. These Research Software Engineers (RSEs) face challenges in developing and sustaining software that differ from those faced by the developers of traditional software. As a result, professional associations have begun to provide support, advocacy, and resources for RSEs. These benefits are critical to sustaining RSEs, especially in environments where their contributions are often undervalued and not rewarded. This paper focuses on how professional associations, such as the United States Research Software Engineer Association (US-RSE), can provide this support.
The Rise of a New Digital Third Space Professional in Higher Education: Recognising Research Software Engineering

Shoaib Sufi

DOI: https://doi.org/10.48550/arXiv.2103.01041

2021-03-01

Computers and Society

Abstract:Research Software Engineering is the application of professional software skills to research problems. Those who do this are called Research Software Engineers or RSEs for short. RSEs work closely with researchers in a collaborative fashion rather than just offering a standalone function (c.f. the traditional IT workforce or Librarians working to provide a general set of services to the University community such as research, teaching or administrative functions). It is this overlap with academic researchers that make the RSE and the RSE management a new type of third space professional in the higher education sector. We explore aspects of knowledge, relationships, legitimacies and language in relation to the model constructed by Whitchurch in Reconstructing Identities in Higher Education to explore how these relate to the RSE role and go on to highlight open problems that need resolving to put RSEs on a firmer organisational footing.
A Research Software Engineering Workflow for Computational Science and Engineering

Tomislav Maric,Dennis Gläser,Jan-Patrick Lehr,Ioannis Papagiannidis,Benjamin Lambie,Christian Bischof,Dieter Bothe

DOI: https://doi.org/10.48550/arXiv.2208.07460

2022-08-15

Software Engineering

Abstract:University research groups in Computational Science and Engineering (CSE) generally lack dedicated funding and personnel for Research Software Engineering (RSE), which, combined with the pressure to maximize the number of scientific publications, shifts the focus away from sustainable research software development and reproducible results. The neglect of RSE in CSE at University research groups negatively impacts the scientific output: research data - including research software - related to a CSE publication cannot be found, reproduced, or re-used, different ideas are not combined easily into new ideas, and published methods must very often be re-implemented to be investigated further. This slows down CSE research significantly, resulting in considerable losses in time and, consequentially, public funding. We propose a RSE workflow for Computational Science and Engineering (CSE) that addresses these challenges, that improves the quality of research output in CSE. Our workflow applies established software engineering practices adapted for CSE: software testing, result visualization, and periodical cross-linking of software with reports/publications and data, timed by milestones in the scientific publication process. The workflow introduces minimal work overhead, crucial for university research groups, and delivers modular and tested software linked to publications whose results can easily be reproduced. We define research software quality from a perspective of a pragmatic researcher: the ability to quickly find the publication, data, and software related to a published research idea, quickly reproduce results, understand or re-use a CSE method, and finally extend the method with new research ideas.
The Future Is Already Here

Jan Bosch

DOI: https://doi.org/10.1109/ms.2024.3358417

IF: 3

2024-01-01

IEEE Software

Abstract:In this article, we argue that the traditional view on the role of academic research in software is outdated and present an alternative approach to academic research. Finally, we exemplify our approach through a concrete case, Software Center.

computer science, software engineering
Software Engineering und Software Engineering Forschung im Zeitalter der Digitalisierung

Michael Felderer,Ralf Reussner,Bernhard Rumpe

DOI: https://doi.org/10.48550/arXiv.2002.10835

2020-02-25

Abstract:Digitization not only affects society, it also requires a redefinition of the location of computer science and computer scientists, as the science journalist Yogeshwar suggests. Since all official aspects of digitalization are based on software, this article is intended to attempt to redefine the role of software engineering and its research. Software-based products, systems or services are influencing all areas of life and are a critical component and central innovation driver of digitization in all areas of life. Scientifically, there are new opportunities and challenges for software engineering as a driving discipline in the development of any technical innovation. However, the chances must not be sacrificed to the competition for bibliometric numbers as an end in themselves.

Software Engineering
Research Software Engineers: Career Entry Points and Training Gaps

Ian A. Cosden,Kenton McHenry,Daniel S. Katz

DOI: https://doi.org/10.1109/mcse.2023.3258630

2023-01-01

Computing in Science & Engineering

Abstract:As software has become more essential to research across disciplines, and as the recognition of this fact has grown, so too has the importance of professionalizing the development and maintenance of this software. The community of software professionals who work on this software have come together under the title “research software engineer” (“RSE”) over the last decade. This, in turn, has created the need to understand how RSEs come into this profession and into these groups, how to further promote this career path to potential members as well as the need to understand what training gaps need to be filled for RSEs coming from different entry points. We have categorized three main classifications of entry paths into the RSE profession and identified key elements, both advantages and disadvantages, that should be acknowledged and addressed by the broader research community to attract and retain a talented, diverse pool of future RSEs.

computer science, interdisciplinary applications
Research Software Development & Management in Universities: Case Studies from Manchester's RSDS Group, Illinois' NCSA, and Notre Dame's CRC

Daniel S. Katz,Kenton McHenry,Caleb Reinking,Robert Haines

DOI: https://doi.org/10.1109/SE4Science.2019.00009

2019-03-03

Abstract:Modern research in the sciences, engineering, humanities, and other fields depends on software, and specifically, research software. Much of this research software is developed in universities, by faculty, postdocs, students, and staff. In this paper, we focus on the role of university staff. We examine three different, independently-developed models under which these staff are organized and perform their work, and comparatively analyze these models and their consequences on the staff and on the software, considering how the different models support software engineering practices and processes. This information can be used by software engineering researchers to understand the practices of such organizations and by universities who want to set up similar organizations and to better produce and maintain research software.

Software Engineering,Computers and Society
Bridging Gaps, Building Futures: Advancing Software Developer Diversity and Inclusion Through Future-Oriented Research

Sonja M. Hyrynsalmi,Sebastian Baltes,Chris Brown,Rafael Prikladnicki,Gema Rodriguez-Perez,Alexander Serebrenik,Jocelyn Simmonds,Bianca Trinkenreich,Yi Wang,Grischa Liebel

2024-04-11

Abstract:Software systems are responsible for nearly all aspects of modern life and society. However, the demographics of software development teams that are tasked with designing and maintaining these software systems rarely match the demographics of users. As the landscape of software engineering (SE) evolves due to technological innovations, such as the rise of automated programming assistants powered by artificial intelligence (AI) and machine learning, more effort is needed to promote software developer diversity and inclusion (SDDI) to ensure inclusive work environments for development teams and usable software for diverse populations. To this end, we present insights from SE researchers and practitioners on challenges and solutions regarding diversity and inclusion in SE. Based on these findings, we share potential utopian and dystopian visions of the future and provide future research directions and implications for academia and industry to promote SDDI in the age of AI-driven SE.

Software Engineering
Building an AI-ready RSE Workforce

Ying Zhang,Matthew A. Gitzendanner,Dan S. Maxwell,Justin W. Richardson,Kaleb E. Smith,Eric A. Stubbs,Brian J. Stucky,Jingchao Zhang,Erik Deumens

DOI: https://doi.org/10.48550/arXiv.2111.04916

2021-11-09

Abstract:Artificial Intelligence has been transforming industries and academic research across the globe, and research software development is no exception. Machine learning and deep learning are being applied in every aspect of the research software development lifecycles, from new algorithm design paradigms to software development processes. In this paper, we discuss our views on today's challenges and opportunities that AI has presented on research software development and engineers, and the approaches we, at the University of Florida, are taking to prepare our workforce for the new era of AI.

Software Engineering,Artificial Intelligence
A pragmatic workflow for research software engineering in computational science

Tomislav Marić,Dennis Gläser,Jan-Patrick Lehr,Ioannis Papagiannidis,Benjamin Lambie,Christian Bischof,Dieter Bothe

2023-10-02

Abstract:University research groups in Computational Science and Engineering (CSE) generally lack dedicated funding and personnel for Research Software Engineering (RSE), which, combined with the pressure to maximize the number of scientific publications, shifts the focus away from sustainable research software development and reproducible results. The neglect of RSE in CSE at University research groups negatively impacts the scientific output: research data - including research software - related to a CSE publication cannot be found, reproduced, or re-used, different ideas are not combined easily into new ideas, and published methods must very often be re-implemented to be investigated further. This slows down CSE research significantly, resulting in considerable losses in time and, consequentially, public funding. We propose a RSE workflow for Computational Science and Engineering (CSE) that addresses these challenges, that improves the quality of research output in CSE. Our workflow applies established software engineering practices adapted for CSE: software testing, result visualization, and periodical cross-linking of software with reports/publications and data, timed by milestones in the scientific publication process. The workflow introduces minimal work overhead, crucial for university research groups, and delivers modular and tested software linked to publications whose results can easily be reproduced. We define research software quality from a perspective of a pragmatic researcher: the ability to quickly find the publication, data, and software related to a published research idea, quickly reproduce results, understand or re-use a CSE method, and finally extend the method with new research ideas.

Software Engineering
Working in Harmony: Towards Integrating RSEs into Multi-Disciplinary CSE Teams

Miranda Mundt,Reed Milewicz

DOI: https://doi.org/10.48550/arXiv.2201.04010

2022-01-11

Abstract:Within the rapidly diversifying field of computational science and engineering (CSE), research software engineers (RSEs) represent a shift towards the adoption of mainstream software engineering tools and practices into scientific software development. An unresolved challenge is the need to effectively integrate RSEs and their expertise into multi-disciplinary scientific software teams. There has been a long-standing "chasm" between the domains of CSE and software engineering, and the emergence of RSEs as a professional identity within CSE presents an opportunity to finally bridge that divide. For this reason, we argue there is an urgent need for systematic investigation into multi-disciplinary teaming strategies which could promote a more productive relationship between the two fields.

Software Engineering
Roundtable: The Future of Software Engineering for Internet Computing

Jian Lu,David S. Rosenblum,Tevfik Bultan,Valérie Issarny,Schahram Dustdar,Margaret-Anne D. Storey,Dongmei Zhang

DOI: https://doi.org/10.1109/MS.2015.15

IF: 3

2015-01-01

IEEE Software

Abstract:Seven research leaders in software engineering for Internet computing present their viewpoints on important issues that will shape this field's future. They discuss opportunities and challenges for the shifting software paradigm; stepping outside the comfort zone to revisit issues such as software correctness; improving Internet software dependability and programmability; addressing software engineering issues for the Internet of Things; exploring relationships among the Internet of Things, people, and software services; supporting a participatory culture of software development; and rethinking logging in online services.
Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps

David Lo

DOI: https://doi.org/10.48550/arXiv.2309.04142

2023-09-08

Software Engineering

Abstract:For decades, much software engineering research has been dedicated to devising automated solutions aimed at enhancing developer productivity and elevating software quality. The past two decades have witnessed an unparalleled surge in the development of intelligent solutions tailored for software engineering tasks. This momentum established the Artificial Intelligence for Software Engineering (AI4SE) area, which has swiftly become one of the most active and popular areas within the software engineering field. This Future of Software Engineering (FoSE) paper navigates through several focal points. It commences with a succinct introduction and history of AI4SE. Thereafter, it underscores the core challenges inherent to AI4SE, particularly highlighting the need to realize trustworthy and synergistic AI4SE. Progressing, the paper paints a vision for the potential leaps achievable if AI4SE's key challenges are surmounted, suggesting a transition towards Software Engineering 2.0. Two strategic roadmaps are then laid out: one centered on realizing trustworthy AI4SE, and the other on fostering synergistic AI4SE. While this paper may not serve as a conclusive guide, its intent is to catalyze further progress. The ultimate aspiration is to position AI4SE as a linchpin in redefining the horizons of software engineering, propelling us toward Software Engineering 2.0.
Sustainable Software Ecosystems: Software Engineers, Domain Scientists, and Engineers Collaborating for Science

Marcus D. Hanwell,Patrick O'Leary,Bob O'Bara

DOI: https://doi.org/10.48550/arXiv.1407.5701

2014-07-22

Abstract:The development of scientific software is often a partnership between domain scientists and scientific software engineers. It is especially important to embrace these collaborations when developing advanced scientific software, where sustainability, reproducibility, and extensibility are important. In the ideal case, as discussed in this manuscript, this brings together teams composed of the world's foremost scientific experts in a given field with seasoned software developers experienced in forming highly collaborative teams working on software to further scientific research.

Software Engineering
The Future of Software Engineering in an AI-Driven World

Valerio Terragni,Partha Roop,Kelly Blincoe

2024-06-12

Abstract:A paradigm shift is underway in Software Engineering, with AI systems such as LLMs gaining increasing importance for improving software development productivity. This trend is anticipated to persist. In the next five years, we will likely see an increasing symbiotic partnership between human developers and AI. The Software Engineering research community cannot afford to overlook this trend; we must address the key research challenges posed by the integration of AI into the software development process. In this paper, we present our vision of the future of software development in an AI-Driven world and explore the key challenges that our research community should address to realize this vision.

Software Engineering,Artificial Intelligence,Machine Learning,Programming Languages

Research Software Engineering in 2030

The future of software engineering: Visions of 2025 and beyond

The Four Pillars of Research Software Engineering

Research Software Science: Expanding the Impact of Research Software Engineering

Software Engineering for Robotics: Future Research Directions; Report from the 2023 Workshop on Software Engineering for Robotics

Foundational Competencies and Responsibilities of a Research Software Engineer

Sustaining Research Software via Research Software Engineers and Professional Associations

The Rise of a New Digital Third Space Professional in Higher Education: Recognising Research Software Engineering

A Research Software Engineering Workflow for Computational Science and Engineering

The Future Is Already Here

Software Engineering und Software Engineering Forschung im Zeitalter der Digitalisierung

Research Software Engineers: Career Entry Points and Training Gaps

Research Software Development & Management in Universities: Case Studies from Manchester's RSDS Group, Illinois' NCSA, and Notre Dame's CRC

Bridging Gaps, Building Futures: Advancing Software Developer Diversity and Inclusion Through Future-Oriented Research

Building an AI-ready RSE Workforce

A pragmatic workflow for research software engineering in computational science

Working in Harmony: Towards Integrating RSEs into Multi-Disciplinary CSE Teams

Roundtable: The Future of Software Engineering for Internet Computing

Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps

Sustainable Software Ecosystems: Software Engineers, Domain Scientists, and Engineers Collaborating for Science

The Future of Software Engineering in an AI-Driven World