Strategic Implications of Openness in AI Development

Nick Bostrom
DOI: https://doi.org/10.1111/1758-5899.12403
2017-02-09
Global Policy
Abstract:This paper attempts a preliminary analysis of the global desirability of different forms of openness in AI development (including openness about source code, science, data, safety techniques, capabilities, and goals). Short‐term impacts of increased openness appear mostly socially beneficial in expectation. The strategic implications of medium and long‐term impacts are complex. The evaluation of long‐term impacts, in particular, may depend on whether the objective is to benefit the present generation or to promote a time‐neutral aggregate of well‐being of future generations. Some forms of openness are plausibly positive on both counts (openness about safety measures, openness about goals). Others (openness about source code, science, and possibly capability) could lead to a tightening of the competitive situation around the time of the introduction of advanced AI, increasing the probability that winning the AI race is incompatible with using any safety method that incurs a delay or limits performance. We identify several key factors that must be taken into account by any well‐founded opinion on the matter. The more that competitors feel that they would still stand to gain from a rival's success, the better the prospects for a collaborative approach or at least one in which competitors don't actively work against one another. For this reason, measures that align the incentives between different AI developers (particularly their incentives at the later stages) are desirable.
political science,international relations
What problem does this paper attempt to address?