The 2023 Computer Olympiad

Hiroyuki Iida,Jonathan Schaeffer,I-Chen Wu

DOI: https://doi.org/10.3233/icg-230240

2024-01-08

ICGA Journal

Abstract:The 26th Computer Olympiad was held online during August/September 2023. With 102 participating programs competing in 32 events, the event was a success.

computer science, software engineering

What problem does this paper attempt to address?

Development and exploration of Chinese National Olympiad in Informatics (CNOI)

Hong Wang,Baolin Yin,Wenxin Li

2007-01-01

Abstract:This article presents a general overview of the historic development, exploration and practice of CNOI during the past 23 years. It includes: 1) some historical data recording the development of CNOI; 2) main contest activities organized by the Scientific Committee and Competition Committee of NOI of CCF, and some relevant management experiences; 3) the selection mechanism for the best contestants of CNOI; 4) the development and characteristics of a testing and evaluation system; 5) the development and characteristics of a visible team competition; 6) training of contestants and teachers, and the improvement and perfection of competition rules.
Competitive Programming in Computational Thinking and Problem Solving Education

Kevin K. F. Yuen,Dennis Y. W. Liu,Hong Va Leong

DOI: https://doi.org/10.1002/cae.22610

2023-01-01

Computer Applications in Engineering Education

Abstract:Building practical programming competency requires a long‐lasting journey of discovery, trial and error, learning and improvement. This article presents essential findings of a case study of a Python programming contest with an automatic judgement system for Competitive Programming training extending the learning experiences for students in an introductory course, computational thinking and problem‐solving. The benefits and challenges are discussed. Due to the coronavirus disease 2019 (COVID‐19) epidemic, a hybrid model of the contest was adopted, that is, some students participated in the contest on‐site, while others participated remotely. To alleviate human effort in judging the submissions, the DOMjudge platform, a web‐based automatic judgement system, has been deployed as an online automatic judgement system and contest management in competitive programming. The implementation roadmap and framework were provided. The contest problems and contestants' performances were discussed. Not many junior contestants could solve at least one problem(s), and competitive computing training should be offered if the students are keen on open competitions. An empirical study was conducted to evaluate the student feedback after the contest. Preliminary results revealed that the contest offering the chance to stimulate student learning interests could enhance their independent learning, innovative thinking and problem‐solving skills, and could thus lead to the overall benefits of the learning experiences, which further encourage them to participate in future contests to improve their learning and therefore enhance their employability. Employers often treasure student experiences in competitive programming events, like association for computing machinery programming contests, Google Code Jam or Microsoft Imagine Cup. Sharp vision requiring skills to tackle unseen problems within a short period is also instrumental to students planning for graduate school.
The First Global e-Competition on Astronomy and Astrophysics

Ioana A. Zelko,Charles Barclay,Tonis Eenmae,Taavet Kalda,Hara Papathanassiou,Nikita Poljakov,Gustavo A. Rojas,Tiit Sepp,Greg Stachowski,Aniket Sule

2023-07-17

Abstract:The first Global e-Competition on Astronomy and Astrophysics was held online in September-October 2020 as a replacement for the International Olympiad on Astronomy and Astrophysics, which was postponed due to the COVID-19 pandemic. Despite the short time available for organisation, 8 weeks, the competition was run successfully, with 325 students from over 42 countries participating with no major issues. The feedback from the participants was positive and reflects the ways in which such events can boost interest in astronomy and astronomy education. With online activities set to become more prevalent in the future, we present an overview of the competition process, the challenges faced, and some of the lessons learned, aiming to contribute to the development of best practices for organizing online competitions.

Physics Education,Instrumentation and Methods for Astrophysics
AI-Olympics: Exploring the Generalization of Agents through Open Competitions

Chen Wang,Yan Song,Shuai Wu,Sa Wu,Ruizhi Zhang,Shu Lin,Haifeng Zhang

2024-05-23

Abstract:Between 2021 and 2023, AI-Olympics, a series of online AI competitions was hosted by the online evaluation platform Jidi in collaboration with the IJCAI committee. In these competitions, an agent is required to accomplish diverse sports tasks in a two-dimensional continuous world, while competing against an opponent. This paper provides a brief overview of the competition series and highlights notable findings. We aim to contribute insights to the field of multi-agent decision-making and explore the generalization of agents through engineering efforts.

Multiagent Systems
The Design and Implementation of Modern Online Programming Competitions

Benjamin Spector,Michael Truell

DOI: https://doi.org/10.48550/arXiv.1710.07738

2017-10-21

Abstract:This paper presents a framework for the implementation of online programming competitions, including a set of principles for the design of the multiplayer game and a practical framework for the construction of the competition environment. The paper presents a successful example competition, the 2016-17 Halite challenge, and briefly mentions a second competition, the Halite II challenge, which launched in October 2017.

Computers and Society
Can Language Models Solve Olympiad Programming?

Quan Shi,Michael Tang,Karthik Narasimhan,Shunyu Yao

2024-04-17

Abstract:Computing olympiads contain some of the most challenging problems for humans, requiring complex algorithmic reasoning, puzzle solving, in addition to generating efficient code. However, it has been understudied as a domain to evaluate language models (LMs). In this paper, we introduce the USACO benchmark with 307 problems from the USA Computing Olympiad, along with high-quality unit tests, reference code, and official analyses for each problem. These resources enable us to construct and test a range of LM inference methods for competitive programming for the first time. We find GPT-4 only achieves a 8.7% pass@1 accuracy with zero-shot chain-of-thought prompting, and our best inference method improves it to 20.2% using a combination of self-reflection and retrieval over episodic knowledge. However, this is far from solving the benchmark. To better understand the remaining challenges, we design a novel human-in-the-loop study and surprisingly find that a small number of targeted hints enable GPT-4 to solve 13 out of 15 problems previously unsolvable by any model and method. Our benchmark, baseline methods, quantitative results, and qualitative analysis serve as an initial step toward LMs with grounded, creative, and algorithmic reasoning.

Computation and Language,Artificial Intelligence,Programming Languages
Virtual Reality in the Digital Olympic Museum

Zhigeng Pan,Wenzhi Chen,Mingmin Zhang,Jianfeng Liu,Gangshan Wu

DOI: https://doi.org/10.1109/mcg.2009.103

IF: 1.909

2009-01-01

IEEE Computer Graphics and Applications

Abstract:The Digital Olympic Museum demonstrates the Olympics' history, culture, and highlights in a virtual environment. The authors describe the framework of their prototype, which also features three virtual games. Implementation of such a system validates the feasibility of the digital Olympic museum.
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

Zhen Huang,Zengzhi Wang,Shijie Xia,Xuefeng Li,Haoyang Zou,Ruijie Xu,Run-Ze Fan,Lyumanshan Ye,Ethan Chern,Yixin Ye,Yikai Zhang,Yuqing Yang,Ting Wu,Binjie Wang,Shichao Sun,Yang Xiao,Yiyuan Li,Fan Zhou,Steffi Chern,Yiwei Qin,Yan Ma,Jiadi Su,Yixiu Liu,Yuxiang Zheng,Shaoting Zhang,Dahua Lin,Yu Qiao,Pengfei Liu

2024-06-19

Abstract:The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclusive to human intellect. To comprehensively evaluate current models' performance in cognitive reasoning abilities, we introduce OlympicArena, which includes 11,163 bilingual problems across both text-only and interleaved text-image modalities. These challenges encompass a wide range of disciplines spanning seven fields and 62 international Olympic competitions, rigorously examined for data leakage. We argue that the challenges in Olympic competition problems are ideal for evaluating AI's cognitive reasoning due to their complexity and interdisciplinary nature, which are essential for tackling complex scientific challenges and facilitating discoveries. Beyond evaluating performance across various disciplines using answer-only criteria, we conduct detailed experiments and analyses from multiple perspectives. We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions. Our extensive evaluations reveal that even advanced models like GPT-4o only achieve a 39.97% overall accuracy, illustrating current AI limitations in complex reasoning and multimodal integration. Through the OlympicArena, we aim to advance AI towards superintelligence, equipping it to address more complex challenges in science and beyond. We also provide a comprehensive set of resources to support AI research, including a benchmark dataset, an open-source annotation platform, a detailed evaluation tool, and a leaderboard with automatic submission features.

Computation and Language,Artificial Intelligence
Recap of the 42nd Edition of the International Conference on Computer- Aided Design (ICCAD 2023)

Evangeline Young

DOI: https://doi.org/10.1109/mdat.2024.3351568

2024-02-23

IEEE Design and Test

Abstract:This Year Marks our return to a fully in-person International Conference on Computer-Aided Design (ICCAD) after the COVID-19 pandemic. We are thrilled to resume an event with personal interactions and extensive networking while retaining some good practices adopted during the pandemic of having a virtual platform where participants and authors can connect remotely.

engineering, electrical & electronic,computer science, hardware & architecture
The Organization of Intel Cup Undergraduate Embedded System Electronic Design Contest

Tianzhou Chen,Jolly Wang,Bin Xie,Guozhi Xu

DOI: https://doi.org/10.1109/ICPADS.2008.83

2008-01-01

Abstract:The Intel Cup Undergraduate Embedded System Electronic Design Contest is an embedded system design invitational contest in China. This contest is held every two years since 2002. The contest focuses on the embedded system design and implementation. And it gives undergraduates a chance to show their creativity and learn teamwork. The influence of the contest is keeping increasing. Now it is an international invitational contest. And some universities from the countries which are advanced in computing begin to take part in the contest. In this paper we describe the experiences in such a contest for embedded system.
Preface - IHMSC2020

Yongchuan Tang

DOI: https://doi.org/10.1109/ihmsc49165.2020.10076

2020-01-01

Abstract:Advances in Artificial Intelligence and Machine Learning, Human-Machine Systems, and Cybernetics continually play important roles in creating intelligent and friendly environments involving state-of-art technologies.The aim of this conference is to provide a forum for exchanges of research results, novel ideas and innovative applications among researchers and practitioners involved with all aspects of Human-Machine Systems and Cybernetics in the era of Big Data and Knowledge Network.However, due to Covid-19 global pandemic, the conference has to be held virtually this year, there will be 10 virtual sessions devoted to theories and methodologies for this conference.
The Tokyo 2020 Olympic Games: impacts of COVID-19 and digital transformation

EDUARDO RUSSO,ARIANE RODER FIGUEIRA,CLARICE SECCHES KOGUT,RENATO DOURADO COTTA DE MELLO

DOI: https://doi.org/10.1590/1679-395120210150x

2022-03-01

Abstract:Abstract The Olympic Games have been responsible for moving billions of dollars in direct and indirect investments during their winter and summer editions in the host cities, thus leaving tangible and intangible legacies that, if well used, can promote significant changes in the daily lives of societies. For the first time in the modern era of the Olympic Games, at the beginning of 2020, this cycle had to be postponed due to the COVID-19 pandemic that had killed more than 4 million people worldwide by July 2021. The teaching case puts the reader in the role of Hiroto Nakami, then President of the Tokyo 2020 Organizing Committee, to solve operational barriers and make it possible to create a successful digital Olympic Games model. It will be necessary to evaluate the financial and technological limitations in order to assess the impacts and legacies from these actions for the event and the local business environment. The case is suitable for multidisciplinary undergraduate and graduate students interested in discussing themes and concepts related to the area of strategic planning, crisis management, mega-events, and digital transformation.

English Else
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems

Chaoqun He,Renjie Luo,Yuzhuo Bai,Shengding Hu,Zhen Leng Thai,Junhao Shen,Jinyi Hu,Xu Han,Yujie Huang,Yuxiang Zhang,Jie Liu,Lei Qi,Zhiyuan Liu,Maosong Sun

2024-06-06

Abstract:Recent advancements have seen Large Language Models (LLMs) and Large Multimodal Models (LMMs) surpassing general human capabilities in various tasks, approaching the proficiency level of human experts across multiple domains. With traditional benchmarks becoming less challenging for these models, new rigorous challenges are essential to gauge their advanced abilities. In this work, we present OlympiadBench, an Olympiad-level bilingual multimodal scientific benchmark, featuring 8,476 problems from Olympiad-level mathematics and physics competitions, including the Chinese college entrance exam. Each problem is detailed with expert-level annotations for step-by-step reasoning. Evaluating top-tier models on OlympiadBench, we implement a comprehensive assessment methodology to accurately evaluate model responses. Notably, the best-performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning. Our analysis orienting GPT-4V points out prevalent issues with hallucinations, knowledge omissions, and logical fallacies. We hope that our challenging benchmark can serve as a valuable resource for helping future AGI research endeavors. The data and evaluation code are available at \url{<a class="link-external link-https" href="https://github.com/OpenBMB/OlympiadBench" rel="external noopener nofollow">this https URL</a>}

Computation and Language
The circumstance design of international programming contest

Chen Yongqiang,Tang Zhizhong

DOI: https://doi.org/10.3969/j.issn.1002-4956.2010.10.031

2010-01-01

Abstract:This paper introduces the circumstance of international programming contest such as ACM,CCC,NOI and so on,held at Tsinghua University.Including software circumstance and hardware circumstance,all of these circumstances ensure the contest to be held successfully.
Proceedings of the 2023 XCSP3 Competition

Gilles Audemard,Christophe Lecoutre,Emmanuel Lonca

DOI: https://doi.org/10.48550/arXiv.2312.05877

2023-12-10

Abstract:This document represents the proceedings of the 2023 XCSP3 Competition. The results of this competition of constraint solvers were presented at CP'23 (the 29th International Conference on Principles and Practice of Constraint Programming, held in Toronto, Canada from 27th to 31th August, 2023).

Artificial Intelligence
The 28th IEEE European Test Symposium

Naghmeh Karimi

DOI: https://doi.org/10.1109/mdat.2023.3292800

2024-02-03

IEEE Design and Test

Abstract:The 28th IEEE European Test Symposium (ETS) was held in Venice, Italy, 22–26 May 2023, in a hybrid format. This was the second hybrid venue for ETS since the COVID-19 pandemic. ETS is Europe's premier forum in the area of electronic-based circuits and system testing, reliability, security, and validation. ETS'23 was arranged in five days and the program consisted of keynotes, scientific paper presentations, panels, workshops, highlights/demos from the industry, a PhD forum, and a McCluskey contest. It also included the Test Spring School (TSS). A total of 238 attendees (including both in-person and virtual) registered for the conference from 36 countries among which 102 were from industry and 135 were affiliated with academia (including 53 students).

engineering, electrical & electronic,computer science, hardware & architecture
Engaging and Motivating Students Through Programming Competitions and GIS Applied Research Projects

Youry Khmelevsky,Ken Chidlow,Kenichi Sugihara,Kongwen Zhang

DOI: https://doi.org/10.1145/3085585.3088491

2017-05-05

Abstract:In this presentation we report on two approaches related to engaging and motivating students: programming competitions and applied research projects. We report on student programming competition results of students from the Computer Science Department (COSC) of Okanagan College (OC) and discuss the achieved results from an educational point of view. Students reported that participation in competitions gave them motivation to effectively learn in their programming courses, inspire them to learn deeper and more thoroughly, and help them achieve better results in their classes. In addition we have found that some freshmen and sophomore students in diploma and degree programs are very capable and eager to be involved in applied research projects as early as the second semester. In 2016 COSC won a fifth NSERC Engage College applied research grant with Esri Canada and Gifu-Keizai University (Japan): Roof Damage Assessment from Automated 3D Building (http://tinyurl.com/lz85n7d). The project is still on-going, but students are excited and enjoy working with the GIS systems, tools and 3D modelling. Dr. Sugihara from Gifu-Keizai University conducted training for the students during his short visit to the College and worked with the students. He demonstrated how to digitize building polygons from orthophotography and how to automatically generate general shaped 3D building models with roofs, based on non-orthogonal input building polygons (building footprints). In 2016 COSC students achieved 2nd place in Canada and 125th of 2,200 teams globally at the IEEEXtreme 10th annual student programming competition (http://tinyurl.com/ltk3n87) (compared with 2015, 25th in Canada and in top 500 world-wide http://tinyurl.com/k4utmmg). Then in 2017 a pair of OC computer science students logged an impressive showing at MIT's longest running programming competition IJBattlecode" against 1000+ teams. In Okanagan College's very first appearance at the competition, two freshman students placed 49th overall, competing against top post-secondary institutions from all over the world (http://tinyurl.com/kjxp3mm).
ITiCSE 2022 call for participation

Brett Becker,Keith Quille,Mikko-Jussi Laakso

DOI: https://doi.org/10.1145/3538522.3538526

2022-04-01

ACM SIGCSE Bulletin

Abstract:The 27th annual ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) will take place in Dublin, Ireland, hosted by University College Dublin (UCD), with support from the Technological University of Dublin (TU Dublin).
Message from the Workshop Chairs; COMPSAC 2024

A. K. M. Jahangir Alam Majumder,Yoshiaki Hori,Ji-Jiang Yang

DOI: https://doi.org/10.1109/compsac61105.2024.00008

2024-01-01

Abstract:It is our great pleasure to welcome you to the workshops of the 48th IEEE International Conference on Computers, Software, and Applications (COMPSAC 2024), which is held in the Osaka, Japan, on July 2 - 4, 2024. The theme of COMPSAC 2024 is “Digital Development for a Better Future”. The IEEE COMPSAC is well established in its 48th edition as a highly reputed conference in the field of computer software and applications. Digital development at COMPSAC 2024 will focus on research and development of computing technologies for their eventual integration into all aspects of society.
The Design and Analysis of Experimental Test for the 29th Chinese Chemical Olympiad (Finals)

ZHA Zheng-Gen,JIN Gu,LAN Quan,HUANG Wei,ZHU Ping-Ping

DOI: https://doi.org/10.3866/pku.dxhx201604027

2016-01-01

Daxue Huaxue

Abstract:The design of experimental test for the 29th Chinese Chemical Olympiad (Finals) was introduced and analyzed. Experimental test, design ideas, the development of experimental selection and evaluation rules were provided.

The 2023 Computer Olympiad

Development and exploration of Chinese National Olympiad in Informatics (CNOI)

Competitive Programming in Computational Thinking and Problem Solving Education

The First Global e-Competition on Astronomy and Astrophysics

AI-Olympics: Exploring the Generalization of Agents through Open Competitions

The Design and Implementation of Modern Online Programming Competitions

Can Language Models Solve Olympiad Programming?

Virtual Reality in the Digital Olympic Museum

OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

Recap of the 42nd Edition of the International Conference on Computer- Aided Design (ICCAD 2023)

The Organization of Intel Cup Undergraduate Embedded System Electronic Design Contest

Preface - IHMSC2020

The Tokyo 2020 Olympic Games: impacts of COVID-19 and digital transformation

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems

The circumstance design of international programming contest

Proceedings of the 2023 XCSP3 Competition

The 28th IEEE European Test Symposium

Engaging and Motivating Students Through Programming Competitions and GIS Applied Research Projects

ITiCSE 2022 call for participation

Message from the Workshop Chairs; COMPSAC 2024

The Design and Analysis of Experimental Test for the 29th Chinese Chemical Olympiad (Finals)