Abstract:Distributed infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex scientific workflows to be executed across hybrid systems spanning from IoT Edge devices to Clouds, and sometimes to supercomputers (the Computing Continuum). Understanding the performance trade-offs of large-scale workflows deployed on such complex Edge-to-Cloud Continuum is challenging. To achieve this, one needs to systematically perform experiments, to enable their reproducibility and allow other researchers to replicate the study and the obtained conclusions on different infrastructures. This breaks down to the tedious process of reconciling the numerous experimental requirements and constraints with low-level infrastructure design <a class="link-external link-http" href="http://choices.To" rel="external noopener nofollow">this http URL</a> address the limitations of the main state-of-the-art approaches for distributed, collaborative experimentation, such as Google Colab, Kaggle, and Code Ocean, we propose KheOps, a collaborative environment specifically designed to enable cost-effective reproducibility and replicability of Edge-to-Cloud experiments. KheOps is composed of three core elements: (1) an experiment repository; (2) a notebook environment; and (3) a multi-platform experiment methodology.We illustrate KheOps with a real-life Edge-to-Cloud application. The evaluations explore the point of view of the authors of an experiment described in an article (who aim to make their experiments reproducible) and the perspective of their readers (who aim to replicate the experiment). The results show how KheOps helps authors to systematically perform repeatable and reproducible experiments on the Grid5000 + FIT IoT LAB testbeds. Furthermore, KheOps helps readers to cost-effectively replicate authors experiments in different infrastructures such as Chameleon Cloud + CHI@Edge testbeds, and obtain the same conclusions with high accuracies (> 88% for all performance metrics).

LinkLab 2.0: A Multi-tenant Programmable IoT Testbed for Experimentation with Edge-Cloud Integration

LinkLab: A Scalable and Heterogeneous Testbed for Remotely Developing and Experimenting IoT Applications

Automatic Generation of IoT Device Platforms with AutoLink

EdgeProg: Edge-centric Programming for IoT Applications

Edge-Centric Programming for IoT Applications with Automatic Code Partitioning

NETLAB—An Internet Based Laboratory for Electrical Engineering Education

Building A Robust And Economical Internet Testbed: 6planetlab

Lte 230mhz Wireless Private Network-Based Edge-Cloud Collaboration Architecture For Ubiquitous Power Internet Of Things

TinyLink 2.0

Dragon-Lab - Next Generation Internet Technology Experiment Platform

Concurrent experimentation in NCSLab: A scalable approach for online laboratories

Wsntb: A Testbed for Heterogeneous Wireless Sensor Networks

ExpoNET: A Flexible Platform for Concurrent Experiments on Programmable Infrastructure.

Cloud-Based Federation Framework and Prototype for Open, Scalable, and Shared Access to NextG and IoT Testbeds

KheOps: Cost-effective Repeatability, Reproducibility, and Replicability of Edge-to-Cloud Experiments

LEDGE: Leveraging Edge Computing for Resilient Access Management of Mobile IoT

Demo: Integrated Development of IoT Applications with OneLink.

Network Innovation Experiment Platform Based on Cloud Computing

V-lab: a cloud-based virtual laboratory platform for hands-on networking courses.

Research testbed for end-to-end network performance measurement and troubleshooting based on PlanetLab

A Multidimensional Internet of Things Testbed System: Development and Evaluation