Do it once, but do it right

Layal Yasin,Arndt Borkhardt

DOI: https://doi.org/10.3324/haematol.2024.285246

2024-04-25

Haematologica

Abstract:Not available. This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

hematology

What problem does this paper attempt to address?

[Re] Learning to Learn By Self-Critique

Isac Arnekvist,Dmytro Kalpakchi

DOI: https://doi.org/10.48550/arXiv.1912.00183

2019-12-05

Abstract:This work is a reproducibility study of the paper of Antoniou and Storkey [2019], published at NeurIPS 2019. Our results are in parts similar to the ones reported in the original paper, supporting the central claim of the paper that the proposed novel method, called Self-Critique and Adapt (SCA), improves the performance of MAML++. The conducted additional experiments on the Caltech-UCSD Birds 200 dataset confirm the superiority of SCA compared to MAML++. In addition, the reproduced paper suggests a novel high-end version of MAML++ for which we could not reproduce the same results. We hypothesize that this is due to the many implementation details that were omitted in the original paper.

Machine Learning
A choice, not an obligation

I Kappas,VJ Promponas,CA Ouzounis

DOI: https://doi.org/10.1038/s44319-023-00039-9

IF: 9.071

2024-01-02

EMBO Reports

Abstract:The timing of making software open source should not be dictated by journal guidelines.

cell biology,biochemistry & molecular biology
Deposited in DRO : 08 February 2018 Version of attached

Yunyi Cao,Bo Su,Subash Chinnaraj,Saikat Jana,Leon Bowen,Sam Charlton,Pengfei Duan,Nicholas S. Jakubovics,Jinju Chen

2018-01-01

Abstract:Publisher's copyright statement: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
Quality Assured: Rethinking Annotation Strategies in Imaging AI

Tim Rädsch,Annika Reinke,Vivienn Weru,Minu D. Tizabi,Nicholas Heller,Fabian Isensee,Annette Kopp-Schneider,Lena Maier-Hein

2024-07-26

Abstract:This paper does not describe a novel method. Instead, it studies an essential foundation for reliable benchmarking and ultimately real-world application of AI-based image analysis: generating high-quality reference annotations. Previous research has focused on crowdsourcing as a means of outsourcing annotations. However, little attention has so far been given to annotation companies, specifically regarding their internal quality assurance (QA) processes. Therefore, our aim is to evaluate the influence of QA employed by annotation companies on annotation quality and devise methodologies for maximizing data annotation efficacy. Based on a total of 57,648 instance segmented images obtained from a total of 924 annotators and 34 QA workers from four annotation companies and Amazon Mechanical Turk (MTurk), we derived the following insights: (1) Annotation companies perform better both in terms of quantity and quality compared to the widely used platform MTurk. (2) Annotation companies' internal QA only provides marginal improvements, if any. However, improving labeling instructions instead of investing in QA can substantially boost annotation performance. (3) The benefit of internal QA depends on specific image characteristics. Our work could enable researchers to derive substantially more value from a fixed annotation budget and change the way annotation companies conduct internal QA.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Graphical Abstract: Angew. Chem. Int. Ed. 4/2021

Carmen Leitner,Marion Schulz,Marco Cavaco,David Andreu,Miguel A. R. B. Castanho,Ben Hicks,Petra Vasko,J. R. Goicoechea,Simon Aldridge,Anne Lipp,Shorouk O. Badir,Gary A. Molander,Rafael Marín,Gabriel Brunet,Muralee Murugesu,Nathaniel Corrigan,Mustafa Çiftçi,Kwangjin Jung,Célia Boyer,Luis M. Rodríguez,Paula Gómez,M Mμs-Montoya,J.-A. Abad,A Tμrraga,J Cerdμ,J Øndez,David Curiel,Nobuyuki Nishi,Kenta Seki,Daisuke Takahashi,Kazunobu Toshima,Kuanxiao Tang,Minakshi Raj,Shuyuan Xu,M Liu,Yuyang Bai,Hui Liu,Paul ’t Hart,Pascal Hommen,Anaïs F. M. Noisier,Arkadiusz Krzyżanowski,D. Schüler,Arthur T. Porfetye,Mohammad Akbarzadeh,Ingrid R. Vetter,H Dihou,Herbert Waldmann,Koel Dutta,Pintu Kanjilal,Ritam Das,S. Thayumanavan,Young‐Han Shin,H Cho,B. H. Choi,Jaehwan Kim,Han Liang,Lirong Wang,Y. -X Ji,Huan Wang,Bing Zhang,Hao Ge,G Li,Lei Han,Biao Ding,Pu Duan,Reinhard Schulz,A Rçmer,B Vankuiken,S Dechert,S Demeshko,George E. Cutsail,Serena DeBeer,Ricardo A. Mata,Franc Meyer,Arnab K. Maity,Alina M. Alb,Mat thias Zeller,Christopher Uyeda,Conor Lanphere,Patrick M. Arnott,Stephen Jones,Katarina Korlova,Stefan Howorka,Zili Lyu,Shanfeng Zhu,Min Xie,Y Zhang,Zhe Chen,Rong Chen,Mingliang Tian,Mingmin Chi,M. Shao,Yu Xia

DOI: https://doi.org/10.1002/anie.202180411

2021-01-01

Angewandte Chemie International Edition

Abstract:Angewandte Chemie International EditionVolume 60, Issue 4 p. 1665-1682 Graphical AbstractFree Access Graphical Abstract: Angew. Chem. Int. Ed. 4/2021 First published: 18 January 2021 https://doi.org/10.1002/anie.202180411Citations: 2AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinked InRedditWechat Citing Literature Volume60, Issue4January 25, 2021Pages 1665-1682 RelatedInformation
Renewing a Craftsmanship of Attention With the World

Brooke Anne Hofsess

DOI: https://doi.org/10.1080/00393541.2021.1896266

2021-04-03

Studies in Art Education

Abstract:I extend my gratitude to Kryssi Staikidis and Dónal O'Donoghue for the warm encouragement, generative feedback, and keen insights that supported the making of this commentary.No potential conflict of interest was reported by the author.
Nanoarchitectonics beyond perfect order – not quite perfect but quite useful

Lin Cao,Yanqi Huang,Bogdan Parakhonskiy,Andre G Skirtach,Andre G. Skirtach

DOI: https://doi.org/10.1039/d2nr02537j

IF: 6.7

2022-01-01

Nanoscale

Abstract:Nanoarchitectonics, like architectonics, allows the design and building of structures, but at the nanoscale.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology,chemistry
ENCORE: a practical implementation to improve reproducibility and transparency of computational research

Antoine H C van Kampen,Utkarsh Mahamune,Aldo Jongejan,Barbera D C van Schaik,Daria Balashova,Danial Lashgari,Mia Pras-Raves,Eric J M Wever,Adrie D Dane,Rodrigo García-Valiente,Perry D Moerland

DOI: https://doi.org/10.1038/s41467-024-52446-8

2024-09-16

Abstract:Reproducibility of computational research is often challenging despite established guidelines and best practices. Translating these guidelines into practical applications remains difficult. Here, we present ENCORE, an approach to enhance transparency and reproducibility by guiding researchers in how to structure and document a computational project. ENCORE builds on previous efforts in computational reproducibility and integrates all project components into a standardized file system structure. It utilizes pre-defined files as documentation templates, leverages GitHub for software versioning, and includes an HTML-based navigator. ENCORE is designed to be agnostic to the type of computational project, data, programming language, and ICT infrastructure, and does not rely on specific software tools. We also share our group's experience using ENCORE, highlighting that the most significant challenge to the routine adoption of approaches like ours is the lack of incentives to motivate researchers to dedicate sufficient time and effort to ensure reproducibility.
Reproducing, Extending, and Analyzing Naming Experiments

Rachel Alpern,Ido Lazer,Issar Tzachor,Hanit Hakim,Sapir Weissbuch,Dror G. Feitelson

2024-02-15

Abstract:Naming is very important in software development, as names are often the only vehicle of meaning about what the code is intended to do. A recent study on how developers choose names collected the names given by different developers for the same objects. This enabled a study of these names' diversity and structure, and the construction of a model of how names are created. We reproduce different parts of this study in three independent experiments. Importantly, we employ methodological variations rather than striving of an exact replication. When the same results are obtained this then boosts our confidence in their validity by demonstrating that they do not depend on the methodology.

Software Engineering
Curatio et Innovatio

Roberto Rossi

2021-08-10

Abstract:The Middle Ages focused obsessively on the old; our era is totally absorbed with the new. In medio stat virtus. In this short note, I advocate a strategy that blends copyright and copyleft for disseminating research results in the sciences. I argue that such a blend may be beneficial in fields such as mathematics and computer science, that it may facilitate the evolution and emergence of improved problem descriptions, whilst at the same time preserving author's rights, and easing researchers' work.

Digital Libraries
Rerunning OCR: A Machine Learning Approach to Quality Assessment and Enhancement Prediction

Pit Schneider,Yves Maurer

DOI: https://doi.org/10.46298/jdmdh.8561

2022-10-31

Abstract:Iterating with new and improved OCR solutions enforces decision making when it comes to targeting the right candidates for reprocessing. This especially applies when the underlying data collection is of considerable size and rather diverse in terms of fonts, languages, periods of publication and consequently OCR quality. This article captures the efforts of the National Library of Luxembourg to support those targeting decisions. They are crucial in order to guarantee low computational overhead and reduced quality degradation risks, combined with a more quantifiable OCR improvement. In particular, this work explains the methodology of the library with respect to text block level quality assessment. Through extension of this technique, a regression model, that is able to take into account the enhancement potential of a new OCR engine, is also presented. They both mark promising approaches, especially for cultural institutions dealing with historical data of lower quality.

Computation and Language,Artificial Intelligence,Machine Learning
Refactoring for Reuse: An Empirical Study

Eman Abdullah AlOmar,Tianjia Wang,Vaibhavi Raut,Mohamed Wiem Mkaouer,Christian Newman,Ali Ouni

DOI: https://doi.org/10.48550/arXiv.2111.07002

2021-11-13

Abstract:Refactoring is the de-facto practice to optimize software health. While several studies propose refactoring strategies to optimize software design through applying design patterns and removing design defects, little is known about how developers actually refactor their code to improve its reuse. Therefore, we extract, from 1,828 open-source projects, a set of refactorings that were intended to improve the software reusability. We analyze the impact of reusability refactorings on the state-of-the-art reusability metrics, and we compare the distribution of reusability refactoring types, with the distribution of the remaining mainstream refactorings. Overall, we found that the distribution of refactoring types, applied in the context of reusability, is different from the distribution of refactoring types in mainstream development. In the refactorings performed to improve reusability, source files are subject to more design-level types of refactorings. Reusability refactorings significantly impact, high-level code elements, such as packages, classes, and methods, while typical refactorings, impact all code elements, including identifiers, and parameters. These findings provide practical insights into the current practice of refactoring in the context of code reuse involving the act of refactoring.

Software Engineering
Building a Culture of Reproducibility in Academic Research

Jimmy Lin

DOI: https://doi.org/10.48550/arXiv.2212.13534

2022-12-28

Abstract:Reproducibility is an ideal that no researcher would dispute "in the abstract", but when aspirations meet the cold hard reality of the academic grind, reproducibility often "loses out". In this essay, I share some personal experiences grappling with how to operationalize reproducibility while balancing its demands against other priorities. My research group has had some success building a "culture of reproducibility" over the past few years, which I attempt to distill into lessons learned and actionable advice, organized around answering three questions: why, what, and how. I believe that reproducibility efforts should yield easy-to-use, well-packaged, and self-contained software artifacts that allow others to reproduce and generalize research findings. At the core, my approach centers on self interest: I argue that the primary beneficiaries of reproducibility efforts are, in fact, those making the investments. I believe that (unashamedly) appealing to self interest, augmented with expectations of reciprocity, increases the chances of success. Building from repeatability, social processes and standardized tools comprise the two important additional ingredients that help achieve aspirational ideals. The dogfood principle nicely ties these ideas together.

Information Retrieval,Computers and Society
Graphical Abstract: Angew. Chem. Int. Ed. 51/2020

Carmen Leitner,Huan Wang,T. Johansson,Xiang Zhang,Y. H. Xie,M. M. Gauthier,R Odríguez,Jeanne Crassous,Connor W. Coley,Natalie S. Eyke,Kimberly Jensen,Mengnan Wang,Asmaa Mohamed,Wei Jia Ong,Hariom Singh,Chandan Das,Stanley F. Vasa,Klaus Grohe,Lothar Schäfer,Kejiang Cao,Stanisław Skowron,Craig T. Stoppiello,Johannes Biskupek,Yuji Tsuchido,Ryo Abe,Toshinori Ide,Kohtaro Osakada,Tao Ding,Lihua Zhu,Y Fang,Yi Liu,W. Tang,Peng Zou,Fatemeh Hanifpour,A Sveinbjçrnsson,Camila Canales,E Skffllason,Helga Dögg Flosadóttir,Werner Schlemmer,Philipp Nothdurft,A. Petzold,Gérard Riess,Philipp Frühwirt,Max Schmallegger,Georg Gescheidt‐Demner,R Ischer,Stefan A. Freunberger,W Ern,Stefan Spirk,Liuping Wang,Kun Song,Yuzhong Qu,Yung‐Fu Chang,Z Li,C. Dong,M Liu,J.G. Brennan,Yang Li,Mofsi Nb Iomimeticc Hemistry Yang,K Li,Chong Li,Juan Gu,Tai-Hua Lin,Pan Zhang,Yan Tu,Shanfeng Zhu,Haohao Wu,Jian Zhang,Yihong Guo,Zhiyu Hu,Jinling Wang,Peng Zhang,J. Zhu,Ji Hua,X. Y. Shen,Seok‐Min Kang,Yongjae Lee,Reactionm Echanisms,Xin Sheng,Fahmi Himo,Xue Bi,Mingchuan Li,C.-H Liu,Y. Yuan,Brian Key,Ran Ang,Reza Shahbazian‐Yassar,Larry A. Curtiss,Jian Lü,Khalil Amine,Alberto Collauto,Sören von Bülow,Dnyaneshwar B. Gophane,Sanjit Kumar Saha,Lukas S. Stelzl,Gerhard Hummer,Snorri Th. Sigurdsson,Thomas F. Prisner,Ehsan Hamzehpoor,Yoko Sakai‐Otsuka,Thaksen Jadhav,Dmitrii F. Perepichka,Crystalg Rowth,Fei Tong,Wei Li,Imadul Islam,Rabih O. Al‐Kaysi,C. Bardeen,Kevin Singewald,Xiaowei Bogetti,Kirti Sinha,G Srule,Sameer Saxena,Kazuhiko Yoshida,Kenichi Okada,Hiroaki Ueda,Hidetoshi Tokuyama,Rongji Gao,P Wang,B Wang,Lin Li,Haichao Zhao,Yixi Chen,Jin Li,Shiyuan Liu,Kehan Zhao,Andreas Lerchen,G. Narasimhulu,Edward Farrar,N Inter,Johannes Platzek,M. Grayson,Vinay K. Aggarwal,Xingyu Jiang,Liang Zhang,Hongna Liu,Delon Wu,Tian Lin,Lei Liu,Jin Zou,Shuai Luo,Bo Chen,B Liu,Zhiyong Lu,Bin Tang,Zeyu Zhang,K Ye,Hailin Zhang,Sarah P. Niehs,Jana Kumpfmüller,Benjamin Dose,Randie R. Little,Kazuyoshi Ishida,L. T. Florez,Martin Kaltenpoth,Christian Hertweck,François Ghiringhelli,Alexander Uttry,Kalyan Sundar Ghosh,Manuel van Gemmeren,Masaki Shimoi,Takashi Watanabe,Kazuyuki Maeda,Dennis P. Curran,Toshiyuki Taniguchi

DOI: https://doi.org/10.1002/anie.202085111

2020-01-01

Angewandte Chemie International Edition

Abstract:Angewandte Chemie International EditionVolume 59, Issue 51 p. 22805-22824 Graphical AbstractFree Access Graphical Abstract: Angew. Chem. Int. Ed. 51/2020 First published: 07 December 2020 https://doi.org/10.1002/anie.202085111AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinked InRedditWechat Volume59, Issue51December 14, 2020Pages 22805-22824 RelatedInformation
Validation Obligations: A Novel Approach to Check Compliance between Requirements and their Formal Specification

Atif Mashkoor,Michael Leuschel,Alexander Egyed

DOI: https://doi.org/10.1109/icse-nier52604.2021.00009

2021-05-01

Abstract:Traditionally, practitioners use formal methods predominately for one half of the quality-assurance process: verification (do we build the software right?). The other half - validation (do we build the right software?) - has been given comparatively little attention. While verification is the core of refinement-based formal methods, where each new refinement step must preserve all properties of its abstract model, validation is usually postponed until the latest stages of the development, when models can be automatically executed. Thus mistakes in requirements or in their interpretation are caught too late: usually at the end of the development process. In this paper, we present a novel approach to check compliance between requirements and their formal refinement-based specification during the earlier stages of development. Our proposed approach - "validation obligations" - is based on the simple idea that both verification and validation are an integral part of all refinement steps of a system.
An Action-Based Fine-Grained Access Control Mechanism for Structured Documents and Its Application

Mang Su,Fenghua Li,Zhi Tang,Yinyan Yu,Bo Zhou

DOI: https://doi.org/10.1155/2014/232708

2014-01-01

Abstract:This paper presents an action-based fine-grained access control mechanism for structured documents. Firstly, we define a describing model for structured documents and analyze the application scenarios. The describing model could support the permission management on chapters, pages, sections, words, and pictures of structured documents. Secondly, based on the action-based access control (ABAC) model, we propose a fine-grained control protocol for structured documents by introducing temporal state and environmental state. The protocol covering different stages from document creation, to permission specification and usage control are given by using the Z-notation. Finally, we give the implementation of our mechanism and make the comparisons between the existing methods and our mechanism. The result shows that our mechanism could provide the better solution of fine-grained access control for structured documents in complicated networks. Moreover, it is more flexible and practical.
Methods used in nanostructure modeling

I. Camps

2023-03-02

Abstract:How many times you need to change your method description because you were "accused" of plagiarism from text you already published? I will use this preprint to add all the methods I currently used in running the simulations for my research works. Then, I will cite it as needed.

Materials Science
You Only Write Thrice: Creating Documents, Computational Notebooks and Presentations From a Single Source

Kacper Sokol,Peter Flach

DOI: https://doi.org/10.48550/arXiv.2107.06639

2021-07-02

Programming Languages

Abstract:Academic trade requires juggling multiple variants of the same content published in different formats: manuscripts, presentations, posters and computational notebooks. The need to track versions to accommodate for the write--review--rebut--revise life-cycle adds another layer of complexity. We propose to significantly reduce this burden by maintaining a single source document in a version-controlled environment (such as git), adding functionality to generate a collection of output formats popular in academia. To this end, we utilise various open-source tools from the Jupyter scientific computing ecosystem and operationalise selected software engineering concepts. We offer a proof-of-concept workflow that composes Jupyter Book (an online document), Jupyter Notebook (a computational narrative) and reveal.js slides from a single markdown source file. Hosted on GitHub, our approach supports change tracking and versioning, as well as a transparent review process based on the underlying code issue management infrastructure. An exhibit of our workflow can be previewed at https://so-cool.github.io/you-only-write-thrice/.
2Nd Eurographics Workshop on Sketch‐Based Interfaces and Modeling Trinity College Dublin, Ireland, August 28–29, 2005 Http://Www.eg.org/sbm/

Baoquan Chen

DOI: https://doi.org/10.1111/j.1467-8659.2006.00923.x

IF: 2.5

2006-01-01

Computer Graphics Forum

Abstract:Computer Graphics ForumVolume 25, Issue 1 p. 139-140 2nd Eurographics Workshop on Sketch-Based Interfaces and Modeling Trinity College Dublin, Ireland, August 28–29, 2005 http://www.eg.org/sbm/ Baoquan Chen, University of Minnesota at Twin Cities http://www.cs.umn.edu/~baoquanE-mail: baoquan@cs.umn.eduSearch for more papers by this author Baoquan Chen, University of Minnesota at Twin Cities http://www.cs.umn.edu/~baoquanE-mail: baoquan@cs.umn.eduSearch for more papers by this author First published: 15 March 2006 https://doi.org/10.1111/j.1467-8659.2006.00923.xRead the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinked InRedditWechat No abstract is available for this article. Volume25, Issue1March 2006Pages 139-140 RelatedInformation
Let's Stop Building at the Feet of Giants: Recovering unavailable Requirements Quality Artifacts

Julian Frattini,Lloyd Montgomery,Davide Fucci,Jannik Fischbach,Michael Unterkalmsteiner,Daniel Mendez

2023-04-10

Abstract:Requirements quality literature abounds with publications presenting artifacts, such as data sets and tools. However, recent systematic studies show that more than 80% of these artifacts have become unavailable or were never made public, limiting reproducibility and reusability. In this work, we report on an attempt to recover those artifacts. To that end, we requested corresponding authors of unavailable artifacts to recover and disclose them according to open science principles. Our results, based on 19 answers from 35 authors (54% response rate), include an assessment of the availability of requirements quality artifacts and a breakdown of authors' reasons for their continued unavailability. Overall, we improved the availability of seven data sets and seven implementations.

Software Engineering

Do it once, but do it right

[Re] Learning to Learn By Self-Critique

A choice, not an obligation

Deposited in DRO : 08 February 2018 Version of attached

Quality Assured: Rethinking Annotation Strategies in Imaging AI

Graphical Abstract: Angew. Chem. Int. Ed. 4/2021

Renewing a Craftsmanship of Attention With the World

Nanoarchitectonics beyond perfect order – not quite perfect but quite useful

ENCORE: a practical implementation to improve reproducibility and transparency of computational research

Reproducing, Extending, and Analyzing Naming Experiments

Curatio et Innovatio

Rerunning OCR: A Machine Learning Approach to Quality Assessment and Enhancement Prediction

Refactoring for Reuse: An Empirical Study

Building a Culture of Reproducibility in Academic Research

Graphical Abstract: Angew. Chem. Int. Ed. 51/2020

Validation Obligations: A Novel Approach to Check Compliance between Requirements and their Formal Specification

An Action-Based Fine-Grained Access Control Mechanism for Structured Documents and Its Application

Methods used in nanostructure modeling

You Only Write Thrice: Creating Documents, Computational Notebooks and Presentations From a Single Source

2Nd Eurographics Workshop on Sketch‐Based Interfaces and Modeling Trinity College Dublin, Ireland, August 28–29, 2005 Http://Www.eg.org/sbm/

Let's Stop Building at the Feet of Giants: Recovering unavailable Requirements Quality Artifacts