Abstract:The Critical Assessment of Information Extraction systems in Biology (BioCreAtIvE) challenge evaluation tasks collectively represent a community-wide effort to evaluate a variety of text-mining and information extraction systems applied to the biological domain. The BioCreative IV Workshop included five independent subject areas, including Track 3, which focused on named-entity recognition (NER) for the Comparative Toxicogenomics Database (CTD; http://ctdbase.org). Previously, CTD had organized document ranking and NER-related tasks for the BioCreative Workshop 2012; a key finding of that effort was that interoperability and integration complexity were major impediments to the direct application of the systems to CTD's text-mining pipeline. This underscored a prevailing problem with software integration efforts. Major interoperability-related issues included lack of process modularity, operating system incompatibility, tool configuration complexity and lack of standardization of high-level inter-process communications. One approach to potentially mitigate interoperability and general integration issues is the use of Web services to abstract implementation details; rather than integrating NER tools directly, HTTP-based calls from CTD's asynchronous, batch-oriented text-mining pipeline could be made to remote NER Web services for recognition of specific biological terms using BioC (an emerging family of XML formats) for inter-process communications. To test this concept, participating groups developed Representational State Transfer /BioC-compliant Web services tailored to CTD's NER requirements. Participants were provided with a comprehensive set of training materials. CTD evaluated results obtained from the remote Web service-based URLs against a test data set of 510 manually curated scientific articles. Twelve groups participated in the challenge. Recall, precision, balanced F-scores and response times were calculated. Top balanced F-scores for gene, chemical and disease NER were 61, 74 and 51%, respectively. Response times ranged from fractions-of-a-second to over a minute per article. We present a description of the challenge and summary of results, demonstrating how curation groups can effectively use interoperable NER technologies to simplify text-mining pipeline implementation. Database URL: http://ctdbase.org/

Enhancing UCSF Chimera through web services

UCSF ChimeraX: Meeting modern challenges in visualization and analysis

UCSF ChimeraX: Structure visualization for researchers, educators, and developers

UCSF ChimeraX: Tools for Structure Building and Analysis

Applying Chimera Virtual Data Concepts to Cluster Finding in the Sloan Sky Survey

Cheminformatics Microservice: unifying access to open cheminformatics toolkits

Chimera: a Virtual Data System for Representing, Querying, and Automating Data Derivation

BioModels.net Web Services, a Free and Integrated Toolkit for Computational Modelling Software

Web Services for Bioinformatics

Web services-based text-mining demonstrates broad impacts for interoperability and process simplification

Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform

ChemCalc: a building block for tomorrow's chemical infrastructure

Moving beyond the desktop: prospects for practical bioimage analysis via the web

Harmonizing and integrating the NCI Genomic Data Commons through accessible, interactive, and cloud-enabled workflows

Open Chemistry: RESTful Web APIs, JSON, NWChem and the Modern Web Application

Developing CIMA based Remote Access for Collaborative e-Research

Facilitating integrative and personalized oncology omics analysis with UCSCXenaShiny

Camera Paths, Modeling, and Image Processing Tools for ArtiaX

Developing CIMA-based cyberinfrastructure for remote access to scientific instruments and collaborative e-research

Workflow and web application for annotating NCBI BioProject transcriptome data

Incorporating Semantics in Scientific Workflow Authoring