Standards, Practices, and Quality Assessment

Charter: To capture community needs and aggregate standards requirements and specifications, coordinate the implementation of standards, and enable sharing and reuse. The WG will facilitate transparent benchmarking, quality control, standards compliance, and efficient dissemination of data and supporting artifacts by promoting and enabling open source and collaborative development of best practices and norms in adopting standards.

The Bridge2AI Standards, Practices, and Quality Assessment working group aims to develop best practices for data collection, deposition, quality assurance, query, dissemination, and integration across Bridge2AI Grand Challenges. We will ensure that the standards used across these projects: are as generalizable as possible in other biomedical and behavioral applications; produce reproducible, credible outputs useful to the wider scientific community; and are updated in an efficient and well-provenanced manner. To achieve this, we will:

1. capture community needs and aggregate standards requirements and specifications, and
2. coordinate implementation of standards and enable sharing and reuse.

Our approach will enable transparent benchmarking, quality control, standards compliance, and efficient dissemination of data and supporting artifacts by promoting and enabling open source and collaborative development of best practices and norms in the adoption of standards.

Development, refinement, evaluation, and dissemination of Bridge2AI community-driven standards. Continuous community engagement is required to define standards requirements (1). We plan to catalog standards, use cases, and validation rules (2); provide web applications to enable users to explore schemas and elements (3); enable modality-agnostic, extensible standards specification (4); deploy a Dashboard to evaluate use of, and compliance with standards (5); and develop protocols & tools for data transformation (6). Our Concierge services facilitate the users’ understanding of how to leverage, design, or incorporate resources; these include open, regular interactions with the wider Bridge2AI community through office hours, help desk activities, issue tracking systems, among other activities.