Flamehaven LogoFlamehaven.space
back to case notes
bioaiPROTOTYPEPUBLICApache License 2.0

STEM-BIO-AI

Rubric-based trust evaluator for bio/medical AI repositories with dual-path evidence, governance overlay, and institutional audit outputs.

About This Work

A T4 score means strong observable evidence signals. It does not mean the repository is safe for clinical deployment — that requires independent expert validation.

ai-governancebio-aiclinical-aicomputational-biologyllm-evaluationmedical-airepository-auditresearch-governancerisk-governancesafety-evaluationtrust-evaluationopen-source-audit

Repository Overview

A T4 score means strong observable evidence signals. It does not mean the repository is safe for clinical deployment — that requires independent expert validation.

README Core

Bio and medical AI repositories vary enormously in evidence quality — from rigorous academic tools to marketing-grade demos that carry clinical language with no data provenance, no reproducibility path, and no clinical-use disclaimer. Manual review is slow and inconsistent.

STEM BIO-AI scans the observable repository surface — README, docs, code structure, CI configuration, dependency manifests, changelogs — and maps detected signals to a structured evidence tier (T0–T4). The scan runs in seconds on a local clone, produces machine-readable JSON and PDF reports, and makes every scoring decision traceable to a specific file, line, and pattern.

A T4 score means strong observable evidence signals. It does not mean the repository is safe for clinical deployment — that requires independent expert validation.

Use & Documentation

Detailed installation, commands, examples, and deeper usage notes live in the repository README and docs.

README Map

  • Why STEM BIO-AI
  • Quick Start
  • Triage Tiers
  • Scoring Model
  • Architecture
  • Output Artifacts

Key Signals

  • Provider output cannot override score.final score or score.formal tier
  • Every advisory item must cite exact finding id strings from allowed finding ids
  • Raw repository source text is not included in provider packets
  • Responses containing clinical safety, efficacy, regulatory, or medical-advice claims are rejected
  • allowed finding ids is capped at 40 entries per packet

Announcements

synced May 05, 2026

No mirrored announcements yet.