Clinical Copilot / Overview

Clinical Decision-Support Overview

Research & CDS Prototype
⚕️
Clinical Governance Notice: Clinical Copilot is an experimental multimodal clinical decision-support tool. Predictions, Grad-CAM saliency heatmaps, and guideline passages are provided for clinician consultation only and do not replace independent licensed physician diagnosis or emergency triage.
Module A: Imaging DenseNet121 7 Thoracic Pathologies + Grad-CAM
Module B: Risk Model 92.7% ROC-AUC Kaggle 918-Patient Cohort
Module C: Guidelines RAG 12 Chunks FAISS Vector Search + Citations
Unified Review Multimodal Strict Provenance Audit

Multimodal Capability Modules

🩻

Medical Imaging Studio

Upload Chest X-Ray (CXR) radiographs to detect cardiomegaly, pneumonia, consolidation, and effusions with visual Grad-CAM saliency overlays.

📊

Patient Risk Calculator

Calculate calibrated cardiovascular disease and heart failure risk trained on the 918-patient Kaggle clinical dataset with feature attribution waterfall.

📚

Clinical Guidelines RAG

Query authoritative AHA/ACC Chest Pain, Heart Failure, and ATS/IDSA Pneumonia guidelines with traceable page citations and uncertainty detection.

Preloaded Clinical Demonstration Cases

Select a real clinical test case to preload multimodal patient vitals, radiographs, and review workspace.

1. Radiograph Input

Drag & Drop Chest X-Ray or click to browse

Supports PNG, JPG, JPEG, WEBP (Max 15MB)

2. Radiograph & Grad-CAM Heatmap

Select a sample CXR or upload an image to begin.

Patient Clinical & Hemodynamic Profile

Features validated on Kaggle Heart Failure & CVD dataset (918 Patients).

Calibrated Risk Prediction

--% Awaiting Input

Evidence-Based Multi-Score Clinical Panel

Automated stratification across established cardiology, pulmonology, and critical care scoring guidelines.

Framingham 10-Yr ASCVD --%
--%
Awaiting Patient Profile

AHA/ACC 10-year atherosclerotic cardiovascular event risk.

CURB-65 Pneumonia Score -
- / 5
Low Risk (Outpatient)

Site-of-care stratification for lower respiratory infection.

Wells' PE Criteria Score -
- pts
PE Unlikely

Pre-test probability for Pulmonary Embolism (D-dimer vs CTPA).

CHA2DS2-VASc (AFib) Score -
- pts
Stroke Risk Tier

Thromboembolic risk and DOAC anticoagulation indication.

Interactive "What-If" Counterfactual Risk Simulator

Simulate personalized clinical interventions (lifestyle, pharmacotherapy, rehab) to observe projected risk reduction.

Causal & Counterfactual AI
120 mmHg
180 mg/dL
155 bpm
Baseline ML Risk
--%
→
Projected Target Risk
--%
ARR: --%
RRR: --%
NNT: --

Adjust sliders to model intervention outcomes.

Clinical Guidelines Query Console

Retrieve evidence grounded in AHA/ACC Chest Pain, AHA/ACC Heart Failure, and ATS/IDSA CAP guidelines.

Quick Queries:

Pharmacotherapy Safety & Contraindication Guardrail

Automated cross-referencing of active patient hemodynamics & comorbidities against guideline black-box warnings.

Active Monitoring

Select or submit a patient case to perform automated pharmacological safety screening.

Case Summary: PT-1001

Generated: Oct 21, 2026

PARTIAL

Multimodal Differential Diagnosis (DDx) & Workup

Cross-modality diagnostic synthesis combining CXR findings, calibrated CVD risk, and ECG hemodynamics.

AI Clinical Synthesis
Primary Working Diagnosis

Awaiting Multimodal Inputs...

ICD-10 -- --% Probability

Complete Module A (Imaging) and Module B (Risk) to synthesize differential diagnosis.

Secondary & Rival Diagnoses

Run image analysis and risk calculation to view rival diagnoses.

Ruled-Out Conditions & Negative Rationale

Explicit negative rules will populate here.

Multimodal Provenance Audit Table

Every finding is strictly attributed to its source module. Outputs from one modality do not automatically substantiate another.

Source Module Clinical Observation Reported Value Metric / Confidence Governance Boundary

Clinical Synthesis Notes

    Documented Uncertainties & Limitations

      🩻 Vision Model Card (DenseNet121-CXR)

      • Architecture: DenseNet-121 with feature concatenation
      • Modality: Frontal Chest Radiographs (PA / AP)
      • Resolution: 224 x 224 pixels, ImageNet normalized
      • Pathologies: Normal, Cardiomegaly, Pneumonia, Pleural Effusion, Consolidation, Atelectasis, Infiltration
      • Visual Localization: Real Grad-CAM on denseblock4 conv2 layer
      • Limitation: Experimental screening only; requires radiologist verification.

      📊 Risk Model Card (Calibrated Gradient Boosting)

      • Model: GradientBoostingClassifier + CalibratedClassifierCV
      • Dataset: Kaggle 918-Patient Heart Failure Dataset (fedesoriano)
      • Validation ROC-AUC: 0.9274
      • Validation Accuracy: 88.04%
      • Brier Calibration Loss: 0.0968
      • Centers: Cleveland Clinic, Hungarian Inst., Univ. Zurich, Long Beach VA, St. Carlos
      • Limitation: Observational cohort; correlational importances do not imply causation.

      📚 Clinical Guidelines Inventory

      • 2021 AHA/ACC Chest Pain Guideline: hs-cTn protocols, HEART score triage, CXR indications
      • 2022 AHA/ACC Heart Failure Guideline: 4-Pillar GDMT, LVEF staging, diagnostic workup
      • 2019 ATS/IDSA Pneumonia Guideline: CURB-65 triage, CXR signs, outpatient/inpatient therapy
      • Vector Database: FAISS Inner Product index with Sentence-Transformers embeddings
      • Traceability: Explicit section and page citations on every claim