Multimodal Capability Modules
Medical Imaging Studio
Upload Chest X-Ray (CXR) radiographs to detect cardiomegaly, pneumonia, consolidation, and effusions with visual Grad-CAM saliency overlays.
Patient Risk Calculator
Calculate calibrated cardiovascular disease and heart failure risk trained on the 918-patient Kaggle clinical dataset with feature attribution waterfall.
Clinical Guidelines RAG
Query authoritative AHA/ACC Chest Pain, Heart Failure, and ATS/IDSA Pneumonia guidelines with traceable page citations and uncertainty detection.
Preloaded Clinical Demonstration Cases
Select a real clinical test case to preload multimodal patient vitals, radiographs, and review workspace.
1. Radiograph Input
Drag & Drop Chest X-Ray or click to browse
Supports PNG, JPG, JPEG, WEBP (Max 15MB)2. Radiograph & Grad-CAM Heatmap
Select a sample CXR or upload an image to begin.
Patient Clinical & Hemodynamic Profile
Features validated on Kaggle Heart Failure & CVD dataset (918 Patients).
Calibrated Risk Prediction
Evidence-Based Multi-Score Clinical Panel
Automated stratification across established cardiology, pulmonology, and critical care scoring guidelines.
AHA/ACC 10-year atherosclerotic cardiovascular event risk.
Site-of-care stratification for lower respiratory infection.
Pre-test probability for Pulmonary Embolism (D-dimer vs CTPA).
Thromboembolic risk and DOAC anticoagulation indication.
Interactive "What-If" Counterfactual Risk Simulator
Simulate personalized clinical interventions (lifestyle, pharmacotherapy, rehab) to observe projected risk reduction.
Adjust sliders to model intervention outcomes.
Clinical Guidelines Query Console
Retrieve evidence grounded in AHA/ACC Chest Pain, AHA/ACC Heart Failure, and ATS/IDSA CAP guidelines.
Pharmacotherapy Safety & Contraindication Guardrail
Automated cross-referencing of active patient hemodynamics & comorbidities against guideline black-box warnings.
Select or submit a patient case to perform automated pharmacological safety screening.
Case Summary: PT-1001
Generated: Oct 21, 2026
Multimodal Differential Diagnosis (DDx) & Workup
Cross-modality diagnostic synthesis combining CXR findings, calibrated CVD risk, and ECG hemodynamics.
Secondary & Rival Diagnoses
Run image analysis and risk calculation to view rival diagnoses.
Ruled-Out Conditions & Negative Rationale
Explicit negative rules will populate here.
Multimodal Provenance Audit Table
Every finding is strictly attributed to its source module. Outputs from one modality do not automatically substantiate another.
| Source Module | Clinical Observation | Reported Value | Metric / Confidence | Governance Boundary |
|---|
Clinical Synthesis Notes
Documented Uncertainties & Limitations
🩻 Vision Model Card (DenseNet121-CXR)
- Architecture: DenseNet-121 with feature concatenation
- Modality: Frontal Chest Radiographs (PA / AP)
- Resolution: 224 x 224 pixels, ImageNet normalized
- Pathologies: Normal, Cardiomegaly, Pneumonia, Pleural Effusion, Consolidation, Atelectasis, Infiltration
- Visual Localization: Real Grad-CAM on denseblock4 conv2 layer
- Limitation: Experimental screening only; requires radiologist verification.
📊 Risk Model Card (Calibrated Gradient Boosting)
- Model: GradientBoostingClassifier + CalibratedClassifierCV
- Dataset: Kaggle 918-Patient Heart Failure Dataset (fedesoriano)
- Validation ROC-AUC: 0.9274
- Validation Accuracy: 88.04%
- Brier Calibration Loss: 0.0968
- Centers: Cleveland Clinic, Hungarian Inst., Univ. Zurich, Long Beach VA, St. Carlos
- Limitation: Observational cohort; correlational importances do not imply causation.
📚 Clinical Guidelines Inventory
- 2021 AHA/ACC Chest Pain Guideline: hs-cTn protocols, HEART score triage, CXR indications
- 2022 AHA/ACC Heart Failure Guideline: 4-Pillar GDMT, LVEF staging, diagnostic workup
- 2019 ATS/IDSA Pneumonia Guideline: CURB-65 triage, CXR signs, outpatient/inpatient therapy
- Vector Database: FAISS Inner Product index with Sentence-Transformers embeddings
- Traceability: Explicit section and page citations on every claim