← All projects
APPLIED DEEP LEARNING / 2022–2026

MEDVSE: Vital Signs Estimation

Efficient deep learning-based estimation of vital signs on smartphones using fingertip videos.

View source ↗Related research ↗
THE WORK

Collaborative research · MTHS dataset · Mobile inference

Deep learningComputer visionMobile
AT A GLANCE

Useful signals, within mobile constraints.

The challenge
Estimate vital signs from fingertip recordings with compact models and a workflow suitable for mobile inference.
The work
Collaborative research, the MTHS dataset, public research code, and a later 2026 journal article.
FROM RECORDING TO ESTIMATE
  1. Fingertip videoSmartphone camera
  2. RGB signalsExtract + preprocess
  3. Compact modelLearn from reference data
  4. Vital signsEvaluate estimates
Conceptual research pipeline. The publications specify datasets, tasks, and evaluation conditions.
On this page5 sections

MEDVSE began as collaborative research into estimating heart rate and blood oxygen saturation from smartphone fingertip video. The 2022 preprint is connected to our later journal article, Parameter-Efficient Deep Learning Models for Vital Sign Estimation From PPG, published in Healthcare Technology Letters in 2026.

From video to a vital signal

The pipeline extracts RGB signals from fingertip recordings, preprocesses the signal, and applies compact neural models to estimate vital signs. Reference measurements provide targets for training and evaluation.

The research asks a practical question: how much model capacity is needed to recover useful information from these signals when memory and compute are limited?

Designing for mobile constraints

The 2026 paper explores parameter-efficient models for heart rate, blood oxygen saturation and respiratory rate estimation. It compares compact fully convolutional and DCT-based architectures and demonstrates on-device deployment using TensorFlow Lite. See the paper for the evaluation settings and results for each task.

The MTHS dataset

The project includes the MTHS dataset of fingertip video recordings and reference vital-sign measurements. The original MEDVSE repository provides the earlier project’s code and dataset information; the journal article describes the later research.

Collaboration and publication history

This work was carried out with Mahdi Farvardin and Aboozar Ghaffari. Both the earlier preprint and the 2026 journal record are linked on the research page.

A CLOSER LOOK / PPG-DALIA

Small models.
Different tradeoffs.

Four architectures from the paper, compared on heart-rate estimation. Parameter count is one part of the decision; error and its variation matter too.

PPG-DaLiA · Heart-rate estimation
ModelParametersMAE ± SD (bpm)
DCT 3,266 7.25 ± 2.84
FCN 8,037 6.49 ± 2.82
Base 29,665 7.79 ± 3.36
Residual FCN 53,713 6.07 ± 2.70
Session-wise results; mean ± standard deviation as reported in Table 5. DCT denotes the variant without inversion. MAE is mean absolute error; SD is standard deviation. Lower MAE is better. Source: Tables 2 and 5 ↗
NEXT PROJECTWeavelet↗