DeMixNB: deconvolution of sparse-count RNA sequencing data for tumor cells using embedded negative binomial distributions

Montierth, M. D., Yan, H., Xie, L., Nemeth, K., Pan, X., Li, R., Ercan, C., Yang, P., Sinjab, A., Zhou, T., Peng, F., Singh, M., Wang, L., Kopetz, S., Kadara, H., Yuan, Y., Calin, G., Wang, W., “DeMixNB: deconvolution of sparse-count RNA sequencing data for tumor cells using embedded negative binomial distributions.” Genome Biology 2026. doi: 10.1186/s13059-026-04234-4

Published

August 2026

Doi
Other details

Received 21 November 2025; accepted 30 July 2026; published 10 August 2026.

Abstract

Estimating tumor-specific transcript proportions from mixed bulk samples has potential to inform novel biology. However, estimation accuracy using existing methods in sparse-count data such as microRNA-seq and spatial transcriptomics has yet to be established. We generated a mixed small RNA benchmark dataset to demonstrate analytical challenges. To resolve them, we developed DeMixNB, a semi-reference-based deconvolution model assuming a sum of negative binomial distributions. Applications to miRNA-seq from 856 patients with breast cancer and 3,755 spatial spots from lung cancer generated either clinical or mechanistic insights into tumor cell plasticity. This supports the important utility of DeMixNB to investigate cancer RNomes.

Citation

@article{Montierth2026DeMixNB,
    author = {Montierth, Matthew D and Yan, Hao and Xie, Liyang and Nemeth, Kinga and Pan, Xiaoxi and Li, Ruonan and Ercan, Caner and Yang, Peng and Sinjab, Ansam and Zhou, Tieling and Peng, Fuduan and Singh, Manisha and Wang, Linghua and Kopetz, Scott and Kadara, Humam and Yuan, Yinyin and Calin, George A. and Wang, Wenyi},
    title = {DeMixNB: deconvolution of sparse-count RNA sequencing data for tumor cells using embedded negative binomial distributions},
    journal = {Genome Biology},
    year = {2026},
    doi = {10.1186/s13059-026-04234-4},
    url = {https://doi.org/10.1186/s13059-026-04234-4}
}