{"entity": "researcher", "timestamp": "2026-08-20T21:31:42.340Z", "family": "Arvidsson McShane", "given": "Staffan", "initials": "S", "orcid": "0000-0001-6709-7116", "affiliations": ["Department of Pharmaceutical Biosciences and Science for Life Laboratory, Uppsala University, 751 24 Uppsala, Sweden."], "links": {"self": {"href": "https://publications-affiliated.scilifelab.se/researcher/1529ee0acadb4f76bff770775ebd633b.json"}, "display": {"href": "https://publications-affiliated.scilifelab.se/researcher/1529ee0acadb4f76bff770775ebd633b"}}, "publications": [{"entity": "publication", "iuid": "8fa6d5080eed445db64b8858f99b66d8", "links": {"self": {"href": "https://publications-affiliated.scilifelab.se/publication/8fa6d5080eed445db64b8858f99b66d8.json"}, "display": {"href": "https://publications-affiliated.scilifelab.se/publication/8fa6d5080eed445db64b8858f99b66d8"}}, "title": "CPSign - Conformal Prediction for Cheminformatics Modeling", "authors": [{"family": "McShane", "given": "Staffan Arvidsson", "initials": "SA", "orcid": "0000-0001-6709-7116", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/1529ee0acadb4f76bff770775ebd633b.json"}}, {"family": "Norinder", "given": "Ulf", "initials": "U", "orcid": "0000-0003-3107-331X", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/da36a1cdadab4126b4e2527721ac2710.json"}}, {"family": "Alvarsson", "given": "Jonathan", "initials": "J", "orcid": "0000-0002-8682-7206", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/9415021fa24f47cf88a63d0cf805940c.json"}}, {"family": "Ahlberg", "given": "Ernst", "initials": "E", "orcid": "0000-0003-2050-9069", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/a1f7735d80084774801a46b57aad5228.json"}}, {"family": "Carlsson", "given": "Lars", "initials": "L"}, {"family": "Spjuth", "given": "Ola", "initials": "O", "orcid": "0000-0002-8083-2864", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/2c192389f99d4801b91f3350e07dfb9e.json"}}], "type": "posted-content", "published": "2023-11-22", "journal": {"issn-l": null}, "abstract": null, "doi": "10.1101/2023.11.21.568108", "pmid": null, "labels": [], "xrefs": [], "notes": [], "created": "2026-08-20T10:50:29.137Z", "modified": "2026-08-20T10:50:29.223Z"}, {"entity": "publication", "iuid": "1e40baf9dd7a42e3b56fbb2872e72705", "links": {"self": {"href": "https://publications-affiliated.scilifelab.se/publication/1e40baf9dd7a42e3b56fbb2872e72705.json"}, "display": {"href": "https://publications-affiliated.scilifelab.se/publication/1e40baf9dd7a42e3b56fbb2872e72705"}}, "title": "Machine Learning Strategies When Transitioning between Biological Assays.", "authors": [{"family": "Arvidsson McShane", "given": "Staffan", "initials": "S", "orcid": "0000-0001-6709-7116", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/1529ee0acadb4f76bff770775ebd633b.json"}}, {"family": "Ahlberg", "given": "Ernst", "initials": "E"}, {"family": "Noeske", "given": "Tobias", "initials": "T", "orcid": "0000-0002-0824-6342", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/d3177a8180f1425f86e6c086812d71b5.json"}}, {"family": "Spjuth", "given": "Ola", "initials": "O", "orcid": "0000-0002-8083-2864", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/2c192389f99d4801b91f3350e07dfb9e.json"}}], "type": "journal article", "published": "2021-07-26", "journal": {"title": "J Chem Inf Model", "issn": "1549-960X", "volume": "61", "issue": "7", "pages": "3722-3733", "issn-l": "1549-9596"}, "abstract": "Machine learning is widely used in drug development to predict activity in biological assays based on chemical structure. However, the process of transitioning from one experimental setup to another for the same biological endpoint has not been extensively studied. In a retrospective study, we here explore different modeling strategies of how to combine data from the old and new assays when training conformal prediction models using data from hERG and NaV assays. We suggest to continuously monitor the validity and efficiency of models as more data is accumulated from the new assay and select a modeling strategy based on these metrics. In order to maximize the utility of data from the old assay, we propose a strategy that augments the proper training set of an inductive conformal predictor by adding data from the old assay but only having data from the new assay in the calibration set, which results in valid (well-calibrated) models with improved efficiency compared to other strategies. We study the results for varying sizes of new and old assays, allowing for discussion of different practical scenarios. We also conclude that our proposed assay transition strategy is more beneficial, and the value of data from the new assay is higher, for the harder case of regression compared to classification problems.", "doi": "10.1021/acs.jcim.1c00293", "pmid": "34152755", "labels": [], "xrefs": [{"db": "pmc", "key": "PMC8317157"}], "notes": [], "created": "2026-08-20T08:10:22.086Z", "modified": "2026-08-20T08:10:22.231Z"}, {"entity": "publication", "iuid": "a1fc2da7a42345749830afe15318d35f", "links": {"self": {"href": "https://publications-affiliated.scilifelab.se/publication/a1fc2da7a42345749830afe15318d35f.json"}, "display": {"href": "https://publications-affiliated.scilifelab.se/publication/a1fc2da7a42345749830afe15318d35f"}}, "title": "Assessing the calibration in toxicological in vitro models with conformal prediction.", "authors": [{"family": "Morger", "given": "Andrea", "initials": "A"}, {"family": "Svensson", "given": "Fredrik", "initials": "F", "orcid": "0000-0002-5556-8133", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/10109223892d4924bbf4986bf71a7846.json"}}, {"family": "Arvidsson McShane", "given": "Staffan", "initials": "S", "orcid": "0000-0001-6709-7116", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/1529ee0acadb4f76bff770775ebd633b.json"}}, {"family": "Gauraha", "given": "Niharika", "initials": "N"}, {"family": "Norinder", "given": "Ulf", "initials": "U", "orcid": "0000-0003-3107-331X", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/da36a1cdadab4126b4e2527721ac2710.json"}}, {"family": "Spjuth", "given": "Ola", "initials": "O", "orcid": "0000-0002-8083-2864", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/2c192389f99d4801b91f3350e07dfb9e.json"}}, {"family": "Volkamer", "given": "Andrea", "initials": "A", "orcid": "0000-0002-3760-580X", "researcher": {"href": "https://publications-affiliated.scilifelab.se/researcher/bf1623a6e5b048589ac7968ee1b50a13.json"}}], "type": "journal article", "published": "2021-04-29", "journal": {"title": "J Cheminform", "issn": "1758-2946", "volume": "13", "issue": "1", "pages": "35", "issn-l": "1758-2946"}, "abstract": "Machine learning methods are widely used in drug discovery and toxicity prediction. While showing overall good performance in cross-validation studies, their predictive power (often) drops in cases where the query samples have drifted from the training data's descriptor space. Thus, the assumption for applying machine learning algorithms, that training and test data stem from the same distribution, might not always be fulfilled. In this work, conformal prediction is used to assess the calibration of the models. Deviations from the expected error may indicate that training and test data originate from different distributions. Exemplified on the Tox21 datasets, composed of chronologically released Tox21Train, Tox21Test and Tox21Score subsets, we observed that while internally valid models could be trained using cross-validation on Tox21Train, predictions on the external Tox21Score data resulted in higher error rates than expected. To improve the prediction on the external sets, a strategy exchanging the calibration set with more recent data, such as Tox21Test, has successfully been introduced. We conclude that conformal prediction can be used to diagnose data drifts and other issues related to model calibration. The proposed improvement strategy-exchanging the calibration data only-is convenient as it does not require retraining of the underlying model.", "doi": "10.1186/s13321-021-00511-5", "pmid": "33926567", "labels": [], "xrefs": [{"db": "pmc", "key": "PMC8082859"}, {"db": "pii", "key": "10.1186/s13321-021-00511-5"}], "notes": [], "created": "2026-08-20T12:22:16.174Z", "modified": "2026-08-20T12:23:44.448Z"}]}