Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
Link to record
Permanent link

Direct link
Publications (10 of 16) Show all publications
Ryeznik, Y., Hilgers, R.-D., Heussen, N., Comets, E., Mentre, F., Hendrickx, N., . . . Sverdlov, O. (2025). A Pharmacometrics-Informed Trial Simulation Framework for Optimizing Study Designs for Disease-Modifying Treatments in Rare Neurological Disorders. CPT: Pharmacometrics and Systems Pharmacology (PSP), 14(10), 1705-1714
Open this publication in new window or tab >>A Pharmacometrics-Informed Trial Simulation Framework for Optimizing Study Designs for Disease-Modifying Treatments in Rare Neurological Disorders
Show others...
2025 (English)In: CPT: Pharmacometrics and Systems Pharmacology (PSP), E-ISSN 2163-8306, Vol. 14, no 10, p. 1705-1714Article in journal (Refereed) Published
Abstract [en]

The development of new treatments for rare neurological diseases (RNDs) may be very challenging due to limited natural history data, lack of relevant biomarkers and clinical endpoints, small and heterogeneous patient populations, and other complexities. A systematic approach is needed for comparing various design and analysis strategies to identify "optimal" approaches for a clinical trial in a chosen RND with the given resource constraints. For this purpose, we propose a pharmacometrics-informed clinical scenario evaluation framework (CSE-PMx), which includes some important research hallmarks relevant to RND clinical trials: a disease progression model for simulating individual longitudinal outcomes, the choice of a suitable randomization method for trial design, and an option to perform subsequent statistical analysis with randomization tests. We illustrate the utility of CSE-PMx for an exemplary randomized trial to compare the disease-modifying effect of an experimental treatment versus control in patients with Autosomal-Recessive Spastic Ataxia Charlevoix Saguenay (ARSACS). In the considered example, our simulation evidence suggests that a nonlinear mixed-effects model (NLMEM) with a population-based likelihood ratio test analysis is valid, robust, and more powerful than some conventional methods such as two-sample t-test, analysis of covariance (ANCOVA), or a mixed model with repeated measurements (MMRM). Our proposed framework is very flexible and generalizable to clinical research in other rare disease indications.

Place, publisher, year, edition, pages
John Wiley & Sons, 2025
Keywords
clinical design optimization, model-informed drug development, nonlinear mixed effects model, pharmacometrics, simulation
National Category
Pharmaceutical Sciences
Identifiers
urn:nbn:se:uu:diva-578083 (URN)10.1002/psp4.70082 (DOI)001543953300001 ()40763305 (PubMedID)2-s2.0-105012613092 (Scopus ID)
Funder
EU, Horizon 2020, 825575
Available from: 2026-01-30 Created: 2026-01-30 Last updated: 2026-01-30Bibliographically approved
Wong, W. K., Ryeznik, Y., Sverdlov, O., Chen, P.-Y., Fang, X., Chen, R.-B., . . . Lee, J. J. (2025). Nature-inspired metaheuristics for optimizing dose-finding and computationally challenging clinical trial designs. Clinical Trials, 22(4), 422-429
Open this publication in new window or tab >>Nature-inspired metaheuristics for optimizing dose-finding and computationally challenging clinical trial designs
Show others...
2025 (English)In: Clinical Trials, ISSN 1740-7745, E-ISSN 1740-7753, Vol. 22, no 4, p. 422-429Article in journal (Refereed) Published
Abstract [en]

Metaheuristics are commonly used in computer science and engineering to solve optimization problems, but their potential applications in clinical trial design have remained largely unexplored. This article provides a brief overview of metaheuristics and reviews their limited use in clinical trial settings. We focus on nature-inspired metaheuristics and apply one of its exemplary algorithms, the particle swarm optimization (PSO) algorithm, to find phase I/II designs that jointly consider toxicity and efficacy. As a specific application, we demonstrate the utility of PSO in designing optimal dose-finding studies to estimate the optimal biological dose (OBD) for a continuation-ratio model with four parameters under multiple constraints. Our design improves existing designs by protecting patients from receiving doses higher than the unknown maximum tolerated dose and ensuring that the OBD is estimated with high accuracy. In addition, we show the effectiveness of metaheuristics in addressing more computationally challenging design problems by extending Simon's phase II designs to more than two stages and finding more flexible Bayesian optimal phase II designs with enhanced power.

Place, publisher, year, edition, pages
Sage Publications, 2025
Keywords
Continuation-ratio model, dose-finding trial, optimal biological dose, particle swarm optimization, phase I/II trial
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:uu:diva-569079 (URN)10.1177/17407745251346396 (DOI)001526668800001 ()40650489 (PubMedID)2-s2.0-105012940615 (Scopus ID)
Available from: 2025-10-09 Created: 2025-10-09 Last updated: 2025-10-09Bibliographically approved
Kuznetsova, O., Ross, J., Bodden, D., Cooner, F., Chipman, J., Jacko, P., . . . Sverdlov, O. (2025). Randomization in the age of platform trials: unexplored challenges and some potential solutions. BMC Medical Research Methodology, 25(1), Article ID 268.
Open this publication in new window or tab >>Randomization in the age of platform trials: unexplored challenges and some potential solutions
Show others...
2025 (English)In: BMC Medical Research Methodology, E-ISSN 1471-2288, Vol. 25, no 1, article id 268Article, review/survey (Refereed) Published
Abstract [en]

While platform trials have several benefits with their adaptive features, randomization challenges become of central relevance to the design and execution of a platform trial. This paper intends to address these challenges and explore some potential solutions. A platform type of clinical trial is a clinical trial design where multiple interventions are investigated simultaneously often against partly or fully shared controls, with new treatment arms added and completed treatment arms removed. Unequal allocation is often used in platform trials to improve statistical efficiency, deliver benefits to trial participants, and control the speed of enrollment in different treatment arms. Changes to the allocation ratio may be required after an interim analysis even when the number of treatment arms remains constant, for example, in a platform trial with response-adaptive randomization. To deliver the design efficiencies promised by the carefully optimized allocation ratio or simply to ensure a pre-determined allocation ratio, randomization methods that keep allocation proportions close to the target allocation ratio throughout randomization are helpful. Other situations commonly occurring in platform trials require special considerations for randomization methods and in some cases new classes of randomization methods. Such specific platform features include the requirement to accommodate differences in eligibility for different treatments, the need to ensure partial blinding with a 2-step randomization when mode of administration for different interventions is conspicuously different and full blinding is unfeasible, the objective to balance through dynamic randomization multiple prognostic factors or the need to accommodate limited drug supplies at the numerous trial centers, among others. The key to a successful execution of a complex randomization in the platform trial is the expert design of the Interactive Response Technology (IRT) system, where the system is built at the master protocol level and existing and potential randomization needs are incorporated from the outset. An additional, often overlooked, challenge when working with unequal allocation ratios and randomization methods to attain these, is the importance of preserving the unconditional allocation ratio at every allocation. Failure to do so might lead to a selection and evaluation bias even in double-blind trials, accidental bias, and reduced power of the re-randomization test.

Place, publisher, year, edition, pages
BioMed Central (BMC), 2025
Keywords
Adaptive design, Platform trial, Randomization, Unequal allocation
National Category
Probability Theory and Statistics Cardiology and Cardiovascular Disease
Identifiers
urn:nbn:se:uu:diva-576543 (URN)10.1186/s12874-025-02693-0 (DOI)001648929600001 ()41275089 (PubMedID)2-s2.0-105023517095 (Scopus ID)
Note

Correction in: BMC Medical Research Methodology, vol. 26, article number 25 (2026)

DOI: 10.1186/s12874-026-02788-2

Available from: 2026-01-16 Created: 2026-01-16 Last updated: 2026-03-10Bibliographically approved
Carter, K., Kuznetsova, O., Anisimov, V., Krisam, J., Scherer, C., Ryeznik, Y. & Sverdlov, O. (2024). Forced randomization: the what, why, and how. BMC Medical Research Methodology, 24(1), Article ID 234.
Open this publication in new window or tab >>Forced randomization: the what, why, and how
Show others...
2024 (English)In: BMC Medical Research Methodology, E-ISSN 1471-2288, Vol. 24, no 1, article id 234Article in journal (Refereed) Published
Abstract [en]

Background When running a randomized controlled trial (RCT), a clinical site may face a situation when an eligible trial participant is to be randomized to the treatment that is not available at the site. In this case, there are two options: not to enroll the participant, or, without disclosing to the site, allocate the participant to a treatment arm with drug available at the site using a built-in feature of the interactive response technology (IRT). In the latter case, one has employed a "forced randomization" (FR). There seems to be an industry-wide consensus that using FR can be acceptable in confirmatory trials provided there are "not too many" instances of forcing. A better understanding of statistical properties of FR is warranted.

Methods We described four different IRT configurations with or without FR and illustrated them using a simple example. We discussed potential merits of FR and outlined some relevant theoretical risks and risk mitigation strategies. We performed a search using Cortellis Regulatory Intelligence database (IDRAC) (www.cortellis.com) to understand the prevalence of FR in clinical trial practice. We also proposed a structured template for development and evaluation of randomization designs featuring FR and showcased an application of this template for a hypothetical multi-center 1:1 RCT under three experimental settings ("base case", "slower recruitment", and "faster recruitment") to explore the effect of four different IRT configurations in combination with three different drug supply/re-supply strategies on some important operating characteristics of the trial. We also supplied the Julia code that can be used to reproduce our simulation results and generate additional results under user-specified experimental scenarios.ResultsFR can eliminate refusals to randomize patients, which can cause frustration for patients and study site personnel, improve the study logistics, drug supply management, cost-efficiency, and recruitment time. Nevertheless, FR carries some potential risks that should be reviewed at the study planning stage and, ideally, prospectively addressed through risk mitigation planning. The Cortellis search identified only 9 submissions that have reported the use of FR; typically, the FR option was documented in IRT specifications. Our simulation evidence showed that under the considered realistic experimental settings, the percentage of FR is expected to be low. When FR with backfilling was used in combination with high re-supply strategy, the final treatment imbalance was negligibly small, the proportion of patients not randomized due to the lack of drug supply was close to zero, and the time to complete recruitment was shortened compared to the case when FR was not allowed. The drug overage was primarily determined by the intensity of the re-supply strategy and to a smaller extent by the presence or absence of the FR feature in IRT.

Conclusion FR with a carefully chosen drug supply/re-supply strategy can result in quantifiable improvements in the patients' and site personnel experience, trial logistics and efficiency while preventing an undesirable refusal to randomize a patient and a consequential unblinding at the site. FR is a useful design feature of multi-center RCTs provided it is properly planned for and carefully implemented.

Place, publisher, year, edition, pages
BioMed Central (BMC), 2024
Keywords
Drug supply chain management, Interactive response technology (IRT), Multi-center clinical trial, Poisson-gamma model
National Category
Clinical Medicine
Identifiers
urn:nbn:se:uu:diva-540672 (URN)10.1186/s12874-024-02340-0 (DOI)001328490900001 ()39379810 (PubMedID)2-s2.0-85205981270 (Scopus ID)
Note

Correction in: BMC Medical Research Methodology volume 24, Article number: 286 (2024)

DOI: 10.1186/s12874-024-02407-y

Available from: 2024-10-30 Created: 2024-10-30 Last updated: 2024-12-06Bibliographically approved
Ryeznik, Y. & Sverdlov, O. (2024). Pharmacometrics and machine learning in drug development. In: Artificial Intelligence for Drug Product Lifecycle Applications: (pp. 99-108). Elsevier
Open this publication in new window or tab >>Pharmacometrics and machine learning in drug development
2024 (English)In: Artificial Intelligence for Drug Product Lifecycle Applications, Elsevier, 2024, p. 99-108Chapter in book (Other academic)
Abstract [en]

Modern drug development is increasingly complex and requires strategic application of novel quantitative disciplines such as pharmacometrics (PMx) and machine learning (ML). This chapter provides a high-level overview of applications of PMx, ML, and their combination throughout the stages of the biopharmaceutical product development—from drug discovery to regulatory submission. It also gives an overview of available software packages and tools for implementing PMx and ML, including both open source and commercial solutions. We argue that combining the PMx and ML approaches can help obtain efficient and fit-for-purpose tools for solving complex drug development problems.

Place, publisher, year, edition, pages
Elsevier, 2024
Keywords
Computer-intensive statistical methods, Digital twins, Machine learning, Model-informed drug development, Nonlinear mixed-effects models, Pharmacometrics
National Category
Pharmaceutical Sciences Pharmacology and Toxicology
Identifiers
urn:nbn:se:uu:diva-555579 (URN)10.1016/B978-0-323-91819-0.00004-X (DOI)2-s2.0-85214943538 (Scopus ID)9780323918190 (ISBN)9780323972512 (ISBN)
Available from: 2025-04-29 Created: 2025-04-29 Last updated: 2025-04-29Bibliographically approved
Sverdlov, O., Ryeznik, Y., Anisimov, V., Kuznetsova, O. M., Knight, R., Carter, K., . . . Zhao, W. (2024). Selecting a randomization method for a multi-center clinical trial with stochastic recruitment considerations. BMC Medical Research Methodology, 24, Article ID 52.
Open this publication in new window or tab >>Selecting a randomization method for a multi-center clinical trial with stochastic recruitment considerations
Show others...
2024 (English)In: BMC Medical Research Methodology, E-ISSN 1471-2288, Vol. 24, article id 52Article in journal (Refereed) Published
Abstract [en]

Background: The design of a multi-center randomized controlled trial (RCT) involves multiple considerations, such as the choice of the sample size, the number of centers and their geographic location, the strategy for recruitment of study participants, amongst others. There are plenty of methods to sequentially randomize patients in a multi-center RCT, with or without considering stratification factors. The goal of this paper is to perform a systematic assessment of such randomization methods for a multi-center 1:1 RCT assuming a competitive policy for the patient recruitment process.

Methods: We considered a Poisson-gamma model for the patient recruitment process with a uniform distribution of center activation times. We investigated 16 randomization methods (4 unstratified, 4 region-stratified, 4 center-stratified, 3 dynamic balancing randomization (DBR), and a complete randomization design) to sequentially randomize n=500 patients. Statistical properties of the recruitment process and the randomization procedures were assessed using Monte Carlo simulations. The operating characteristics included time to complete recruitment, number of centers that recruited a given number of patients, several measures of treatment imbalance and estimation efficiency under a linear model for the response, the expected proportions of correct guesses under two different guessing strategies, and the expected proportion of deterministic assignments in the allocation sequence.

Results: Maximum tolerated imbalance (MTI) randomization methods such as big stick design, Ehrenfest urn design, and block urn design result in a better balance-randomness tradeoff than the conventional permuted block design (PBD) with or without stratification. Unstratified randomization, region-stratified randomization, and center-stratified randomization provide control of imbalance at a chosen level (trial, region, or center) but may fail to achieve balance at the other two levels. By contrast, DBR does a very good job controlling imbalance at all 3 levels while maintaining the randomized nature of treatment allocation. Adding more centers into the study helps accelerate the recruitment process but at the expense of increasing the number of centers that recruit very few (or no) patients-which may increase center-level imbalances for center-stratified and DBR procedures. Increasing the block size or the MTI threshold(s) may help obtain designs with improved randomness-balance tradeoff.

Conclusions: The choice of a randomization method is an important component of planning a multi-center RCT. Dynamic balancing randomization with carefully chosen MTI thresholds could be a very good strategy for trials with the competitive policy for patient recruitment.

Place, publisher, year, edition, pages
BioMed Central (BMC), 2024
Keywords
Multi-center clinical trial, Maximum tolerated imbalance, Allocation randomness, Poisson-gamma model, Recruitment time
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:uu:diva-525900 (URN)10.1186/s12874-023-02131-z (DOI)001176269400002 ()38418968 (PubMedID)
Note

Oleksandr Sverdlov and Yevgen Ryeznik contributed equally to this work

Available from: 2024-04-05 Created: 2024-04-05 Last updated: 2024-04-05Bibliographically approved
Krisam, J., Ryeznik, Y., Carter, K., Kuznetsova, O. & Sverdlov, O. (2024). Understanding an impact of patient enrollment pattern on predictability of central (unstratified) randomization in a multi-center clinical trial. Statistics in Medicine, 43(17), 3313-3325
Open this publication in new window or tab >>Understanding an impact of patient enrollment pattern on predictability of central (unstratified) randomization in a multi-center clinical trial
Show others...
2024 (English)In: Statistics in Medicine, ISSN 0277-6715, E-ISSN 1097-0258, Vol. 43, no 17, p. 3313-3325Article in journal (Refereed) Published
Abstract [en]

In a multi-center randomized controlled trial (RCT) with competitive recruitment, eligible patients are enrolled sequentially by different study centers and are randomized to treatment groups using the chosen randomization method. Given the stochastic nature of the recruitment process, some centers may enroll more patients than others, and in some instances, a center may enroll multiple patients in a row, for example, on a given day. If the study is open-label, the investigators might be able to make intelligent guesses on upcoming treatment assignments in the randomization sequence, even if the trial is centrally randomized and not stratified by center. In this paper, we use enrollment data inspired by a real multi-center RCT to quantify the susceptibility of two restricted randomization procedures, the permuted block design and the big stick design, to selection bias under the convergence strategy of Blackwell and Hodges (1957) applied at the center level. We provide simulation evidence that the expected proportion of correct guesses may be greater than 50% (i.e., an increased risk of selection bias) and depends on the chosen randomization method and the number of study patients recruited by a given center that takes consecutive positions on the central allocation schedule. We propose some strategies for ensuring stronger encryption of the randomization sequence to mitigate the risk of selection bias.

Place, publisher, year, edition, pages
John Wiley & Sons, 2024
Keywords
big stick design, multi-center clinical trial, permuted block randomization, selection bias
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:uu:diva-542417 (URN)10.1002/sim.10117 (DOI)001237514400001 ()38831520 (PubMedID)2-s2.0-85195215982 (Scopus ID)
Available from: 2024-11-12 Created: 2024-11-12 Last updated: 2026-06-09Bibliographically approved
Sverdlov, O., Ryeznik, Y. & Wong, W. K. (2021). Opportunity for efficiency in clinical development: An overview of adaptive clinical trial designs and innovative machine learning tools, with examples from the cardiovascular field. Contemporary Clinical Trials, 105, Article ID 106397.
Open this publication in new window or tab >>Opportunity for efficiency in clinical development: An overview of adaptive clinical trial designs and innovative machine learning tools, with examples from the cardiovascular field
2021 (English)In: Contemporary Clinical Trials, ISSN 1551-7144, E-ISSN 1559-2030, Vol. 105, article id 106397Article, review/survey (Refereed) Published
Abstract [en]

Modern data analysis tools and statistical modeling techniques are increasingly used in clinical research to improve diagnosis, estimate disease progression and predict treatment outcomes. What seems less emphasized is the importance of the study design, which can have a serious impact on the study cost, time and statistical efficiency. This paper provides an overview of different types of adaptive designs in clinical trials and their applications to cardiovascular trials. We highlight recent proliferation of work on adaptive designs over the past two decades, including some recent regulatory guidelines on complex trial designs and master protocols. We also describe the increasing role of machine learning and use of metaheuristics to construct increasingly complex adaptive designs or to identify interesting features for improved predictions and classifications.

Place, publisher, year, edition, pages
ElsevierElsevier BV, 2021
Keywords
Adaptive designs, Cardiovascular trials, Machine learning, Master protocols, Nature-inspired metaheuristics, Rare diseases, Seamless designs
National Category
Cardiology and Cardiovascular Disease Clinical Laboratory Medicine
Identifiers
urn:nbn:se:uu:diva-447640 (URN)10.1016/j.cct.2021.106397 (DOI)000656784700027 ()33845209 (PubMedID)
Available from: 2021-06-29 Created: 2021-06-29 Last updated: 2025-02-10Bibliographically approved
Sverdlov, O., Ryeznik, Y. & Wong, W. K. (2020). On Optimal Designs for Clinical Trials: An Updated Review. Journal of Statistical Theory and Practice, 14(1), Article ID 10.
Open this publication in new window or tab >>On Optimal Designs for Clinical Trials: An Updated Review
2020 (English)In: Journal of Statistical Theory and Practice, ISSN 1559-8608, E-ISSN 1559-8616, Vol. 14, no 1, article id 10Article, review/survey (Refereed) Published
Abstract [en]

Optimization of clinical trial designs can help investigators achieve higher quality results for the given resource constraints. The present paper gives an overview of optimal designs for various important problems that arise in different stages of clinical drug development, including phase I dose-toxicity studies; phase I/II studies that consider early efficacy and toxicity outcomes simultaneously; phase II dose-response studies driven by multiple comparisons (MCP), modeling techniques (Mod), or their combination (MCP-Mod); phase III randomized controlled multi-arm multi-objective clinical trials to test difference among several treatment groups; and population pharmacokinetics-pharmacodynamics experiments. We find that modern literature is very rich with optimal design methodologies that can be utilized by clinical researchers to improve efficiency of drug development.

Place, publisher, year, edition, pages
Springer Nature, 2020
Keywords
Estimation efficiency, Dose-finding, Multiple comparisons and modeling, Optimal response-adaptive randomization, Phase I, II studies, Population PK, PD studies, Power
National Category
Pharmaceutical Sciences
Identifiers
urn:nbn:se:uu:diva-407110 (URN)10.1007/s42519-019-0073-4 (DOI)000511595400001 ()
Available from: 2020-03-19 Created: 2020-03-19 Last updated: 2023-09-04Bibliographically approved
Sverdlov, O. & Ryeznik, Y. (2019). Implementing Unequal Randomization in Clinical Trials with Heterogeneous Treatment Costs. Statistics in Medicine, 38(16), 2905-2927
Open this publication in new window or tab >>Implementing Unequal Randomization in Clinical Trials with Heterogeneous Treatment Costs
2019 (English)In: Statistics in Medicine, ISSN 0277-6715, E-ISSN 1097-0258, Vol. 38, no 16, p. 2905-2927Article in journal (Refereed) Published
Abstract [en]

Equal randomization has been a popular choice in clinical trial practice. However, in trials with heterogeneous variances and/or variable treatment costs, as well as in the settings where maximization of every trial participant’s benefit is an important design consideration, optimal allocation proportions may be unequal across study treatment arms. In this paper, we investigate optimal allocation designs minimizing study cost under statistical efficiency constraints for parallel group clinical trials comparing several investigational treatments against the control. We show theoretically that equal allocation designs may be suboptimal, and unequal allocation designs can provide higher statistical power for the same budget, or result in a smaller cost for the same level of power. We also show how the optimal allocation can be implemented in practice by means of restricted randomization procedures, and how to perform statistical inference following these procedures, using invoked population-based or randomization-based approaches. Our results provide further support to some previous findings in the literature that unequal randomization designs can be cost-efficient and can be successfully implemented in practice. We conclude that the choice of the target allocation, the randomization procedure and the statistical methodology for data analysis are essential components to ensure valid, powerful, and robust clinical trial results.

National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:uu:diva-377608 (URN)10.1002/sim.8160 (DOI)000473655400001 ()31049999 (PubMedID)
Available from: 2019-02-22 Created: 2019-02-22 Last updated: 2019-08-16Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0003-2997-8566

Search in DiVA

Show all publications