Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Performance of longitudinal item response theory models in shortened or partial assessments.
Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Pharmacy, Department of Pharmaceutical Biosciences.ORCID iD: 0000-0001-7272-1657
Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Pharmacy, Department of Pharmaceutical Biosciences.ORCID iD: 0000-0002-3712-0255
Show others and affiliations
2020 (English)In: Journal of Pharmacokinetics and Pharmacodynamics, ISSN 1567-567X, E-ISSN 1573-8744, Vol. 47, no 5, p. 461-471Article in journal (Refereed) Published
Abstract [en]

This work evaluates the performance of longitudinal item response (IR) theory models in shortened assessments using an existing model for part II and III of the MDS-UPDRS score. Based on the item information content, the assessment was reduced by removal of items in multiple increments and the models' ability to recover the item characteristics of the remaining items at each level was evaluated. This evaluation was done for both simulated and real data. The metric of comparison in both cases was the item information function. For real data, the impact of shortening on the estimated disease progression and drug effect was also studied. In the simulated data setting, the item characteristics did not differ between the full and the shortened assessments down to the lowest level of information remaining; indicating a considerable independence between items. In contrast when reducing the assessment in a real data setting, a substantial change in item information was observed for some of the items. Disease progression and drug effect estimates also decreased in the reduced assessments. These changes indicate a shift in the measured construct of the shortened assessment and warrant caution when comparing results from a partial assessment with results from the full assessment.

Place, publisher, year, edition, pages
2020. Vol. 47, no 5, p. 461-471
Keywords [en]
Composite score, Item information, Item response theory, Pharmacometrics
National Category
Pharmaceutical Sciences
Identifiers
URN: urn:nbn:se:uu:diva-431478DOI: 10.1007/s10928-020-09697-xISI: 000545056600001PubMedID: 32617833OAI: oai:DiVA.org:uu-431478DiVA, id: diva2:1517707
Funder
Swedish Research Council, 2018-03317Available from: 2021-01-14 Created: 2021-01-14 Last updated: 2025-03-21Bibliographically approved
In thesis
1. Pharmacometric Evaluation of Item Response Modeling to Inform Clinical Drug Development
Open this publication in new window or tab >>Pharmacometric Evaluation of Item Response Modeling to Inform Clinical Drug Development
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Drug development is the process of advancing novel therapeutics to market to improve patient outcomes. However, in hard-to-treat diseases like neurodegenerative disorders there is a high failure rate in late-stage trials, creating significant unmet needs. This highlights the need for more sensitive endpoints, improved trial designs, or analytical methods to optimize data utilization.  In many diseases, clinical outcome assessments (COAs) serve as clinical endpoints and are often reported as a composite score, potentially losing important information present at the item level. Alternatively, item response theory (IRT) leverages item-level data to describe the relationship between a subject’s response on an item and their underlying ability, through item characteristic functions (ICFs), offering a more informed analysis of COAs. This thesis evaluates the robustness of IRT, estimation strategies and its applicability to model rating-scale-based COAs to facilitate model-informed drug development (MIDD). 

For single time point analysis, our findings suggest at least 100 subjects and 20 items are generally sufficient. Comparison of Laplace and Gaussian-hermite quadrature (GHQ-EM) for the estimation of item parameters, indicated similar accuracy and precision with slight improvement in accuracy for GHQ-EM.   IRT models in reduced assessments were relatively stable up to ~40-60% information remaining. However, removing items shifts the measured disease construct, which can affect the accurate assessment of disease progression and drug effect. The trade-offs in information lost or gained should be considered when shortening assessments. Comparison of two common estimation strategies for determining ICFs indicated similar performance, each providing different advantages. IRT was also effective in classifying disease (Parkinson’s vs SWEDDs), showing comparable performance to artificial neural networks. Additionally, IRT demonstrated superior power for detecting symptomatic treatment effect in a short duration trial compared to traditional approaches, highlighting IRT’s potential not only for endpoint analyses but as a strategic tool to optimize trial design. Greater public disclosure of applied IRT in real-time drug development, such as inclusion in trial protocols or in regulatory milestones could foster broader acceptance and wider adoption beyond ad-hoc analyses. In conclusion, this thesis presents a methodological foundation for successful implementation of IRT in a pharmacometric framework to facilitate MIDD and inform clinical decision-making.

 

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 78
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Pharmacy, ISSN 1651-6192 ; 375
Keywords
pharmacometrics, nonlinear mixed-effects models, item response theory, Parkinson's Disease, Alzheimer's Disease, composite score, clinical outcome assessments
National Category
Pharmaceutical Sciences
Research subject
Pharmaceutical Science
Identifiers
urn:nbn:se:uu:diva-552893 (URN)978-91-513-2438-8 (ISBN)
Public defence
2025-05-13, A1:107a, BMC, Husargatan 3, Uppsala, 13:15 (English)
Opponent
Supervisors
Available from: 2025-04-22 Created: 2025-03-21 Last updated: 2025-04-22

Open Access in DiVA

fulltext(517 kB)275 downloads
File information
File name FULLTEXT01.pdfFile size 517 kBChecksum SHA-512
482a5bb779104d00511b2ac1db03ced6116bc6af6ce201148e44399bf247b6aa29e8d53bcbfdbe845cae69124b55eff9a133f9b6fe56330ce263840d66b75a3a
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMed

Authority records

Arrington, LeticiaUeckert, SebastianKarlsson, Mats

Search in DiVA

By author/editor
Arrington, LeticiaUeckert, SebastianKarlsson, Mats
By organisation
Department of Pharmaceutical Biosciences
In the same journal
Journal of Pharmacokinetics and Pharmacodynamics
Pharmaceutical Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 275 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 259 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf