Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Reinforcement Learning in Mechatronic Systems: A Case Study on DC Motor Control
Uppsala University, Disciplinary Domain of Science and Technology, Technology, Department of Electrical Engineering, Electricity. Cologne University of Applied Science, Cologne, Germany.
Heringer Consulting GmbH, Cologne, Germany..
Uppsala University, Disciplinary Domain of Science and Technology, Technology, Department of Electrical Engineering, Electricity. Cologne University of Applied Science, Cologne, Germany.ORCID iD: 0000-0002-1488-3778
Uppsala University, Disciplinary Domain of Science and Technology, Technology, Department of Electrical Engineering, Electricity. Cologne University of Applied Science, Cologne, Germany.ORCID iD: 0000-0001-9551-2890
Show others and affiliations
2025 (English)In: Circuits and Systems, ISSN 2153-1285, E-ISSN 2153-1293, Vol. 16, no 1, p. 1-24Article in journal (Refereed) Published
Abstract [en]

The integration of artificial intelligence into the development and production of mechatronic products offers a substantial opportunity to enhance efficiency, adaptability, and system performance. This paper examines the utilization of reinforcement learning as a control strategy, with a particular focus on its deployment in pivotal stages of the product development lifecycle, specifically between system architecture and system integration and verification. A controller based on reinforcement learning was developed and evaluated in comparison to traditional proportional-integral controllers in dynamic and fault-prone environments. The results illustrate the superior adaptability, stability, and optimization potential of the reinforcement learning approach, particularly in addressing dynamic disturbances and ensuring robust performance. The study illustrates how reinforcement learning can facilitate the transition from conceptual design to implementation by automating optimization processes, enabling interface automation, and enhancing system-level testing. Based on the aforementioned findings, this paper presents future directions for research, which include the integration of domain-specific knowledge into the reinforcement learning process and the validation of this process in real-world environments. The results underscore the potential of artificial intelligence-driven methodologies to revolutionize the design and deployment of intelligent mechatronic systems.

Place, publisher, year, edition, pages
Scientific Research Publishing, 2025. Vol. 16, no 1, p. 1-24
Keywords [en]
Artificial Intelligence in Product Development, Mechatronic Systems, Reinforcement Learning for Control, System Integration and Verification, Adaptive Optimization Processes, Knowledge-Based Engineering
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:uu:diva-552258DOI: 10.4236/cs.2025.161001OAI: oai:DiVA.org:uu-552258DiVA, id: diva2:1944009
Available from: 2025-03-12 Created: 2025-03-12 Last updated: 2025-03-14Bibliographically approved
In thesis
1. AI Potential in the Mechatronic Product Development: Identification, Utilization and Evaluation
Open this publication in new window or tab >>AI Potential in the Mechatronic Product Development: Identification, Utilization and Evaluation
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis explores the potential of Artificial Intelligence (AI) in mechatronic product development, focusing on the identification, utilization, and evaluation of AI-driven approaches. The increasing complexity of cross-domain collaboration, coupled with the demand for efficiency and reliability, necessitates structured methodologies to systematically integrate AI into engineering processes. While AI offers significant opportunities, challenges related to trustworthiness, robustness, and effective implementation remain critical considerations.

To address these challenges, this work introduces a generalized five-step methodology, providing a structured framework for assessing AI’s role in mechatronic development. The methodology enables the targeted identification of AI potential, structured integration into engineering workflows, and systematic evaluation of its impact. By applying this framework to real-world industrial case studies, the thesis demonstrates its practical applicability across different AI use cases, including translation, interpretation, and prediction.

As mechatronic product development continues to evolve, leveraging AI in a structured and validated manner ensures that organizations not only overcome current challenges but also enhance innovation, decision-making, and cross-domain collaboration. The findings of this thesis provide a scalable foundation for AI-driven advancements while maintaining a balance between AI potential and investment considerations.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 98
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2515
Keywords
Generalization Framework, Mechatronic Product Development, AI in Engineering, Decision Support Systems, Knowledge Integration, Human-AI Collaboration, Trustworthy AI, AI Potential Assessment, Industrial AI Applications
National Category
Engineering and Technology
Identifiers
urn:nbn:se:uu:diva-552264 (URN)978-91-513-2423-4 (ISBN)
Public defence
2025-05-12, Polhemsalen, Ångströmlaboratoriet, Lägerhyddsvägen 1, Uppsala, 09:00 (English)
Opponent
Supervisors
Available from: 2025-04-14 Created: 2025-03-12 Last updated: 2025-04-14
2. Model-Based Design and Validation of Advanced Mechatronic Systems illustrated by Modern Steer-by-Wire Systems
Open this publication in new window or tab >>Model-Based Design and Validation of Advanced Mechatronic Systems illustrated by Modern Steer-by-Wire Systems
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The automotive industry is experiencing a significant transformation driven by the demand for automation, autonomy and resource reduction. A key factor in this transformation is the model-based design and validation of advanced vehicle systems, particularly Steer-by-Wire systems, which are essential for highly automated and autonomous vehicles. However, Steer-by-Wire systems, characterized by the absence of a mechanical connection between the steering wheel and the front wheels, present unique challenges for achieving robust control as well as ensuring driving comfort and safety. This dissertation addresses these challenges by exploring innovative approaches for the optimal control of Steer-by-Wire systems, highlighting the model-based design and the integration of simulation environments. For this, a detailed model is developed, considering all relevant degrees of freedom and nonlinear characteristics of a real Steer-by-Wire system. Based on this detailed model, the dissertation presents a novel multivariable control approach that enhances the robustness and performance of Steer-by-Wire systems compared to traditional designs. The derived control approach demonstrates improved system stability and performance, effectively addressing parameter uncertainties and varying driving conditions. These satisfactory characteristics are validated both in an augmented simulation environment and on a real prototype. By combining virtual testing within the augmented simulation environment with real-world prototyping, the need for labor-intensive physical testing is minimized, thus optimizing development resources and time. The presented methods are not only employed for the development of Steer-by-Wire systems, but also for further applications in automotive engineering, including driver assistance systems, sensor evaluations and perception systems. In conclusion, the research contributes to mechatronics and automotive engineering by advancing autonomous driving through robust control approaches, virtual testing and agile development strategies. The insights and methodologies proposed not only advance the development of novel Steer-by-Wire systems, but can also serve as a basis for future innovations in mechatronic systems that require precise control and reliability.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. p. 98
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 2516
Keywords
Mechatronic Systems, Vehicle Dynamics Systems, Steer-by-Wire Systems, Modeling, Optimal Control Theory, Robustness Analysis
National Category
Control Engineering
Research subject
Electrical Engineering with specialization in Automatic Control
Identifiers
urn:nbn:se:uu:diva-552408 (URN)978-91-513-2426-5 (ISBN)
Public defence
2025-05-12, Lecure hall Eva von Bahr, Ångströmlaboratoriet, Lägerhyddsvägen 1, Uppsala, 13:00 (English)
Opponent
Supervisors
Available from: 2025-04-14 Created: 2025-03-14 Last updated: 2025-04-14

Open Access in DiVA

fulltext(1709 kB)35 downloads
File information
File name FULLTEXT01.pdfFile size 1709 kBChecksum SHA-512
081e706c6e9ba79be6245994acf0ce6f96fd1b546f9c896d6ef2e18ad03be94b05435758b7fca8b53a510f5d973f3b4afcc232332da7060c0180485917b47b88
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Nüssgen, AlexanderDegen, RenéIrmer, Marcusde Fries, MartinBoström, Cecilia

Search in DiVA

By author/editor
Nüssgen, AlexanderDegen, RenéIrmer, Marcusde Fries, MartinBoström, Cecilia
By organisation
Electricity
In the same journal
Circuits and Systems
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 35 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 232 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf