Logotyp: till Uppsala universitets webbplats

uu.sePublikationer från Uppsala universitet
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Haptics with Applications to Cranio-Maxillofacial Surgery Planning
Uppsala universitet, Teknisk-naturvetenskapliga vetenskapsområdet, Matematisk-datavetenskapliga sektionen, Institutionen för informationsteknologi, Avdelningen för visuell information och interaktion. Uppsala universitet, Teknisk-naturvetenskapliga vetenskapsområdet, Matematisk-datavetenskapliga sektionen, Institutionen för informationsteknologi, Bildanalys och människa-datorinteraktion.
2015 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Virtual surgery planning systems have demonstrated great potential to help surgeons achieve a better functional and aesthetic outcome for the patient, and at the same time reduce time in the operating room resulting in considerable cost savings. However, the two-dimensional tools employed in these systems today, such as a mouse and a conventional graphical display, are difficult to use for interaction with three-dimensional anatomical images. Therefore surgeons often outsource virtual planning which increases cost and lead time to surgery.

Haptics relates to the sense of touch and haptic technology encompasses algorithms, software, and hardware designed to engage the sense of touch. To demonstrate how haptic technology in combination with stereo visualization can make cranio-maxillofacial surgery planning more efficient and easier to use, we describe our haptics-assisted surgery planning (HASP) system. HASP supports in-house virtual planning of reconstructions in complex trauma cases, and reconstructions with a fibula osteocutaneous free flap including bone, vessels, and soft-tissue in oncology cases. An integrated stable six degrees-of-freedom haptic attraction force model, snap-to-fit, supports semi-automatic alignment of virtual bone fragments in trauma cases. HASP has potential beyond this thesis as a teaching tool and also as a development platform for future research.

In addition to HASP, we describe a surgical bone saw simulator with a novel hybrid haptic interface that combines kinesthetic and vibrotactile feedback to display both low frequency contact forces and realistic high frequency vibrations when a virtual saw blade comes in contact with a virtual bone model. 

We also show that visuo-haptic co-location shortens the completion time, but does not improve the accuracy, in interaction tasks performed on two different visuo-haptic displays: one based on a holographic optical element and one based on a half-transparent mirror. 

Finally, we describe two prototype hand-worn haptic interfaces that potentially may expand the interaction capabilities of the HASP system. In particular we evaluate two different types of piezo-electric motors, one walking quasi-static motor and one traveling-wave ultrasonic motor for actuating the interfaces.

Ort, förlag, år, upplaga, sidor
Uppsala: Acta Universitatis Upsaliensis, 2015. , s. 79
Serie
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 1289
Nyckelord [en]
medical image processing, haptics, haptic rendering, haptic gripper, visuo-haptic co-location, vibrotactile feedback, surgery simulation, virtual surgery planning, cranio-maxillofacial surgery
Nationell ämneskategori
Medicinsk bildvetenskap Människa-datorinteraktion (interaktionsdesign)
Forskningsämne
Datoriserad bildbehandling
Identifikatorer
URN: urn:nbn:se:uu:diva-262378ISBN: 978-91-554-9339-4 (tryckt)OAI: oai:DiVA.org:uu-262378DiVA, id: diva2:853863
Disputation
2015-10-16, Room 2247, Polacksbacken, Lägerhyddsvägen 2, Uppsala, 10:00 (Engelska)
Opponent
Handledare
Tillgänglig från: 2015-09-25 Skapad: 2015-09-14 Senast uppdaterad: 2025-02-09Bibliografiskt granskad
Delarbeten
1. Haptics-assisted Virtual Planning of Bone, Soft Tissue, and Vessels in Fibula Osteocutaneous Free Flaps
Öppna denna publikation i ny flik eller fönster >>Haptics-assisted Virtual Planning of Bone, Soft Tissue, and Vessels in Fibula Osteocutaneous Free Flaps
Visa övriga...
2015 (Engelska)Ingår i: Plastic and Reconstructive Surgery - Global Open, E-ISSN 2169-7574, Vol. 3, nr 8, artikel-id e479Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Background: Virtual surgery planning has proven useful for reconstructing head and neck defects by fibula osteocutaneous free flaps (FOFF). Benefits include improved healing, function, and aesthetics, as well as cost savings. But available virtual surgery planning systems incorporating fibula in craniomaxillofacial reconstruction simulate only bone reconstruction without considering vessels and soft tissue.

Methods: The Haptics-Assisted Surgery Planning (HASP) system incorporates bone, vessels, and soft tissue of the FOFF in craniomaxillofacial defect reconstruction. Two surgeons tested HASP on 4 cases they had previously operated on: 3 with composite mandibular defects and 1 with a composite cervical spine defect. With the HASP stereographics and haptic feedback, using patient-specific computed tomography angiogram data, the surgeons planned the 4 cases, including bone resection, fibula design, recipient vessels selection, pedicle and perforator location selection, and skin paddle configuration.

Results: Some problems encountered during the actual surgery could have been avoided as they became evident with HASP. In one case, the fibula reconstruction was incomplete because the fibula had to be reversed and thus did not reach the temporal fossa. In another case, the fibula had to be rotated 180 degrees to correct the plate and screw placement in relation to the perforator. In the spinal case, difficulty in finding the optimal fibula shape and position required extra ischemia time.

Conclusions: The surgeons found HASP to be an efficient planning tool for FOFF reconstructions. The testing of alternative reconstructions to arrive at an optimal FOFF solution preoperatively potentially improves patient function and aesthetics and reduces operating room time.

Ort, förlag, år, upplaga, sidor
Wolters Kluwer, 2015
Nationell ämneskategori
Medicinsk bildvetenskap Kirurgi
Forskningsämne
Datoriserad bildbehandling
Identifikatorer
urn:nbn:se:uu:diva-260771 (URN)10.1097/GOX.0000000000000447 (DOI)000219082300005 ()26495192 (PubMedID)
Tillgänglig från: 2015-08-24 Skapad: 2015-08-24 Senast uppdaterad: 2025-02-09Bibliografiskt granskad
2. A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases
Öppna denna publikation i ny flik eller fönster >>A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases
2013 (Engelska)Ingår i: International Journal of Computer Assisted Radiology and Surgery, ISSN 1861-6410, E-ISSN 1861-6429, Vol. 8, nr 6, s. 887-894Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Cranio-maxillofacial (CMF) surgery to restore normal skeletal anatomy in patients with serious trauma to the face can be both complex and time-consuming. But it is generally accepted that careful pre-operative planning leads to a better outcome with a higher degree of function and reduced morbidity in addition to reduced time in the operating room. However, today's surgery planning systems are primitive, relying mostly on the user's ability to plan complex tasks with a two-dimensional graphical interface. A system for planning the restoration of skeletal anatomy in facial trauma patients using a virtual model derived from patient-specific CT data. The system combines stereo visualization with six degrees-of-freedom, high-fidelity haptic feedback that enables analysis, planning, and preoperative testing of alternative solutions for restoring bone fragments to their proper positions. The stereo display provides accurate visual spatial perception, and the haptics system provides intuitive haptic feedback when bone fragments are in contact as well as six degrees-of-freedom attraction forces for precise bone fragment alignment. A senior surgeon without prior experience of the system received 45 min of system training. Following the training session, he completed a virtual reconstruction in 22 min of a complex mandibular fracture with an adequately reduced result. Preliminary testing with one surgeon indicates that our surgery planning system, which combines stereo visualization with sophisticated haptics, has the potential to become a powerful tool for CMF surgery planning. With little training, it allows a surgeon to complete a complex plan in a short amount of time.

Nationell ämneskategori
Medicinsk bildvetenskap Kirurgi
Identifikatorer
urn:nbn:se:uu:diva-198977 (URN)10.1007/s11548-013-0827-5 (DOI)000326455900002 ()23605116 (PubMedID)
Tillgänglig från: 2013-04-21 Skapad: 2013-04-30 Senast uppdaterad: 2025-02-09Bibliografiskt granskad
3. Visuohaptic bone saw simulator: Combining vibrotactile and kinesthetic feedback
Öppna denna publikation i ny flik eller fönster >>Visuohaptic bone saw simulator: Combining vibrotactile and kinesthetic feedback
Visa övriga...
2015 (Engelska)Ingår i: Proc. 8th ACM SIGGRAPH Asia Technical Briefs, New York: ACM Press, 2015, s. 10:1-4Konferensbidrag, Publicerat paper (Refereegranskat)
Ort, förlag, år, upplaga, sidor
New York: ACM Press, 2015
Nationell ämneskategori
Datorgrafik och datorseende
Forskningsämne
Datoriserad bildbehandling
Identifikatorer
urn:nbn:se:uu:diva-262369 (URN)10.1145/2820903.2820925 (DOI)978-1-4503-3930-8 (ISBN)
Konferens
ACM SIGGRAPH Asia 2015, November 2–5, Kobe, Japan
Tillgänglig från: 2015-11-02 Skapad: 2015-09-14 Senast uppdaterad: 2025-02-07Bibliografiskt granskad
4. Snap-to-fit, a Haptic 6 DOF Alignment Tool for Virtual Assembly
Öppna denna publikation i ny flik eller fönster >>Snap-to-fit, a Haptic 6 DOF Alignment Tool for Virtual Assembly
2013 (Engelska)Ingår i: Proc. World Haptics (WHC), 2013 IEEE, 2013, s. 205-210Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Virtual assembly of complex objects has application in domains ranging from surgery planning to archaeology. In these domains the objective is to plan the restoration of skeletal anatomy or archaeological artifacts to achieve an optimal reconstruction without causing further damage. While graphical modeling plays a central role in virtual assembly, visual feedback alone is often insufficient since object contact and penetration is difficult to discern due to occlusion. Haptics can improve an assembly task by giving feedback when objects collide, but precise fitting of fractured objects guided by delicate haptic cues similar to those present in the physical world requires haptic display transparency beyond the performance of today’s systems. We propose a haptic alignment tool that combines a 6 Degrees of Freedom (DOF) attraction force with traditional 6 DOF contact forces to pull a virtual object towards a local stable fit with a fixed object. The object forces are integrated into a virtual coupling framework yielding a stable haptic tool. We demonstrate the use of our system on applications from both cranio-maxillofacial surgery and archaeology, and show that we can achieve haptic rates for fractured surfaces with over 5000 points.

Nyckelord
Virtual Assembly, Force Feedback, Haptic Rendering, Fractured Object, Virtual Environments, 3D puzzle
Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign) Annan teknik Medicinsk bildvetenskap
Identifikatorer
urn:nbn:se:uu:diva-209551 (URN)10.1109/WHC.2013.6548409 (DOI)000325187400035 ()978-1-4799-0087-9 (ISBN)
Konferens
IEEE World Haptics Conference (WHC), 14-18 April, 2013, Daejeon, SOUTH KOREA
Tillgänglig från: 2013-10-21 Skapad: 2013-10-21 Senast uppdaterad: 2025-02-18Bibliografiskt granskad
5. Comparison of walking and traveling-wave piezoelectric motors as actuators in kinesthetic haptic devices
Öppna denna publikation i ny flik eller fönster >>Comparison of walking and traveling-wave piezoelectric motors as actuators in kinesthetic haptic devices
2016 (Engelska)Ingår i: IEEE Transactions on Haptics, ISSN 1939-1412, E-ISSN 2329-4051, Vol. 9, nr 3, s. 427-431Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Piezoelectric motors offer an attractive alternative to electromagnetic actuators in portable haptic interfaces: they are compact, have a high force-to-volume ratio, and can operate with limited or no gearing. However, the choice of a piezoelectric motor type is not obvious due to differences in performance characteristics. We present our evaluation of two commercial, operationally different, piezoelectric motors acting as actuators in two kinesthetic haptic grippers, a walking quasi-static motor and a traveling wave ultrasonic motor. We evaluate each gripper's ability to display common virtual objects including springs, dampers, and rigid walls, and conclude that the walking quasi-static motor is superior at low velocities. However, for applications where high velocity is required, traveling wave ultrasonic motors are a better option.

Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign) Robotik och automation
Forskningsämne
Datoriserad bildbehandling; Teknisk fysik med inriktning mot mikrosystemteknik
Identifikatorer
urn:nbn:se:uu:diva-262371 (URN)10.1109/TOH.2016.2537803 (DOI)000384670000012 ()27046907 (PubMedID)
Forskningsfinansiär
VårdalstiftelsenVINNOVA
Tillgänglig från: 2016-03-30 Skapad: 2015-09-14 Senast uppdaterad: 2025-02-05Bibliografiskt granskad
6. Rendering stiffness with a prototype haptic glove actuated by an integrated piezoelectric motor
Öppna denna publikation i ny flik eller fönster >>Rendering stiffness with a prototype haptic glove actuated by an integrated piezoelectric motor
2012 (Engelska)Ingår i: Haptics: Perception, Devices, Mobility, and Communication: Part I, Springer Berlin/Heidelberg, 2012, s. 361-372Konferensbidrag, Publicerat paper (Refereegranskat)
Ort, förlag, år, upplaga, sidor
Springer Berlin/Heidelberg, 2012
Serie
Lecture Notes in Computer Science ; 7282
Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign) Annan teknik
Identifikatorer
urn:nbn:se:uu:diva-183878 (URN)10.1007/978-3-642-31401-8_33 (DOI)978-3-642-31400-1 (ISBN)
Konferens
EuroHaptics 2012, Tampere, Finland, June 13-15
Projekt
Whole Hand Haptics
Tillgänglig från: 2012-05-30 Skapad: 2012-11-05 Senast uppdaterad: 2025-02-18Bibliografiskt granskad
7. Physically Co-Located Haptic Interaction with 3D Displays
Öppna denna publikation i ny flik eller fönster >>Physically Co-Located Haptic Interaction with 3D Displays
2012 (Engelska)Ingår i: Proc. Haptics Symposium (HAPTICS), 2012 IEEE, 2012, s. 267-272Konferensbidrag, Poster (med eller utan abstract) (Refereegranskat)
Abstract [en]

Studies indicate that haptic interaction with a computer generated virtual scene may become more intuitive by aligning (co-locating) the visual and haptic workspaces so that the visual and haptic feedback coincide as they do in the real world. Co-located haptics may gain importance when more advanced haptic interfaces, such as high-fidelity whole hand devices, become available. We describe a user study that investigates the pros and cons with physically co-located versus non-collocated haptics on two different display types: a commercial half-transparent mirror 3D display with shutter glasses and a prototype autostereoscopic display based on a Holographic Optical Element (HOE). We use two accuracy tasks with spatial accuracy as the dependent variable and one manipulation task with time as the dependent variable. The study shows that on both displays co-location significantly improves completion time in the manipulation task. However, the study shows that co-location does not improve the accuracy in the spatial accuracy tasks.

Nyckelord
Haptics, Co-Location, 3D displays, Stereoscopy
Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign)
Identifikatorer
urn:nbn:se:uu:diva-175446 (URN)10.1109/HAPTIC.2012.6183801 (DOI)
Konferens
Haptics Symposium (HAPTICS), 2012 IEEE
Projekt
Whole Hand Haptics
Tillgänglig från: 2012-06-07 Skapad: 2012-06-07 Senast uppdaterad: 2023-11-01

Open Access i DiVA

fulltext(2500 kB)1351 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 2500 kBChecksumma SHA-512
7a96d1d878661c6261b37a04fd72d852ef65665726c857acea01daf0f67ff789b03b60e1586ebd2129af100ef326c4e9181947a73b6c72bb7f440ddf7a83a913
Typ fulltextMimetyp application/pdf

Person

Olsson, Pontus

Sök vidare i DiVA

Av författaren/redaktören
Olsson, Pontus
Av organisationen
Avdelningen för visuell information och interaktionBildanalys och människa-datorinteraktion
Medicinsk bildvetenskapMänniska-datorinteraktion (interaktionsdesign)

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 1356 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 2271 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf