Reinforcement Learning for Active Length Control and Hysteresis Characterization of Shape Memory Alloys

dc.contributor.advisorValasek, John
dc.contributor.committeeMemberLagoudas, Dimitris
dc.contributor.committeeMemberIoerger, Thomas
dc.creatorKirkpatrick, Kenton C.
dc.date.accessioned2010-01-16T00:08:40Z
dc.date.available2010-01-16T00:08:40Z
dc.date.created2009-05
dc.date.issued2010-01-16
dc.description.abstractShape Memory Alloy actuators can be used for morphing, or shape change, by controlling their temperature, which is effectively done by applying a voltage difference across their length. Control of these actuators requires determination of the relationship between voltage and strain so that an input-output map can be developed. In this research, a computer simulation uses a hyperbolic tangent curve to simulate the hysteresis behavior of a virtual Shape Memory Alloy wire in temperature-strain space, and uses a Reinforcement Learning algorithm called Sarsa to learn a near-optimal control policy and map the hysteretic region. The algorithm developed in simulation is then applied to an experimental apparatus where a Shape Memory Alloy wire is characterized in temperature-strain space. This algorithm is then modified so that the learning is done in voltage-strain space. This allows for the learning of a control policy that can provide a direct input-output mapping of voltage to position for a real wire. This research was successful in achieving its objectives. In the simulation phase, the Reinforcement Learning algorithm proved to be capable of controlling a virtual Shape Memory Alloy wire by determining an accurate input-output map of temperature to strain. The virtual model used was also shown to be accurate for characterizing Shape Memory Alloy hysteresis by validating it through comparison to the commonly used modified Preisach model. The validated algorithm was successfully applied to an experimental apparatus, in which both major and minor hysteresis loops were learned in temperature-strain space. Finally, the modified algorithm was able to learn the control policy in voltage-strain space with the capability of achieving all learned goal states within a tolerance of +-0.5% strain, or +-0.65mm. This policy provides the capability of achieving any learned goal when starting from any initial strain state. This research has validated that Reinforcement Learning is capable of determining a control policy for Shape Memory Alloy crystal phase transformations, and will open the door for research into the development of length controllable Shape Memory Alloy actuators.en
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/1969.1/ETD-TAMU-2009-05-632
dc.language.isoen_US
dc.subjectReinforcement Learningen
dc.subjectShape Memory Alloysen
dc.subjectmorphing aircraften
dc.subjectmachine learningen
dc.subjectSarsaen
dc.subjectPreisach Modelen
dc.subjectMarkov Propertyen
dc.titleReinforcement Learning for Active Length Control and Hysteresis Characterization of Shape Memory Alloysen
dc.typeBooken
dc.typeThesisen
dc.type.genreElectronic Thesisen
thesis.degree.departmentAerospace Engineeringen
thesis.degree.disciplineAerospace Engineeringen
thesis.degree.grantorTexas A&M Universityen
thesis.degree.levelMastersen
thesis.degree.nameMaster of Scienceen

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
1_Kirkpatrick_Thesis.pdf
Size:
3.07 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.12 KB
Format:
Plain Text
Description: