Title:
Improving Model-Predictive Control with Value Function Approximation
Improving Model-Predictive Control with Value Function Approximation
| dc.contributor.author | Chintalapudi, Sahit | |
| dc.contributor.committeeMember | Boots, Byron | |
| dc.contributor.committeeMember | Tsiotras, Panagiotis | |
| dc.contributor.department | Computer Science | |
| dc.contributor.department | Computer Science | |
| dc.date.accessioned | 2020-11-09T16:59:02Z | |
| dc.date.available | 2020-11-09T16:59:02Z | |
| dc.date.created | 2019-12 | |
| dc.date.issued | 2019-12 | |
| dc.date.submitted | December 2019 | |
| dc.date.updated | 2020-11-09T16:59:02Z | |
| dc.description.abstract | Existing Model Predictive Control methods rely on finite-horizon trajectories from the environment. Such methods are limited by the length of the samples because the robot cannot plan for scenarios beyond this time horizon. Simply extending the time-horizon of sampled trajectories is not feasible as an increase in the time-horizon requires more sampled trajectories from the environment in order to maintain controller performance. On robots such as the AutoRally platform, which operate in real time with limited computational power, increasing the number of sampled trajectories is computationally intractable. This work improves the long-term planning capabilities of autonomous systems by augmenting cost-estimates of trajectories with a learned value of the terminal state. This learned value approximates the expected cost under the car's current control policy from the terminal state for an arbitrary time-horizon without requiring an increase in the number of samples. We show that this improves the lap times of the AutoRally platform. | |
| dc.description.degree | Undergraduate | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | http://hdl.handle.net/1853/63845 | |
| dc.language.iso | en_US | |
| dc.publisher | Georgia Institute of Technology | |
| dc.subject | Model-Predictive Control | |
| dc.subject | Reinforcement Learning | |
| dc.subject | Autonomous Driving | |
| dc.title | Improving Model-Predictive Control with Value Function Approximation | |
| dc.type | Text | |
| dc.type.genre | Undergraduate Thesis | |
| dspace.entity.type | Publication | |
| local.contributor.corporatename | College of Computing | |
| local.contributor.corporatename | School of Computer Science | |
| local.contributor.corporatename | Undergraduate Research Opportunities Program | |
| local.relation.ispartofseries | Undergraduate Research Option Theses | |
| relation.isOrgUnitOfPublication | c8892b3c-8db6-4b7b-a33a-1b67f7db2021 | |
| relation.isOrgUnitOfPublication | 6b42174a-e0e1-40e3-a581-47bed0470a1e | |
| relation.isOrgUnitOfPublication | 0db885f5-939b-4de1-807b-f2ec73714200 | |
| relation.isSeriesOfPublication | e1a827bd-cf25-4b83-ba24-70848b7036ac | |
| thesis.degree.level | Undergraduate |