Παρακαλώ χρησιμοποιήστε αυτό το αναγνωριστικό για να παραπέμψετε ή να δημιουργήσετε σύνδεσμο προς αυτό το τεκμήριο:
https://hdl.handle.net/20.500.14279/8205
Τίτλος: | A non-stationary infinite partially-observable markov decision process | Συγγραφείς: | Kosmopoulos, Dimitrios I. Chatzis, Sotirios P. |
Major Field of Science: | Engineering and Technology | Field Category: | Computer and Information Sciences | Λέξεις-κλειδιά: | Markov decision processes;Bayesian methods | Ημερομηνία Έκδοσης: | 2014 | Πηγή: | 24th International Conference on Artificial Neural Networks, Hamburg, Germany, September 15-19, 2014. Proceedings, pp. 355-362 | Conference: | International Conference on Artificial Neural Networks | Περίληψη: | Partially Observable Markov Decision Processes (POMDPs) have been met with great success in planning domains where agents must balance actions that provide knowledge and actions that provide reward. Recently, nonparametric Bayesian methods have been success- fully applied to POMDPs to obviate the need of a priori knowledge of the size of the state space, allowing to assume that the number of visited states may grow as the agent explores its environment. These approaches rely on the assumption that the agent's environment remains stationary; however, in real-world scenarios the environment may change over time. In this work, we aim to address this inadequacy by introducing a dynamic nonparametric Bayesian POMDP model that both allows for automatic inference of the (distributional) representations of POMDP states, and for capturing non-stationarity in the modeled environments. Formulation of our method is based on imposition of a suitable dynamic hierarchical Dirichlet process (dHDP) prior over state transitions. We derive e cientalgorithms for model inference and action planning and evaluate it on several benchmark tasks. | URI: | https://hdl.handle.net/20.500.14279/8205 | ISBN: | 978-3-319-11179-7 (online) | DOI: | 10.1007/978-3-319-11179-7_45 | Type: | Conference Papers | Affiliation: | Cyprus University of Technology Hellenic Mediterranean University |
Εμφανίζεται στις συλλογές: | Δημοσιεύσεις σε συνέδρια /Conference papers or poster or presentation |
Αρχεία σε αυτό το τεκμήριο:
Αρχείο | Περιγραφή | Μέγεθος | Μορφότυπος | |
---|---|---|---|---|
Chatzis.pdf | 196.62 kB | Adobe PDF | Δείτε/ Ανοίξτε |
CORE Recommender
SCOPUSTM
Citations
1
checked on 9 Νοε 2023
Page view(s) 20
435
Last Week
4
4
Last month
10
10
checked on 13 Μαϊ 2024
Download(s)
203
checked on 13 Μαϊ 2024
Google ScholarTM
Check
Altmetric
Όλα τα τεκμήρια του δικτυακού τόπου προστατεύονται από πνευματικά δικαιώματα