CV
Basics
Name | Gersi Doko |
Label | PhD Student UNH |
Gersi.Doko@unh.edu | |
Phone | (603) 862-3778 |
Url | https://gersid.github.io/ |
Summary | PhD Students at UNH, working on robust decision making under uncertainty. |
Work
-
2022.05 - Present Research Assistant
University of New Hampshire
Researching robust offline and online decision making under uncertainty. Developing algorithms for complex and involved domains.
- Published in the first ever RL Conference 2024.
Education
-
2018.08 - 2022.05 Durham, NH
Bachelors
University of New Hampshire
Computer Science
- Reinforcement Learning
- Machine Learning
- Deep Learning
Awards
- 2022.05.23
Graduated Summa Cum Laude
University of New Hampshire
Awarded to students who are in the top of their graduating class academically.
- 2018.08.26
Deans Scholarship
University of New Hampshire
Scholarship awarded to students with exceptional academic performance, scholarly excellence, and leadership qualities.
- 2019.08.26
Phillips Family Engineering Scholarship
University of New Hampshire
Awarded to Engineering students who maintain a 3.5 GPA or higher in the first 2 years of study.
Publications
-
2024.10.30 Deep Reinforcement Learning based Optimization of an Island Energy-Water Microgrid System
Resources, Conservation and Recycling
Implemented a Deep RL method to optimize the operation of an island energy-water microgrid system. The results show that the proposed method outperforms the traditional multi-object optimization approach as well as improves the sustainability of the Island infastructure compared to human occupants.
-
2024.05.30 ROIL: Robust Offline Imitation Learning
RLJ (Reinforcement Learning Journal)
Developed novel IRL method to solve for a policy which is maximially robust to adversarial perturbations in the reward function and demonstrations. We show that this approach completely avoids covariate shift, which harshly affects the performance of existing methods.
Skills
Computer Science | |
Machine Learning | |
Deep Learning | |
Reinforcement Learning | |
Pytorch Lightning | |
Research |
Languages
Albanian | |
Intermediate |
English | |
Fluent |
Spanish | |
Intermediate |
References
Marek Petrik | |
Marek Petrik, Professor of Computer Science at UNH. Leading researcher in RL. Marek.Petrik@unh.edu |
Projects
- 2022.04 - 2023.08
PPO: Proximal Policy Optimization
Open source project on a flexible implementation of PPO. Implemented in Python. Using Pytorch Lightning.
- Deep RL
- RL
- Python
- 2023.01 - 2024.01
Bandit Algorithms
Open source project on bandit algorithms. Implemented in Python. Following the popular book by Tor Lattimore and Csaba Szepesvari.
- Bandits
- RL
- Python