CV

Basics

Name Gersi Doko
Label PhD Student UNH
Email Gersi.Doko@unh.edu
Phone (603) 862-3778
Url https://gersid.github.io/
Summary PhD Students at UNH, working on robust decision making under uncertainty.

Work

  • 2022.05 - Present
    Research Assistant
    University of New Hampshire
    Researching robust offline and online decision making under uncertainty. Developing algorithms for complex and involved domains.
    • Published in the first ever RL Conference 2024.

Education

  • 2018.08 - 2022.05

    Durham, NH

    Bachelors
    University of New Hampshire
    Computer Science
    • Reinforcement Learning
    • Machine Learning
    • Deep Learning

Awards

  • 2022.05.23
    Graduated Summa Cum Laude
    University of New Hampshire
    Awarded to students who are in the top of their graduating class academically.
  • 2018.08.26
    Deans Scholarship
    University of New Hampshire
    Scholarship awarded to students with exceptional academic performance, scholarly excellence, and leadership qualities.
  • 2019.08.26
    Phillips Family Engineering Scholarship
    University of New Hampshire
    Awarded to Engineering students who maintain a 3.5 GPA or higher in the first 2 years of study.

Publications

  • 2024.10.30
    Deep Reinforcement Learning based Optimization of an Island Energy-Water Microgrid System
    Resources, Conservation and Recycling
    Implemented a Deep RL method to optimize the operation of an island energy-water microgrid system. The results show that the proposed method outperforms the traditional multi-object optimization approach as well as improves the sustainability of the Island infastructure compared to human occupants.
  • 2024.05.30
    ROIL: Robust Offline Imitation Learning
    RLJ (Reinforcement Learning Journal)
    Developed novel IRL method to solve for a policy which is maximially robust to adversarial perturbations in the reward function and demonstrations. We show that this approach completely avoids covariate shift, which harshly affects the performance of existing methods.

Skills

Computer Science
Machine Learning
Deep Learning
Reinforcement Learning
Pytorch Lightning
Research

Languages

Albanian
Intermediate
English
Fluent
Spanish
Intermediate

References

Marek Petrik
Marek Petrik, Professor of Computer Science at UNH. Leading researcher in RL. Marek.Petrik@unh.edu

Projects

  • 2022.04 - 2023.08
    PPO: Proximal Policy Optimization
    Open source project on a flexible implementation of PPO. Implemented in Python. Using Pytorch Lightning.
    • Deep RL
    • RL
    • Python
  • 2023.01 - 2024.01
    Bandit Algorithms
    Open source project on bandit algorithms. Implemented in Python. Following the popular book by Tor Lattimore and Csaba Szepesvari.
    • Bandits
    • RL
    • Python