CV
Basics
| Name | Gersi Doko |
| Label | PhD Student at UNH |
| Gersi.Doko@unh.edu | |
| Url | https://gersid.github.io/ |
| Summary | PhD student at UNH researching risk-averse decision-making, with a focus on reinforcement learning and LLMs. |
Work
-
2025.09 - 2025.12 New York City, NY
Applied Scientist II Intern (L5)
Amazon
Optimized large language model (LLM) performance for real-time applications.
- Delivered scalable knowledge distillation approach for internal LLM application, improving inference latency by 4.5x while maintaining accuracy
- Collaborated with cross-functional teams to deploy distilled models into production at scale
- Developed internal artifacts for vLLM deployments, Supervised Fine-Tuning (SFT), and Reinforcement Learning with Human Feedback (RLHF)
-
2025.05 - 2025.08 Durham, NH
Machine Learning Engineer Intern
Northlight AI
Drove real-world AI solutions for underserved markets by deploying pragmatic, ethical machine learning models in cloud environments to empower small-to-midsize enterprises.
- Delivered a customer-facing product that resolved pain points for small businesses by leveraging LLMs and reinforcement learning to optimize supply-chain operations
-
2022.05 - Present Durham, NH
Machine Learning Research Assistant
UNH RL² Lab
Studying machine learning and reinforcement learning (RL) under Dr. Marek Petrik in the RL² Lab.
- Doctoral research publishing new methods for risk-averse decision-making problems, with a focus on RL and LLMs
- Efficiently implementing and testing RL algorithms in Julia and Python (github.com/RiskAverseRL)
- Job skills: Python, Julia, TensorFlow, PyTorch, LLMs, Risk-Sensitive Decision Making
-
2021.08 - 2022.05 Cambridge, MA
Data Scientist Intern
NextStep Health
- Implemented on-prem models to predict patient outcomes using Python and TensorFlow
- Delivered internal tools that reduced turnaround time for data analysis by 30%
-
2021.05 - 2022.05 Dover, NH
Software Engineer Intern
Liberty Mutual
- Fostered code reuse by creating a shared Python library, reducing code duplication by more than 80%
- Optimized new data storage and retrieval system using AWS S3, reducing on-premise storage costs by 25%
-
2018.06 - 2021.05 Durham, NH
Senior Test Engineer
UNH Interoperability Lab
- Reviewed and engineered test media for IEEE Standard 802.3, improving test coverage for back-plane and Base-T
- Job skills: Python, C++, Java, Test Engineering, Standardization, IEEE 802.3, Robotics, Hands-on Experience
Education
-
2022 - 2025.05 Durham, NH
-
2022 - Present Durham, NH
Doctor of Philosophy (PhD)
University of New Hampshire
Computer Science (expected May 2027)
- Advanced Algorithms in Machine Learning
- Deep-Q Learning
- Reinforcement Learning
- Risk-Sensitive Decision-Making
- LLM-Driven Optimization
- Foundation Model Theory
- PyTorch, TensorFlow
- Prototyping, Implementation, Robotics
-
2018.08 - 2022.05 Durham, NH
Bachelor of Science
University of New Hampshire
Computer Science, Summa Cum Laude (GPA 3.98 / 4.00)
- Data Structures and Algorithms (C++)
- Probability and Statistics in CS (Python)
- Intro to CS II (C++)
- Linear Algebra with Computational Applications (Python)
- Reinforcement Learning (Python)
- Neural Networks (Python)
- AWS, Azure, REST
- Software Development, Cloud Infrastructure
Awards
-
Technical Reviewer
Reinforcement Learning Journal; European Workshop on Reinforcement Learning (EWRL)
-
Graduated Summa Cum Laude (B.S. and M.S.)
University of New Hampshire
- 2022
Presented at the UNH Undergraduate Research Conference
University of New Hampshire
-
Dean's Award for Academic Excellence in Computer Science
University of New Hampshire
-
President's Scholarship
University of New Hampshire
Awarded for academic achievement and leadership, two years in a row.
- 2018.08
Dean's Scholarship
University of New Hampshire
Scholarship awarded to students with exceptional academic performance, scholarly excellence, and leadership qualities.
- 2019.08
Phillips Family Engineering Scholarship
University of New Hampshire
Awarded to Engineering students who maintain a 3.5 GPA or higher in the first 2 years of study.
Publications
-
2026.10 Computing Monetary Risk Measures in Linear Time
Transactions on Machine Learning Research (TMLR)
Developed a linear-time algorithm for computing monetary risk measures, which are widely used in reinforcement learning and finance. Optimized state-of-the-art methods for computing risk measures, resulting in a log-factor speedup in computation time.
-
2025.12 Risk-Averse Total-Reward Reinforcement Learning
Advances in Neural Information Processing Systems (NeurIPS)
Developed risk-sensitive reinforcement learning algorithms that optimize for the risk-adjusted future rewards, rather than the expected reward. Gave practical algorithms for optimizing the entropic utility of the total reward, which is a common risk-sensitive objective in domains such as finance, health and autonomous driving.
-
2025.08 Deep Reinforcement Learning-Based Optimization of an Island Energy-Water Microgrid System
Resources, Conservation and Recycling (RCR)
Interdisciplinary work with the UNH Civil Engineering Dept. Developed a deep reinforcement learning model to optimize the energy and water usage of an off-shore microgrid. Real-world RL application which resulted in a 20% increase in island sustainability, with less human intervention.
-
2024.12 LLM Thematic Analysis for Agriculture Research
Led collaboration with UNH Agriculture Dept. to develop a thematic analysis pipeline for categorizing research laboratories across the USA. Implemented a human-in-the-loop LLM system to improve accuracy and reduce workload, leveraging LangChain.
-
2024.05 ROIL: Robust Offline Imitation Learning
Reinforcement Learning Journal (RLJ)
First publication. Led novel research on a robust method for training agents from data using offline imitation learning, surpassing previous work by leveraging consistent policy sets. Improved on existing IRL methods by allowing for covariate shift, which is common in the real world.
Skills
| Tools | |
| Python | |
| Julia | |
| PyTorch | |
| TensorFlow | |
| LangChain | |
| AWS | |
| Azure | |
| Docker | |
| Kubernetes | |
| Git | |
| Go | |
| Java | |
| Postgres | |
| ChromaDB | |
| JSON Schema | |
| Tableau | |
| Power BI | |
| Spring Boot (REST) |
| Skills | |
| Reinforcement Learning | |
| Risk-Sensitive Machine Learning | |
| Optimal Decision-Making | |
| Machine Learning Research | |
| Deep Learning | |
| Transformers and LLMs | |
| Agentic AI Implementation | |
| Human-LLM Collaboration | |
| Computer Vision | |
| Large-Scale Data Analysis | |
| Scientific Publication |
| Soft Skills | |
| Science Communication | |
| Idea Organizer | |
| Team Player | |
| Problem Solver | |
| Critical Thinker | |
| Self-Motivated | |
| Strong Work Ethic | |
| Leadership | |
| Collaborator |
Languages
| Albanian | |
| Intermediate |
| English | |
| Fluent |
| Spanish | |
| Intermediate |
References
| Marek Petrik | |
| Marek Petrik, Professor of Computer Science at UNH. Leading researcher in RL. Marek.Petrik@unh.edu |
Projects
- 2022.04 - 2023.08
PPO: Proximal Policy Optimization
Open source project on a flexible implementation of PPO. Implemented in Python. Using PyTorch Lightning.
- Deep RL
- RL
- Python
- 2023.01 - 2024.01
Bandit Algorithms
Open source project on bandit algorithms. Implemented in Python. Following the popular book by Tor Lattimore and Csaba Szepesvári.
- Bandits
- RL
- Python