CV

Basics

Name Gersi Doko
Label PhD Student at UNH
Email Gersi.Doko@unh.edu
Url https://gersid.github.io/
Summary PhD student at UNH researching risk-averse decision-making, with a focus on reinforcement learning and LLMs.

Work

  • 2025.09 - 2025.12

    New York City, NY

    Applied Scientist II Intern (L5)
    Amazon
    Optimized large language model (LLM) performance for real-time applications.
    • Delivered scalable knowledge distillation approach for internal LLM application, improving inference latency by 4.5x while maintaining accuracy
    • Collaborated with cross-functional teams to deploy distilled models into production at scale
    • Developed internal artifacts for vLLM deployments, Supervised Fine-Tuning (SFT), and Reinforcement Learning with Human Feedback (RLHF)
  • 2025.05 - 2025.08

    Durham, NH

    Machine Learning Engineer Intern
    Northlight AI
    Drove real-world AI solutions for underserved markets by deploying pragmatic, ethical machine learning models in cloud environments to empower small-to-midsize enterprises.
    • Delivered a customer-facing product that resolved pain points for small businesses by leveraging LLMs and reinforcement learning to optimize supply-chain operations
  • 2022.05 - Present

    Durham, NH

    Machine Learning Research Assistant
    UNH RL² Lab
    Studying machine learning and reinforcement learning (RL) under Dr. Marek Petrik in the RL² Lab.
    • Doctoral research publishing new methods for risk-averse decision-making problems, with a focus on RL and LLMs
    • Efficiently implementing and testing RL algorithms in Julia and Python (github.com/RiskAverseRL)
    • Job skills: Python, Julia, TensorFlow, PyTorch, LLMs, Risk-Sensitive Decision Making
  • 2021.08 - 2022.05

    Cambridge, MA

    Data Scientist Intern
    NextStep Health
    • Implemented on-prem models to predict patient outcomes using Python and TensorFlow
    • Delivered internal tools that reduced turnaround time for data analysis by 30%
  • 2021.05 - 2022.05

    Dover, NH

    Software Engineer Intern
    Liberty Mutual
    • Fostered code reuse by creating a shared Python library, reducing code duplication by more than 80%
    • Optimized new data storage and retrieval system using AWS S3, reducing on-premise storage costs by 25%
  • 2018.06 - 2021.05

    Durham, NH

    Senior Test Engineer
    UNH Interoperability Lab
    • Reviewed and engineered test media for IEEE Standard 802.3, improving test coverage for back-plane and Base-T
    • Job skills: Python, C++, Java, Test Engineering, Standardization, IEEE 802.3, Robotics, Hands-on Experience

Education

  • 2022 - 2025.05

    Durham, NH

    Master of Science
    University of New Hampshire
    Computer Science, Summa Cum Laude (GPA 4.00 / 4.00)
  • 2022 - Present

    Durham, NH

    Doctor of Philosophy (PhD)
    University of New Hampshire
    Computer Science (expected May 2027)
    • Advanced Algorithms in Machine Learning
    • Deep-Q Learning
    • Reinforcement Learning
    • Risk-Sensitive Decision-Making
    • LLM-Driven Optimization
    • Foundation Model Theory
    • PyTorch, TensorFlow
    • Prototyping, Implementation, Robotics
  • 2018.08 - 2022.05

    Durham, NH

    Bachelor of Science
    University of New Hampshire
    Computer Science, Summa Cum Laude (GPA 3.98 / 4.00)
    • Data Structures and Algorithms (C++)
    • Probability and Statistics in CS (Python)
    • Intro to CS II (C++)
    • Linear Algebra with Computational Applications (Python)
    • Reinforcement Learning (Python)
    • Neural Networks (Python)
    • AWS, Azure, REST
    • Software Development, Cloud Infrastructure

Awards

Publications

  • 2026.10
    Computing Monetary Risk Measures in Linear Time
    Transactions on Machine Learning Research (TMLR)
    Developed a linear-time algorithm for computing monetary risk measures, which are widely used in reinforcement learning and finance. Optimized state-of-the-art methods for computing risk measures, resulting in a log-factor speedup in computation time.
  • 2025.12
    Risk-Averse Total-Reward Reinforcement Learning
    Advances in Neural Information Processing Systems (NeurIPS)
    Developed risk-sensitive reinforcement learning algorithms that optimize for the risk-adjusted future rewards, rather than the expected reward. Gave practical algorithms for optimizing the entropic utility of the total reward, which is a common risk-sensitive objective in domains such as finance, health and autonomous driving.
  • 2025.08
    Deep Reinforcement Learning-Based Optimization of an Island Energy-Water Microgrid System
    Resources, Conservation and Recycling (RCR)
    Interdisciplinary work with the UNH Civil Engineering Dept. Developed a deep reinforcement learning model to optimize the energy and water usage of an off-shore microgrid. Real-world RL application which resulted in a 20% increase in island sustainability, with less human intervention.
  • 2024.12
    LLM Thematic Analysis for Agriculture Research
    Led collaboration with UNH Agriculture Dept. to develop a thematic analysis pipeline for categorizing research laboratories across the USA. Implemented a human-in-the-loop LLM system to improve accuracy and reduce workload, leveraging LangChain.
  • 2024.05
    ROIL: Robust Offline Imitation Learning
    Reinforcement Learning Journal (RLJ)
    First publication. Led novel research on a robust method for training agents from data using offline imitation learning, surpassing previous work by leveraging consistent policy sets. Improved on existing IRL methods by allowing for covariate shift, which is common in the real world.

Skills

Tools
Python
Julia
PyTorch
TensorFlow
LangChain
AWS
Azure
Docker
Kubernetes
Git
Go
Java
Postgres
ChromaDB
JSON Schema
Tableau
Power BI
Spring Boot (REST)
Skills
Reinforcement Learning
Risk-Sensitive Machine Learning
Optimal Decision-Making
Machine Learning Research
Deep Learning
Transformers and LLMs
Agentic AI Implementation
Human-LLM Collaboration
Computer Vision
Large-Scale Data Analysis
Scientific Publication
Soft Skills
Science Communication
Idea Organizer
Team Player
Problem Solver
Critical Thinker
Self-Motivated
Strong Work Ethic
Leadership
Collaborator

Languages

Albanian
Intermediate
English
Fluent
Spanish
Intermediate

References

Marek Petrik
Marek Petrik, Professor of Computer Science at UNH. Leading researcher in RL. Marek.Petrik@unh.edu

Projects

  • 2022.04 - 2023.08
    PPO: Proximal Policy Optimization
    Open source project on a flexible implementation of PPO. Implemented in Python. Using PyTorch Lightning.
    • Deep RL
    • RL
    • Python
  • 2023.01 - 2024.01
    Bandit Algorithms
    Open source project on bandit algorithms. Implemented in Python. Following the popular book by Tor Lattimore and Csaba Szepesvári.
    • Bandits
    • RL
    • Python