Skip to content
View Danielmarinn's full-sized avatar
  • Portugal
  • 11:39 (UTC +01:00)

Block or report Danielmarinn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Danielmarinn/README.md

Hi, I'm Daniel Marin 👋

MSc Engineering Physics @ University of Coimbra
Building intelligent systems at the intersection of physics, control theory, and reinforcement learning — from research notebook to production VPS.


🔬 What I'm working on

  • 🧠 MSc Thesis — Multi-Agent Reinforcement Learning (G2ANet) for autonomous control of wastewater treatment plants using BSM2/Simulink
  • 🧪 rl-sweep — 120-run PPO vs DQN hyperparameter study across 3 Gymnasium environments; discovered and root-caused a policy-collapse failure mode
  • 🌾 Grain Sentinel — STL + rolling MAD anomaly detector for industrial temperature data, deployed unattended on a $6/mo VPS via cron

🛠️ Skills

Languages & Frameworks
Python PyTorch Stable-Baselines3 MATLAB Linux pandas

Areas
Reinforcement Learning Multi-Agent Systems Hyperparameter Studies Time-Series Analysis Anomaly Detection Control Theory VPS Deployment


📂 Projects

Project Description Stack
bsm2-marl MARL for wastewater treatment plant control — MSc Thesis Python · PyTorch · MATLAB/Simulink
rl-sweep 120-run PPO vs DQN sweep across 3 Gymnasium envs — discovered & explained a policy-collapse failure mode Python · Stable-Baselines3 · Gymnasium · multiprocessing
grain-sentinel STL anomaly detector deployed on a $6/mo VPS — 88% recall, 52% precision Python · pandas · statsmodels · Linux/cron

🏃 Beyond the code

When I'm not training neural networks, I'm training myself — competing in track & field for Académica de Coimbra.


Open to Remote or Hybrid ML/AI Engineer roles, plus freelance work in ML/AI and Python. Feel free to reach out!

Pinned Loading

  1. bsm2-marl bsm2-marl Public

    Multi-agent RL for wastewater treatment plant control (BSM2/Simulink) — MSc Thesis

    Python 1

  2. grain-sentinel grain-sentinel Public

    Jupyter Notebook

  3. rl-sweep rl-sweep Public

    120-run PPO vs DQN hyperparameter sweep across 3 Gymnasium environments — reproducible parallel infrastructure and a documented policy-collapse failure mode.

    Python