homeprojectscontact

hi Herbert here. 👋

21yo software engineer based in India.

AI/ML Engineer | Deep Learning • Reinforcement Learning • Robotics I build fun and cool things.

Wood N Beyond

Wood N Beyond

Web Technologies Freelancer

2024 – 2025
  • Designed and deployed a production-ready ReactJS website, improving client visibility by 40%.
  • Optimized frontend workflows improving load times and retention.

featured projects

view more →
Reinforcement Learning for Genome Editing

Reinforcement Learning for Genome Editing

A simulation-driven genome editing framework that models DNA sequences as dynamic environments. Reinforcement learning agents trained with DQN and PPO learn to perform codon-aware nucleotide edits, optimizing edit accuracy while minimizing off-target mutations. The system demonstrates how sequential decision-making can be applied to complex biological editing problems, achieving faster convergence and higher precision compared to heuristic methods.

PythonPyTorchReinforcement LearningDQNPPOBioinformatics
MFIDS – Multi-Faceted Intruder Detection System

MFIDS – Multi-Faceted Intruder Detection System

A smart, camera-based security platform , designed to be fully programmable and extensible. MFIDS uses real-time computer vision to detect and recognize people, triggering automated actions such as unlocking doors or activating connected devices for authorized users. When unknown individuals are detected, the system raises alerts and flags anomalies, making it adaptable to a wide range of security and access-control scenarios beyond just door locks.

PythonOpenCVYOLOComputer VisionSecurity SystemsIoT Integration