Role: Systems Engineer & Lead Developer
Tech Stack: Unity3D, C#, ESP32 Microcontrollers, Computer Vision (Homography), UDP Telemetry, HTTP REST
Domain: Defense Technologies, Tactical Training, Hardware-in-the-Loop Simulation
Executive Summary
Developed AIM-SIM, an advanced hardware-in-the-loop tactical marksmanship simulator designed to meet defense industry training standards. By bridging custom ESP32-integrated weapon replicas with a real-time computer vision tracking system, AIM-SIM provides a risk-free, highly repeatable, and data-driven combat environment. The system translates physical trigger pulls and laser projections into precise digital ballistics, allowing operators to build genuine muscle memory and tactical readiness without the logistical costs of live-fire exercises.
Engineering & Technical Milestones
Real-Time Telemetry & Homography Transformation: Engineered a zero-latency UDP communication pipeline to process high-frequency laser detection telemetry. Implemented a complex Homography matrix calculation (Gaussian Elimination) to flawlessly map physical camera coordinates into the 3D rendering engine, ensuring sub-millimeter ballistic precision.
Hardware-in-the-Loop Architecture: Developed a bi-directional RESTful network interface to synchronize the virtual simulation with physical weapon hardware. Successfully managed real-time hardware states, including dynamic fire modes (Semi/Full-Auto), ammunition depletion, and physical burst timings.
Data-Driven After Action Reports (AAR): Architected a comprehensive analytics engine that evaluates operator performance across various metrics (reaction time, grouping spread/deviation, hit factor, and civilian casualty rates). The system automatically compiles these diagnostics into exported CSV logs, providing instructors with quantifiable, military-grade performance data.
Dynamic Scenario Generation: Programmed versatile, algorithm-driven training modules including Threat Discrimination, Snap Shooting, and Zeroing & Grouping. Integrated complex target mechanics (pop-up stands, moving rails, hostile/civilian classification) alongside meticulously designed sensory feedback (tactical lighting and auditory cues) to maximize cognitive immersion under stress.