<p>The objective of the study was to independently validate a calibrated commercial handheld near infrared (NIR) spectroscopic device and test its repeatability over time using phenotypically diverse populations of Australian lamb. Validation testing in eight separate data sub-groups (n = 1591 carcasses overall) demonstrated that the NIR device had moderate precision (R2 = 0.4–0.64, RMSEP = 0.70–1.22%) but fluctuated in accuracy between experimental site demonstrated by variable slopes (0.50–0.94) and biases (− 0.86–0.02). The repeatability experiment (n = 10 carcasses) showed that time to scan post quartering affected NIR measurement from 0 to 24 h (P < 0.001). On average, NIR IMF% was 0.97% lower (P < 0.001) at 24 h (4.01% ± 0.166), compared to 0 h. There was no difference (P > 0.05) between Time 0 and 1 h or Time 0 and 4 h or between replicate scans within each time point. This study demonstrated the SOMA NIR device could predict lamb chemical IMF% with moderate precision and accuracy, however additional work is required to understand how loin preparation, blooming and surface hydration affect NIR measurement.</p>