Counting Error before Counting Accuracy: A Reproducibility Audit of Sorghum Panicle Metrics

Abstract

Automated panicle counting can make field phenotyping more scalable, but its evaluation depends on a traceable relationship between predictions and reported error measures. This article performs a secondary arithmetic audit of the ten rows in a published sorghum counting table. All ten reported root mean squared errors are smaller than their corresponding mean absolute errors. That ordering is incompatible with the standard definitions if the measures use identical scalar errors, weights, and units. The reported root mean squared errors also lie within 0.054 of the square roots of the reported mean absolute errors, an exploratory numerical pattern that does not identify the original computation. Without raw predictions, no corrected performance estimate can be recovered. The article then develops a field-oriented evaluation design addressing spatial splitting, object formation, density-dependent error, and annotation uncertainty. It reports no new image processing or network training. The contribution is a reproducible audit and a specification of the evidence needed to interpret counting performance. Keywords: sorghum; panicle counting; UAV imagery; metric consistency; spatial validation; phenotyping.

PDF
HTML

References

Lin, Zhe and Wenxuan Guo. “Sorghum panicle detection and counting using unmanned aerial system images and deep learning.” Frontiers in Plant Science, vol. 11, 2020. https://doi.org/10.3389/fpls.2020.534853.

Tong, H., Xu, G., & Chen, Y. (2026, May). Hadamard Tensor Ring for Efficient Low-Rank Fine-Tuning. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Lecture Notes in Computer Science, 2015, pp. 234-241. https://doi.org/10.1007/978-3-319-24574-4_28.

Roberts, David R., et al. “Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure.” Ecography, vol. 40, no. 8, 2017, pp. 913-929. https://doi.org/10.1111/ecog.02881.

Valavi, Roozbeh, Jane Elith, José J. Lahoz‐Monfort, and Gurutzeta Guillera‐Arroita. “blockCV: An R package for generating spatially or environmentally separated folds for k-fold cross-validation of species distribution models.” Methods in Ecology and Evolution, vol. 10, no. 2, 2019, pp. 225-232. https://doi.org/10.1111/2041-210x.13107.

Hyndman, Rob J. and Anne B. Koehler. “Another look at measures of forecast accuracy.” International Journal of Forecasting, vol. 22, no. 4, 2006, pp. 679-688. https://doi.org/10.1016/j.ijforecast.2006.03.001.

White, Halbert. “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity.” Econometrica, vol. 48, no. 4, 1980, pp. 817–838. https://doi.org/10.2307/1912934.

Fiorani, Fabio and Ulrich Schurr. “Future Scenarios for Plant Phenotyping.” Annual Review of Plant Biology, vol. 64, no. 1, 2013, pp. 267-291. https://doi.org/10.1146/annurev-arplant-050312-120137.

Gebbers, Robin and Viacheslav I. Adamchuk. “Precision Agriculture and Food Security.” Science, vol. 327, no. 5967, 2010, pp. 828-831. https://doi.org/10.1126/science.1183899.

Hu, Edward J., et al. “LoRA: Low-Rank Adaptation of Large Language Models.” International Conference on Learning Representations, 2022. https://openreview.net/forum?id=nZeVKeeFYf9.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Copyright (c) 2026 Trevor Lawson, Spencer Coleman, Derek Bailey (Author)