Robustness Reproduction with Machine Learning
DOI:
https://doi.org/10.52825/gjae.v75i.3085Keywords:
Machine Learning, Robustness Reproduction, Replication, P-Value Debate, Agricultural PolicyAbstract
We conduct a robustness reproduction of Ammann et al. (2023), published in Food Quality and Preference, who examine how consumers evaluate the importance of animal welfare as an agricultural policy goal relative to potentially competing objectives. Using the publicly available data, we first provide a reproduction of the original results and then perform a robustness reproduction that relaxes the linearity assumption through a Machine Learning (ML) work-flow. The original association patterns are reproducible, while the ML extension uncovers modest nonlinearities with limited gains in explanatory power. Overall, this study illustrates a simple and transparent workflow that complements standard OLS-based replication with data-driven specifications, thereby supporting transparency and reproducibility in applied agricultural economics.
Downloads
References
Ammann, J., Mack, G., Irek, J., Finger, R., El Benni, N. (2023): Consumers’ meat commitment and the importance of animal welfare as agricultural policy goal. Food Quality and Prefer-ence 112: 105010. https://doi.org/10.1016/j.foodqual.2023.105010.
Ammann, J., Mack, G., Irek, J., Finger, R., El Benni, N. (2024): Data on Swiss citizens' prefer-ences and perceptions of agricultural policy. Data in Brief 52: 110042. https://doi.org/10.1016/j.dib.2024.110042.
Ammann, J., Arbenz, A., Mack, G., Siegrist, M. (2025): Consumer support of policy measures to increase sustainability in food consumption. Food Policy 131: 102822. https://doi.org/10.1016/j.foodpol.2025.102822.
Ankel-Peters, J., Brodeur, A., Dreber, A., Johannesson, M., Neubauer, F., Rose, J. (2025): A protocol for structured robustness reproductions and replicability assessments. Q Open 5 (3): qoaf004. https://doi.org/10.1093/qopen/qoaf004.
Aurbacher, J., Bahrs, E., Banse, M., Hess, S., Hirsch, S., Hüttel, S., Latacz-Lohmann, U., Mußhoff, O., Odening, M., Teuber, R. (2024): Comments on the p-value debate and good statistical practice. German Journal of Agricultural Economics 73 (1): 1-3. https://doi.org/10.52825/gjae.v73i1.988.
Belloni, A., Chernozhukov, V. (2013): Least squares after model selection in high-dimensional sparse models. Bernoulli 19 (2): 521-547. https://doi.org/10.3150/11-BEJ410.
Belloni, A., Chernozhukov, V., Hansen, C. (2014): Inference on treatment effects after selec-tion among high-dimensional controls. Review of Economic Studies 81 (2): 608-650. https://doi.org/10.1093/restud/rdt044.
Bien, J., Taylor, J., Tibshirani, R. (2013): A lasso for hierarchical interactions. The Annals of Statistics 41 (3): 1111-1141. https://doi.org/10.1214/13-AOS1096.
Bittmann, T. (2025): A practical guide from ordinary least squares to causal machine learning. International Food and Agribusiness Management Review 28 (2): 457-486. https://doi.org/10.22434/IFAMR.1087.
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., Robins, J. (2018): Double/debiased machine learning for treatment and structural parameters. The Econometrics Journal 21 (1): C1-C68. https://doi.org/10.1111/ectj.12097.
Choi, N.H., Li, W., Zhu, J. (2010): Variable selection with the strong heredity constraint and its oracle property. Journal of the American Statistical Association 105 (489): 354-364. https://doi.org/10.1198/jasa.2010.tm08281.
Cinelli, C., Forney, A., Pearl, J. (2024): A crash course in good and bad controls. Sociological Methods & Research 53 (3): 1071-1104. https://doi.org/10.1177/00491241221099552.
Damm, J. (2007): The Internet and the fragmentation of Chinese society. Critical Asian Stud-ies 39 (2): 273-294. https://doi.org/10.1080/14672710701339485.
El Benni, N., Irek, J., Finger, R., Mack, G., Ammann, J. (2024): Citizens’ perceptions of agri-cultural policy goals—evidence from Switzerland. Food Policy 125: 102643. https://doi.org/10.1016/j.foodpol.2024.102643.
Finger, R., Grebitus, C., Henningsen, A. (2023): Replications in agricultural economics. Ap-plied Economic Perspectives and Policy 45 (3): 1258-1274. https://doi.org/10.1002/aepp.13386.
Freijeiro-González, L., Febrero-Bande, M., González-Manteiga, W. (2022): A critical review of LASSO and its derivatives for variable selection under dependence among covariates. In-ternational Statistical Review 90 (1): 118-145. https://doi.org/10.1111/insr.12469.
Friedman, J., Hastie, T., Tibshirani, R. (2010): A note on the group lasso and a sparse group lasso. arXiv:1001.0736. https://arxiv.org/abs/1001.0736.
Hao, N., Feng, Y., Zhang, H.H. (2018): Model selection for high-dimensional quadratic regres-sion via regularization. Journal of the American Statistical Association 113 (522): 615-625. https://doi.org/10.1080/01621459.2016.1264956.
Hastie, T., Tibshirani, R., Friedman, J. (2009): The elements of statistical learning: Data min-ing, inference, and prediction. Springer. https://doi.org/10.1007/978-0-387-84858-7.
Hawinkel, S., Waegeman, W., Maere, S. (2024): Out-of-sample R²: estimation and inference. The American Statistician 78 (1): 15-25. https://doi.org/10.1080/00031305.2023.2216252.
Heckelei, T., Hüttel, S., Odening, M., Rommel, J. (2023): The p-value debate and statistical (mal)practice—implications for the agricultural and food economics community. German Journal of Agricultural Economics 72 (1): 47-67. https://doi.org/10.30430/gjae.2023.0231.
Hirschauer, N., Grüner, S., Mußhoff, O., Becker, C. (2019): Twenty steps towards an adequate inferential interpretation of p-values in econometrics. Jahrbücher für Nationalökonomie und Statistik 239 (4): 703-721. https://doi.org/10.1515/jbnst-2018-0069.
Huang, J., Ma, S., Zhang, C.-H. (2008): Adaptive LASSO for sparse high-dimensional regres-sion models. Statistica Sinica 18 (4): 1603-1618.
Hünermund, P., Louw, B., Caspi, I. (2023): Double machine learning and automated con-founder selection: A cautionary tale. Journal of Causal Inference 11 (1): 20220078. https://doi.org/10.1515/jci-2022-0078.
Hüttel, S., Hess, S. (2024): Are lessons being learnt from the replication crisis or will the revo-lution devour its children? Open Q science from the editor's perspective. Q Open 5 (3): qoae019. https://doi.org/10.1093/qopen/qoae019.
Hüttel, S., Rommel, J., Teuber, R., Banse, M., Grebitus, C. (2025): GJAE is preparing for fu-ture developments in the scientific system: New policies regarding data and AI. German Journal of Agricultural Economics 74: 1-9. https://doi.org/10.52825/gjae.v74i.2824.
Kulkarni, K., Rossi, D. (2023): Determinants of downside risk exposure: An analysis of Korean rice farms using partial and quantile moments. Applied Economic Perspectives and Policy 45 (3): 1356-1373. https://doi.org/10.1002/aepp.13320.
Lee, Y., Li, Q., Çakır, M. (2023): Elasticities of substitution between marketing and farm inputs in a complete system of food commodities. Applied Economic Perspectives and Policy 45 (3): 1450-1471. https://doi.org/10.1002/aepp.13322.
Leng, C., Lin, Y., Wahba, G. (2006): A note on the LASSO and related procedures in model selection. Statistica Sinica 16 (4): 1273-1284.
Li, F., Lai, L., Cui, S. (2021): On the adversarial robustness of LASSO-based feature selection. IEEE Transactions on Signal Processing 69: 5555-5567. https://doi.org/10.1109/TSP.2021.3115943.
Lim, M., Hastie, T. (2015): Learning interactions via hierarchical group-lasso regularization. Journal of Computational and Graphical Statistics 24 (3): 627-654. https://doi.org/10.1080/10618600.2014.938812.
Makowska, M., Boguszewski, R., Hrehorowicz, A. (2024): Generational differences in food choices and consumer behaviors in the context of sustainable development. Foods 13 (4): 521. https://doi.org/10.3390/foods13040521.
Maruejols, L., Höschle, L., Yu, X. (2022): Vietnam between economic growth and ethnic diver-gence: A LASSO examination of income-mediated energy consumption. Energy Econom-ics 114: 106222. https://doi.org/10.1016/j.eneco.2022.106222.
Navarro, A., López-Bao, J.V. (2019): EU agricultural policy still not green. Nature Sustainabil-ity 2 (11): 990-990. https://doi.org/10.1038/s41893-019-0424-x.
Ölkers, T., Mußhoff, O. (2024): Exploring the role of interest rates, macroeconomic environ-ment, agricultural cycle, and gender on loan demand in the agricultural sector: Evidence from Mali. Agribusiness 40 (2): 484-512. https://doi.org/10.1002/agr.21891.
Richter, S., Stolz, H., Martinez-Cruz, A.L., Kachi, A. (2025): Animal welfare has priority: Swiss consumers’ preferences for animal welfare, greenhouse gas reductions and other sustaina-bility improvements in dairy products. Food Quality and Preference 123: 105350. https://doi.org/10.1016/j.foodqual.2024.105350.
Sant'Anna, A.C., Katchova, A.L. (2023): How economic conditions changed the number of US farms, 1960-1988: A replication and extension of Gale (1990) to midsize farms in the United
States and abroad. Applied Economic Perspectives and Policy 45 (3): 1400-1426. https://doi.org/10.1002/aepp.13306.
Schmidt, L., Heydarli, M., Filler, G., Odening, M. (2025): Using cubic splines in crop insurance models - A replication study. German Journal of Agricultural Economics 74: 1-31. https://doi.org/10.52825/gjae.v74i.2635.
Speiser, J.L., Miller, M.E., Tooze, J., Ip, E. (2019): A comparison of random forest variable selection methods for classification prediction modeling. Expert Systems with Applications 134: 93-101. https://doi.org/10.1016/j.eswa.2019.05.028.
Spindler, M. (2016): Lasso for instrumental variable selection: A replication study. Journal of Applied Econometrics 31 (2): 450-454. https://doi.org/10.1002/jae.2432.
Tibshirani, R. (1996): Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 58 (1): 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x.
Wimmer, S., Dakpo, K.H. (2023): Components of agricultural productivity change: Replication of US evidence and extension to the EU. Applied Economic Perspectives and Policy 45 (3): 1332-1355. https://doi.org/10.1002/aepp.13377.
Yuan, M., Lin, Y. (2006): Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society Series B: Statistical Methodology 68 (1): 49-67. https://doi.org/10.1111/j.1467-9868.2005.00532.x.
Zhao, P., Rocha, G., Yu, B. (2006): The composite absolute penalties family for grouped and hierarchical variable selection. The Annals of Statistics 37 (6A): 3468-3497, December 2009. http://www.jstor.org/stable/25662200.
Zou, H. (2006): The adaptive lasso and its oracle properties. Journal of the American Statisti-cal Association 101 (476): 1418-1429. https://doi.org/10.1198/016214506000000735.
Zou, H., Hastie, T. (2005): Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67 (2): 301-320. https://doi.org/10.1111/j.1467-9868.2005.00503.x.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Thomas Bittmann, Lucie Maruejols
This work is licensed under a Creative Commons Attribution 4.0 International License.