Contextual bandits-guided local search for solving air cargo palletisation problem

Air transport; complete shipment; contextual bandits; local search heuristic; three-dimensional bin packing; Strategy and Management; Management Science and Operations Research; Industrial and Manufacturing Engineering

Abstract :

[en] In this paper, we address the challenges of efficiently assigning items to Unit Load Devices within the air cargo industry. We present a comprehensive formulation of the three-dimensional air cargo palletisation problem, focussing on cost minimisation and incorporating grouping, positioning, and compatibility constraints. We propose a set of 12 resolution approaches that utilise contextual bandits-guided local search heuristics. We conduct a thorough benchmark experiment to evaluate the performance of our proposed methods. Two objective functions, namely unused volume and costs are employed to underscore the significance of cost minimisation in air cargo palletisation. Furthermore, we address instances encompassing grouping, positioning, and compatibility constraints, enabling us to explore the managerial insights these constraints offer and assess the benefits of integrating cost-reduction strategies. The findings provide valuable insights for decision-makers involved in optimising air cargo palletisation operations.

Disciplines :

Quantitative methods in economics & management

Author, co-author :

Achamrah, Fatima Ezzahra ; Sheffield University Management School, The University of Sheffield, Sheffield, United Kingdom ; Centre for management science (CGS), CNRS, Mines Paris, PSL University, Paris, France

Limbourg, Sabine ; Université de Liège - ULiège > HEC Liège : UER > UER Opérations : Logistique

Language :

English

Title :

Contextual bandits-guided local search for solving air cargo palletisation problem

Publication date :

2025

Journal title :

International Journal of Production Research

ISSN :

0020-7543

eISSN :

1366-588X

Publisher :

Taylor and Francis Ltd.

Pages :

1-22

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

https://www.tandfonline.com/doi/pdf/10.1080/00207543.2025.2473066

Available on ORBi :

since 13 May 2025

Statistics

Number of views

90 (1 by ULiège)

Number of downloads

43 (1 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

Abeyratne, Ruwantissa., 2018. Regulation of Air Cargo, 129–155. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-92489-2_4.
Achamrah, Fatima Ezzahra, Fouad, Riane, and Sabine, Limbourg. 2021. “Solving Inventory Routing with Transshipment and Substitution under Dynamic and Stochastic Demands Using Genetic Algorithm and Deep Reinforcement Learning.” International Journal of Production Research60 (20): 6187–6204. https://doi.org/10.1080/00207543.2021.1987549.
Achamrah, Fatima Ezzahra, Fouad, Riane, Evren, Sahin, and Sabine, Limbourg. 2022. “An Artificial-Immune-System-Based Algorithm Enhanced with Deep Reinforcement Learning for Solving Returnable Transport Item Problems.” Sustainability14 (10): 5805. https://doi.org/10.3390/su14105805.
Agrawal, Shipra, and Navin, Goyal. 2013. “Thompson Sampling for Contextual Bandits with Linear Payoffs.” In International Conference on Machine Learning, 127–135. PMLR.
Alvarez-Valdés, Ramón, Francisco, Parreño, and José Manuel, Tamarit. 2013. “A GRASP/Path Relinking Algorithm for Two-and Three-Dimensional Multiple Bin-Size Bin Packing Problems.” Computers & Operations Research40 (12): 3081–3090. https://doi.org/10.1016/j.cor.2012.03.016.
Alvarez-Valdes, R., F., Parreño, and J. M., Tamarit. 2015. “Lower Bounds for Three-Dimensional Multiple-Bin-Size Bin Packing Problems.” OR Spectrum37 (1): 49–74. https://doi.org/10.1007/s00291-013-0347-2.
Angelelli, Enrico, Claudia, Archetti, and Lorenzo, Peirano. 2022. “A Heuristic Algorithm for the Air Transport Unit Consolidation Problem.” arXiv https://arxiv.org/abs/2210.06004.
Auer, Peter., 2002. “Using Confidence Bounds for Exploitation-Exploration Trade-Offs.” Journal of Machine Learning Research3 (Nov): 397–422.
Battarra, Maria, Michele, Monaci, and Daniele, Vigo. 2009. “An Adaptive Guidance Approach for the Heuristic Solution of a Minimum Multiple Trip Vehicle Routing Problem.” Computers & Operations Research36 (11): 3041–3050. https://doi.org/10.1016/j.cor.2009.02.008.
Baxter, Glenn, and Kyriakos, Kourousis. 2015. “Temperature Controlled Aircraft Unit Load Devices: The Technological Response to Growing Global Air Cargo Cool Chain Requirements.” Journal of Technology Management & Innovation10 (1): 157–172. https://doi.org/10.4067/S0718-27242015000100012.
Bietti, Alberto, Alekh, Agarwal, and John, Langford. 2018. “A Contextual Bandit Bake-Off.” arXiv. https://arxiv.org/abs/1802.04064.
Bombelli, Alessandro, and Stefano, Fazi. 2022. “The Ground Handler Dock Capacitated Pickup and Delivery Problem with Time Windows: A Collaborative Framework for Air Cargo Operations.” Transportation Research Part E: Logistics and Transportation Review159:102603. https://doi.org/10.1016/j.tre.2022.102603.
Bookbinder, James H., Samir, Elhedhli, and Zichao, Li. 2015. “The Air-Cargo Consolidation Problem with Pivot Weight: Models and Solution Methods.” Computers & Operations Research59:22–32. https://doi.org/10.1016/j.cor.2014.11.015.
Bouneffouf, Djallel, Irina, Rish, and Charu, Aggarwal. 2020. “Survey on Applications of Multi-Armed and Contextual Bandits.” In 2020 IEEE Congress on Evolutionary Computation (CEC), 1–8. IEEE.
Brandt, Felix., 2017. “The Air Cargo Load Planning Problem.” Accessed August 12, 2022.
Brandt, Felix, and Stefan, Nickel. 2019. “The Air Cargo Load Planning Problem–A Consolidated Problem Definition and Literature Review on Related Problems.” European Journal of Operational Research275 (2): 399–410. https://doi.org/10.1016/j.ejor.2018.07.013.
Chan, Felix T. S., Rajat, Bhagwat, N., Kumar, M. K., Tiwari, and Philip, Lam. 2006. “Development of a Decision Support System for Air-Cargo Pallets Loading Problem: A Case Study.” Expert Systems with Applications31 (3): 472–485. https://doi.org/10.1016/j.eswa.2005.09.057.
Chapelle, Olivier, and Lihong, Li. 2011. “An Empirical Evaluation of Thompson Sampling.” Advances in Neural Information Processing Systems24: 2249–2257.
Chen, Xi, Yining, Wang, and Yuan, Zhou. 2020. “Dynamic Assortment Optimization with Changing Contextual Information.” Journal of Machine Learning Research21 (216): 1–44.
Cortes, David., 2018. “Adapting Multi-Armed Bandits Policies to Contextual Bandits Scenarios.” arXiv. https://arxiv.org/abs/1811.04383.
Crainic, Teodor Gabriel, Guido, Perboli, Walter, Rei, and Roberto, Tadei. 2011. “Efficient Lower Bounds and Heuristics for the Variable Cost and Size Bin Packing Problem.” Computers & Operations Research38 (11): 1474–1482. https://doi.org/10.1016/j.cor.2011.01.001.
Crainic, Teodor Gabriel, Guido, Perboli, and Roberto, Tadei. 2008. “Extreme Point-Based Heuristics for Three-Dimensional Bin Packing.” INFORMS Journal on Computing20 (3): 368–384. https://doi.org/10.1287/ijoc.1070.0250.
Dangerous Goods Panel. 1995. “Development of Recommendations for Amendments to the Technical Instructions for the Safe Transport of Dangerous Goods by Air for incorporation in the 2007–2008 Edition.” Accessed August 15, 2022. https://www.icao.int/safety/DangerousGoods/DGP20%20Working%20Papers/DGP.20.IP.001.pdf.
Desai, Jitamitra, Sandeep, Srivathsan, Woen Yon, Lai, Liqun, Li, and Chuhang, Yu. 2023. “An Optimization-Based Decision Support Tool for Air Cargo Loading.” Computers & Industrial Engineering175:108816. https://doi.org/10.1016/j.cie.2022.108816.
Dudik, Miroslav, John, Langford, and Lihong, Li. 2011. “Doubly Robust Policy Evaluation and Learning.” https://arxiv.org/abs/1103.4601.
Elhedhli, Samir, Fatma, Gzara, and Burak, Yildiz. 2019. “Three-Dimensional Bin Packing and Mixed-Case Palletization.” INFORMS Journal on Optimization1 (4): 323–352. https://doi.org/10.1287/ijoo.2019.0013.
Feng, Bo, Yanzhi, Li, and Zuo-Jun Max, Shen. 2015. “Air Cargo Operations: Literature Review and Comparison with Practices.” Transportation Research Part C: Emerging Technologies56:263–280. https://doi.org/10.1016/j.trc.2015.03.028.
Hamdi-Dhaoui, Khaoula, Nacima, Labadie, and Alice, Yalaoui. 2014. “The Bi-Objective Two-Dimensional Loading Vehicle Routing Problem with Partial Conflicts.” International Journal of Production Research52 (19): 5565–5582. https://doi.org/10.1080/00207543.2014.885181.
Huang, Kuancheng, and Wenhou, Chi. 2007. “A Lagrangian Relaxation Based Heuristic for the Consolidation Problem of Airfreight Forwarders.” Transportation Research Part C: Emerging Technologies15 (4): 235–245. Modeling and Optimization for Transportation Logistics. https://doi.org/10.1016/j.trc.2006.08.006.
IATA. 2021. “Air Cargo Market Analysis.” https://www.iata.org/en/iata-repository/publications/economic-reports/air-freight-monthly-analysis–december-2021/.
IATA. 2023a. European Air Cargo Programme Handbook. International Air Transport Association (IATA). Accessed August 21, 2024. https://www.iata.org/contentassets/e9cb5a72b88f4f68a5cfc572a50b60c9/eacph-european-air-cargo-programme-handbook.pdf.
IATA. 2023b. “What Types of Cargo are Transported by Air?” May. Accessed May 31, 2023. https://www.iata.org/en/publications/newsletters/iata-knowledge-hub/what-types-of-cargo-are-transported-by-air.
ICAO. 2017. “Dangerous Goods Panel, Working Group Meeting (DGP-WG/17).” https://www.icao.int/safety/DangerousGoods/WG17/DGPWG.17.WP.001.2.en.pdf.
The International Air Cargo Association (TIACA). 2020. “TIACA Calls for the Use of the Dynamic Load Factor Methodology to Measure Air Cargo Performance.” https://tiaca.org/tiaca-calls-for-the-use-of-the-dynamic-load-factor-methodology-to-measure-air-cargo-performance/.
Juan, Angel A, Peter, Keenan, Rafael, Martí, Seán, McGarraghy, Javier, Panadero, Paula, Carroll, and Diego, Oliva. 2021. “A Review of the Role of Heuristics in Stochastic Optimisation: From Metaheuristics to Learnheuristics.” Annals of Operations Research320 (2): 831–861.
Jun, Sungbum, Chul Hun, Choi, and Seokcheon, Lee. 2022. “Scheduling of Autonomous Mobile Robots with Conflict-Free Routes Utilising Contextual-Bandit-Based Local Search.” International Journal of Production Research60 (13): 4090–4116. https://doi.org/10.1080/00207543.2022.2063085.
Lee, No-San, Philipp Gabriel, Mazur, Moritz, Bittner, and Detlef, Schoder. 2021. “An Intelligent Decision-Support System for Air Cargo Palletizing.” January. Accessed August 10, 2022. https://scholarspace.manoa.hawaii.edu/items/85427938-716c-4d49-9dda-46deac276745.
Li, Zichao, James H., Bookbinder, and Samir, Elhedhli. 2012. “Optimal Shipment Decisions for An Airfreight Forwarder: Formulation and Solution Methods.” Transportation Research Part C: Emerging Technologies21 (1): 17–30. https://doi.org/10.1016/j.trc.2011.08.001.
Li, Tzuu-Hseng S., Chih-Yin, Liu, Ping-Huan, Kuo, Nien-Chu, Fang, Cheng-Hui, Li, Ching-Wen, Cheng, Cheng-Ying, Hsieh, Li-Fan, Wu, Jie-Jhong, Liang, and Chih-Yen, Chen. 2017. “A Three-Dimensional Adaptive PSO-Based Packing Algorithm for An IoT-Based Automated E-Fulfillment Packaging System.” IEEE Access5:9188–9205. https://doi.org/10.1109/ACCESS.2017.2702715.
Limbourg, S, M, Schyns, and G, Laporte. 2012. “Automatic Aircraft Cargo Load Planning.” Journal of the Operational Research Society63 (9): 1271–1283. https://doi.org/10.1057/jors.2011.134.
The Loadstar. 2021. “IATA's Poorly Determined Cargo Load Factors Leave Observers Stupefied.” https://theloadstar.com/iatas-poorly-determined-cargo-load-factors-leave-observers-stupefied/.
Lu, Tyler, Dávid, Pál, and Martin, Pál. 2010. “Contextual Multi-Armed Bandits.” In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 485–492. JMLR Workshop and Conference Proceedings.
Lurkin, Virginie, and Michaël, Schyns. 2015. “The Airline Container Loading Problem with Pickup and Delivery.” European Journal of Operational Research244 (3): 955–965. https://doi.org/10.1016/j.ejor.2015.02.027.
Nascimento, Oliviana Xavier, Thiago Alves, de Queiroz, and Leonardo, Junqueira. 2021. “Practical Constraints in the Container Loading Problem: Comprehensive Formulations and Exact Algorithm.” Computers & Operations Research128:105186. https://doi.org/10.1016/j.cor.2020.105186.
Paquay, Célia., 2017. “The Three-Dimensional Rectangular Multiple Bin Size Bin Packing Problem with Transportation Constraints: A Case Study in the Field of Air Transportation.” PhD diss., ULiège–Université de Liège.
Paquay, Célia, Sabine, Limbourg, and Michaël, Schyns. 2018. “A Tailored Two-Phase Constructive Heuristic for the Three-Dimensional Multiple Bin Size Bin Packing Problem with Transportation Constraints.” European Journal of Operational Research267 (1): 52–64. https://doi.org/10.1016/j.ejor.2017.11.010.
Paquay, Célia, Sabine, Limbourg, Michaël, Schyns, and José Fernando, Oliveira. 2018. “MIP-based Constructive Heuristics for the Three-Dimensional Bin Packing Problem with Transportation Constraints.” International Journal of Production Research56 (4): 1581–1592. https://doi.org/10.1080/00207543.2017.1355577.
Paquay, Célia, Michael, Schyns, and Sabine, Limbourg. 2016. “A Mixed Integer Programming Formulation for the Three-Dimensional Bin Packing Problem Deriving from An Air Cargo Application.” International Transactions in Operational Research23 (1–2): 187–213. https://doi.org/10.1111/itor.2016.23.issue-1-2.
Pollaris, Hanne, Kris, Braekers, An, Caris, Gerrit K, Janssens, and Sabine, Limbourg. 2015. “Vehicle Routing Problems with Loading Constraints: State-of-the-Art and Future Directions.” OR Spectrum37 (2): 297–330. https://doi.org/10.1007/s00291-014-0386-3.
Rodrigue, Jean-Paul., 2020. The Geography of Transport Systems. Andover: Taylor & Francis.
Sui, Guoxin, and Yong, Yu. 2020. “Bayesian Contextual Bandits for Hyper Parameter Optimization.” IEEE Access8:42971–42979. https://doi.org/10.1109/ACCESS.2020.2977129.
Sun, Jiankun, Dennis J., Zhang, Haoyuan, Hu, and Jan A., Van Mieghem. 2022. “Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations.” Management Science68 (2): 846–865. https://doi.org/10.1287/mnsc.2021.3990.
Thompson, William R., 1933. “Biometrika Trust.” Biometrika25 (3/4): 285–294. https://doi.org/10.2307/2332286.
Tresca, Giulia, Graziana, Cavone, Raffaele, Carli, Antonio, Cerviotti, and Mariagrazia, Dotoli. 2022. “Automating Bin Packing: A Layer Building Matheuristics for Cost Effective Logistics.” IEEE Transactions on Automation Science and Engineering19 (3): 1599–1613. https://doi.org/10.1109/TASE.2022.3177422.
Tseremoglou, Iordanis, Alessandro, Bombelli, and Bruno F., Santos. 2022. “A Combined Forecasting and Packing Model for Air Cargo Loading: A Risk-Averse Framework.” Transportation Research Part E: Logistics and Transportation Review158:102579. https://doi.org/10.1016/j.tre.2021.102579.
UN. 2019. “Transport of Dangerous Goods.” https://unece.org/fileadmin/DAM/trans/danger/publi/unrec/rev21/ST-SG-AC10-1r21e_Vol1_WEB.pdf.
Van Asch, Thomas., 2022. “Chapter 16–The Forwarders' Power Play Effect on Competition in the Air Cargo Industry.” In The Air Transportation Industry, edited by Rosário Macário and Eddy Van de Voorde, Contemporary Issues in Air Transport, 361–381. Elsevier. https://www.sciencedirect.com/science/article/pii/B9780323915229000038.
Wang, Yu-Xiang, Alekh, Agarwal, and Miroslav, Dudık. 2017. “Optimal and Adaptive Off-Policy Evaluation in Contextual Bandits.” 3589–3597.
Wäscher, Gerhard, Heike, Hauβner, and Holger, Schumann. 2007. “An Improved Typology of Cutting and Packing Problems.” European Journal of Operational Research183 (3): 1109–1130. https://doi.org/10.1016/j.ejor.2005.12.047.
Wong, Eugene Y. C., and Kev K. T., Ling. 2020. “A Mixed Integer Programming Approach to Air Cargo Load Planning with Multiple Aircraft Configurations and Dangerous Goods.” 123–130. https://doi.org/10.1109/ICFIE50845.2020.9266727.
Yu, Tong, Branislav, Kveton, and Ole J., Mengshoel. 2017. “Thompson Sampling for Optimizing Stochastic Local Search.” In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 493–510. Springer.
Zhao, X., Y., Yuan, Y., Dong, and R., Zhao. 2021. “Optimization Approach to the Aircraft Weight and Balance Problem with the Centre of Gravity Envelope Constraints.” IET Intelligent Transport Systems15 (10): 1269–1286. https://doi.org/10.1049/itr2.v15.10.
Zheng, Jiongzhi, Kun, He, Jianrong, Zhou, Yan, Jin, Chu-Min, Li, and Felip, Manya. 2022. “Bandmaxsat: A Local Search MaxSAT Solver with Multi-Armed Bandit.” arXiv preprint arXiv:2201.05544.