Crane Mat Layout Optimization Based on Agent-Based Greedy and Reinforcement-Learning Approach
Publication: Journal of Construction Engineering and Management
Volume 149, Issue 8
Abstract
The growing prevalence of modular construction, while it offers benefits in terms of productivity and sustainability, has led to increased use of heavy mobile cranes and related resources on construction sites. One significant resource associated with crane use is the crane mat, which offers practical mobile crane ground support against poor soil-bearing capacity. Due to increased use of crane mats, crane mat layout plans/drawings have become increasingly significant in today’s construction industry. The present work describes an automated crane mat optimization framework for preparing crane mat layout plans/drawings built on an agent-based greedy algorithm and reinforcement learning. The proposed framework employs these approaches to achieve the maximum area with the minimum number of crane mats. The proposed framework is found to decrease the time required for preparing a crane mat layout plan/drawing (approximately 97% time saving) with more uniform and efficient crane mat planning outcomes (approximately 63% crane mat material reduction).
Practical Applications
The research presented in this manuscript examined the largely unexplored topics of crane mat layout optimization and layout preparation, proposing an agent-based greedy algorithm and reinforcement learning (RL) approach for automated crane mat layout optimization as an innovative approach to developing sustainable crane mat layouts. This approach takes into account the site constraints and can be applied to mitigate crane mat crowding on construction sites. Crane mat optimization is applied using both methods (greedy and RL) to achieve the maximum area covered with the minimum number of crane mats used. The results demonstrate that the practitioner time spent preparing a crane mat layout plan/drawing can be reduced considerably, with more uniform and cost-effective crane mat optimization outcomes. Another outcome of this research is that developed approaches reduce the crane mat requirements compared with the outputs generated by the manual approach, thereby reducing the emissions associated with crane mat manufacturing and usage.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
References
Al-Hussein, M., S. Alkass, and O. Moselhi. 2000. “D-CRANE: A database system for utilization of cranes.” Can. J. Civ. Eng. 27 (6): 1130–1138. https://doi.org/10.1139/l00-039.
Al-Hussein, M., S. Alkass, and O. Moselhi. 2005. “Optimization algorithm for selection and on site location of mobile cranes.” J. Constr. Eng. Manage. 131 (5): 579–590. https://doi.org/10.1061/(ASCE)0733-9364(2005)131:5(579).
Ali, G. M., M. Al-Hussein, and A. Bouferguene. 2019. “Use of finite element analysis for the estimate of freezing & maintenance phase of indirect & direct artificial ground freezing of proposed frozen silt mat, an alternative of timber mat.” In Proc., 2019 Int. Symp. on Automation and Robotics in Construction (ISARC), 846–853. Banff, AB, Canada: International Association for Automation and Robotics in Construction. https://doi.org/10.22260/ISARC2019/0114.
Bagheri, S. M., H. Taghaddos, A. Mousaei, F. Shahnavaz, and U. Hermann. 2021. “An A-star algorithm for semi-optimization of crane location and configuration in modular construction.” Autom. Constr. 121 (Jan): 103447. https://doi.org/10.1016/j.autcon.2020.103447.
Bang-Jensen, J., G. Gutin, and A. Yeo. 2004. “When the greedy algorithm fails.” Discrete Optim. 1 (2): 121–127. https://doi.org/10.1016/j.disopt.2004.03.007.
Bellman, R. 1957. “A Markovian decision process.” J. Math. Mech. 6 (5): 679–684.
Cormen, T. H., C. E. Leiserson, R. L. Rivest, and C. Stein. 2009. Introduction to algorithms. 3rd ed. Cambridge, MA: MIT Press.
Deen, A. M. S. A., B. N. Ramesh, and V. Koshy. 2005. “Collision free path planning of cooperative crane manipulators using genetic algorithm.” J. Comput. Civ. Eng. 19 (2): 182–193. https://doi.org/10.1061/(ASCE)0887-3801(2005)19:2(182).
Duerr, D. 2010. “Effective bearing length of crane mats.” In Proc., Crane & Rigging Conf., 1–8. Houston, TX: 2DM Associates.
Gullapalli, V., and A. G. Barto. 1992. “Shaping as a method for accelerating reinforcement learning.” In Proc., 1992 IEEE Int. Symp. on Intelligent Control, 554–559. New York: IEEE. https://doi.org/10.1109/ISIC.1992.225046.
Hammad, A. W. A., A. Akbarnezhad, P. Wu, X. Wang, and A. Haddad. 2019. “Building information modelling-based framework to contrast conventional and modular construction methods through selected sustainability factors.” J. Cleaner Prod. 228 (Aug): 1264–1281. https://doi.org/10.1016/j.jclepro.2019.04.150.
Hasan, S., M. Al-Hussein, U. Hermann, and H. Safouhi. 2010. “Interactive and dynamic integrated module for mobile cranes supporting system design.” J. Constr. Eng. Manage. 136 (2): 179–186. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000121.
Hilgard, E. R., D. G. Marquis, and G. A. Kimble. 1961. Hilgard and Marquis’ conditioning and learning. East Norwalk, CT: Appleton-Century-Crofts.
Kan, C., P. Zhang, Y. Fang, C. Anumba, and J. Messner. 2018. “A taxonomic analysis of mobile crane fatalities for CPS-based simulation.” In Proc., 17th Int. Conf. on Computing in Civil and Building Engineering, 1–8. Tampere, Finland: International Society for Computing in Civil and Building Engineering.
Lee, D., and M. Kim. 2021. “Autonomous construction hoist system based on deep reinforcement learning in high-rise building construction.” Autom. Constr. 128 (Aug): 103737. https://doi.org/10.1016/j.autcon.2021.103737.
Lillicrap, T. P., J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra. 2015. “Continuous control with deep reinforcement learning.” Preprint, submitted September 9, 2015. https://arxiv.org/abs/1509.02971.
Lim, C. H., S. H. Cho, Y. C. Lee, and J. K. Choi. 2005. “Basic construction of intelligent expert system for riser design using database system and optimisation tools.” Int. J. Cast Met. Res. 18 (4): 195–201. https://doi.org/10.1179/136404605225022937.
Lin, M., N. Duong, L. Deng, U. Hermann, T. Zubick, Z. Lei, and S. Adeeb. 2017. “An investigation of the distribution of mobile crane loads for construction projects.” In Proc., CSCE Leadership in Sustainable Infrastructure, 1–9. Vancouver, BC, Canada: Canadian Society of Civil Engineering.
Liu, H., C. Sydora, M. Sadiq Altaf, S. Han, and M. Al-Hussein. 2019. “Towards sustainable construction: BIM-enabled design and planning of roof sheathing installation for prefabricated buildings.” J. Cleaner Prod. 235 (Oct): 1189–1201. https://doi.org/10.1016/j.jclepro.2019.07.055.
Madireddy, M., D. J. Medeiros, and S. Kumara. 2011. “An agent based model for evacuation traffic management.” In Proc., 2011 Winter Simulation Conf. (WSC), 222–233. New York: IEEE. https://doi.org/10.1109/WSC.2011.6147753.
Mehr, E. 2019. “Using reinforcement learning to design a better rocket engine.” Insight. Accessed December 30, 2021. https://blog.insightdatascience.com/using-reinforcement-learning-to-design-a-better-rocket-engine-4dfd1770497a.
Melega, G. M., S. A. de Araujo, and R. Jans. 2018. “Classification and literature review of integrated lot-sizing and cutting stock problems.” Eur. J. Oper. Res. 271 (1): 1–19. https://doi.org/10.1016/j.ejor.2018.01.002.
Nourinejad, M., and M. J. Roorda. 2016. “Agent based model for dynamic ridesharing.” Transp. Res. Part C: Emerging Technol. 64 (Mar): 117–132. https://doi.org/10.1016/j.trc.2015.07.016.
Octarina, S., F. M. Puspita, and S. S. Supadi. 2020. “The greedy randomized adaptive search procedure method in formulating set covering model on cutting stock problem.” J. Phys. Conf. Ser. 1663 (1): 012062. https://doi.org/10.1088/1742-6596/1663/1/012062.
Oliveira, W. A., D. J. Fiorotto, X. Song, and D. F. Jones. 2021. “An extended goal programming model for the multiobjective integrated lot-sizing and cutting stock problem.” Eur. J. Oper. Res. 295 (3): 996–1007. https://doi.org/10.1016/j.ejor.2021.03.049.
Pang, K., B. Zhu, H. Zhang, N. Liu, M. Xu, and L. Zhang. 2021. “An approach based on demand prediction with LSTM for solving multi-batch 2D cutting stock problems.” In Proc., Advances in Artificial Intelligence and Security. Communications in Computer and Information Science (ICAIS 2021), edited by X. Sun, X. Zhang, Z. Xia, and E. Bertino, 3–15. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-78618-2_1.
Reddy, H. R., and K. Varghese. 2002. “Automated path planning for mobile crane lifts.” Comput.-Aided Civ. Infrastruct. Eng. 17 (6): 439–448. https://doi.org/10.1111/0885-9507.00005.
Sivakumar, P. Á., K. Varghese, and N. R. Babu. 2003. “Automated path planning of cooperative crane lifts using heuristic search.” J. Comput. Civ. Eng. 17 (3): 197–207. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:3(197).
Soman, R. K., and M. Molina-Solana. 2022. “Automating look-ahead schedule generation for construction using linked-data based constraint checking and reinforcement learning.” Autom. Constr. 134 (Feb): 104069. https://doi.org/10.1016/j.autcon.2021.104069.
Sutton, R. S. 1988. “Learning to predict by the methods of temporal differences.” Mach. Learn. 3 (Aug): 9–44. https://doi.org/10.1007/BF00115009.
Sutton, R. S. 1996. “Generalization in reinforcement learning: Successful examples using sparse coarse coding.” In Proc., Advances in Neural Information Processing Systems, 1038–1044. Cambridge, MA: MIT Press.
Sutton, R. S., and A. G. Barto. 2018. Reinforcement learning: An introduction. 2nd ed. Cambridge, MA: MIT Press.
Taghaddos, H., U. Hermann, and A. Abbasi. 2018. “Automated crane planning and optimization for modular construction.” Autom. Constr. 95 (Nov): 219–232. https://doi.org/10.1016/j.autcon.2018.07.009.
Tak, A. N., H. Taghaddos, A. Mousaei, A. Bolourani, and U. Hermann. 2021. “BIM-based 4D mobile crane simulation and onsite operation management.” Autom. Constr. 128 (Aug): 103766. https://doi.org/10.1016/j.autcon.2021.103766.
Tam, C. M., T. K. L. Tong, and W. K. W. Chan. 2001. “Genetic algorithm for optimizing supply locations around tower crane.” J. Constr. Eng. Manage. 127 (4): 315–321. https://doi.org/10.1061/(ASCE)0733-9364(2001)127:4(315).
Wang, Y.-H., T.-H. S. Li, and C.-J. Lin. 2013. “Backward Q-learning: The combination of SARSA algorithm and Q-learning.” Eng. Appl. Artif. Intell. 26 (9): 2184–2193. https://doi.org/10.1016/j.engappai.2013.06.016.
Watkins, C. 1989. “Learning from delayed rewards.” Doctoral dissertation, King’s College.
Watkins, C., and P. Dayan. 1992. “Technical note: Q-learning.” Mach. Learn. 8 (3–4): 279–292. https://doi.org/10.1007/BF00992698.
Waxenegger-Wilfing, G., K. Dresia, J. C. Deeken, and M. Oschwald. 2020. “A reinforcement learning approach for transient control of liquid rocket engines.” Preprint, submitted June 19, 2020. https://arxiv.org/abs/2006.11108.
Wiering, M. A., and H. Van Hasselt. 2008. “Ensemble algorithms in reinforcement learning.” IEEE Trans. Syst. Man Cybern. Part B Cybern. 38 (4): 930–936. https://doi.org/10.1109/TSMCB.2008.920231.
Wilson, J. 2019. “The potential of prefab: How modular construction can be green.” Building Green. Accessed August 25, 2021. https://www.buildinggreen.com/feature/potential-prefab-how-modular-construction-can-be-green.
Zhao, Q. 2011. “Cause analysis of US crane-related accidents.” Master’s dissertation, Dept. of Building Construction, Univ. of Florida.
Information & Authors
Information
Published In
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Jul 4, 2022
Accepted: Mar 27, 2023
Published online: Jun 5, 2023
Published in print: Aug 1, 2023
Discussion open until: Nov 5, 2023
ASCE Technical Topics:
- Aging (material)
- Business management
- Construction engineering
- Construction equipment
- Construction management
- Construction sites
- Cranes
- Deterioration
- Engineering fundamentals
- Equipment and machinery
- Materials characterization
- Materials engineering
- Modular structures
- Personnel management
- Practice and Profession
- Productivity
- Structural engineering
- Structures (by type)
- Sustainable development
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.