Technical Papers
Jun 5, 2023

Crane Mat Layout Optimization Based on Agent-Based Greedy and Reinforcement-Learning Approach

Publication: Journal of Construction Engineering and Management
Volume 149, Issue 8

Abstract

The growing prevalence of modular construction, while it offers benefits in terms of productivity and sustainability, has led to increased use of heavy mobile cranes and related resources on construction sites. One significant resource associated with crane use is the crane mat, which offers practical mobile crane ground support against poor soil-bearing capacity. Due to increased use of crane mats, crane mat layout plans/drawings have become increasingly significant in today’s construction industry. The present work describes an automated crane mat optimization framework for preparing crane mat layout plans/drawings built on an agent-based greedy algorithm and reinforcement learning. The proposed framework employs these approaches to achieve the maximum area with the minimum number of crane mats. The proposed framework is found to decrease the time required for preparing a crane mat layout plan/drawing (approximately 97% time saving) with more uniform and efficient crane mat planning outcomes (approximately 63% crane mat material reduction).

Practical Applications

The research presented in this manuscript examined the largely unexplored topics of crane mat layout optimization and layout preparation, proposing an agent-based greedy algorithm and reinforcement learning (RL) approach for automated crane mat layout optimization as an innovative approach to developing sustainable crane mat layouts. This approach takes into account the site constraints and can be applied to mitigate crane mat crowding on construction sites. Crane mat optimization is applied using both methods (greedy and RL) to achieve the maximum area covered with the minimum number of crane mats used. The results demonstrate that the practitioner time spent preparing a crane mat layout plan/drawing can be reduced considerably, with more uniform and cost-effective crane mat optimization outcomes. Another outcome of this research is that developed approaches reduce the crane mat requirements compared with the outputs generated by the manual approach, thereby reducing the CO2 emissions associated with crane mat manufacturing and usage.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.

References

Al-Hussein, M., S. Alkass, and O. Moselhi. 2000. “D-CRANE: A database system for utilization of cranes.” Can. J. Civ. Eng. 27 (6): 1130–1138. https://doi.org/10.1139/l00-039.
Al-Hussein, M., S. Alkass, and O. Moselhi. 2005. “Optimization algorithm for selection and on site location of mobile cranes.” J. Constr. Eng. Manage. 131 (5): 579–590. https://doi.org/10.1061/(ASCE)0733-9364(2005)131:5(579).
Ali, G. M., M. Al-Hussein, and A. Bouferguene. 2019. “Use of finite element analysis for the estimate of freezing & maintenance phase of indirect & direct artificial ground freezing of proposed frozen silt mat, an alternative of timber mat.” In Proc., 2019 Int. Symp. on Automation and Robotics in Construction (ISARC), 846–853. Banff, AB, Canada: International Association for Automation and Robotics in Construction. https://doi.org/10.22260/ISARC2019/0114.
Bagheri, S. M., H. Taghaddos, A. Mousaei, F. Shahnavaz, and U. Hermann. 2021. “An A-star algorithm for semi-optimization of crane location and configuration in modular construction.” Autom. Constr. 121 (Jan): 103447. https://doi.org/10.1016/j.autcon.2020.103447.
Bang-Jensen, J., G. Gutin, and A. Yeo. 2004. “When the greedy algorithm fails.” Discrete Optim. 1 (2): 121–127. https://doi.org/10.1016/j.disopt.2004.03.007.
Bellman, R. 1957. “A Markovian decision process.” J. Math. Mech. 6 (5): 679–684.
Cormen, T. H., C. E. Leiserson, R. L. Rivest, and C. Stein. 2009. Introduction to algorithms. 3rd ed. Cambridge, MA: MIT Press.
Deen, A. M. S. A., B. N. Ramesh, and V. Koshy. 2005. “Collision free path planning of cooperative crane manipulators using genetic algorithm.” J. Comput. Civ. Eng. 19 (2): 182–193. https://doi.org/10.1061/(ASCE)0887-3801(2005)19:2(182).
Duerr, D. 2010. “Effective bearing length of crane mats.” In Proc., Crane & Rigging Conf., 1–8. Houston, TX: 2DM Associates.
Gullapalli, V., and A. G. Barto. 1992. “Shaping as a method for accelerating reinforcement learning.” In Proc., 1992 IEEE Int. Symp. on Intelligent Control, 554–559. New York: IEEE. https://doi.org/10.1109/ISIC.1992.225046.
Hammad, A. W. A., A. Akbarnezhad, P. Wu, X. Wang, and A. Haddad. 2019. “Building information modelling-based framework to contrast conventional and modular construction methods through selected sustainability factors.” J. Cleaner Prod. 228 (Aug): 1264–1281. https://doi.org/10.1016/j.jclepro.2019.04.150.
Hasan, S., M. Al-Hussein, U. Hermann, and H. Safouhi. 2010. “Interactive and dynamic integrated module for mobile cranes supporting system design.” J. Constr. Eng. Manage. 136 (2): 179–186. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000121.
Hilgard, E. R., D. G. Marquis, and G. A. Kimble. 1961. Hilgard and Marquis’ conditioning and learning. East Norwalk, CT: Appleton-Century-Crofts.
Kan, C., P. Zhang, Y. Fang, C. Anumba, and J. Messner. 2018. “A taxonomic analysis of mobile crane fatalities for CPS-based simulation.” In Proc., 17th Int. Conf. on Computing in Civil and Building Engineering, 1–8. Tampere, Finland: International Society for Computing in Civil and Building Engineering.
Lee, D., and M. Kim. 2021. “Autonomous construction hoist system based on deep reinforcement learning in high-rise building construction.” Autom. Constr. 128 (Aug): 103737. https://doi.org/10.1016/j.autcon.2021.103737.
Lillicrap, T. P., J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra. 2015. “Continuous control with deep reinforcement learning.” Preprint, submitted September 9, 2015. https://arxiv.org/abs/1509.02971.
Lim, C. H., S. H. Cho, Y. C. Lee, and J. K. Choi. 2005. “Basic construction of intelligent expert system for riser design using database system and optimisation tools.” Int. J. Cast Met. Res. 18 (4): 195–201. https://doi.org/10.1179/136404605225022937.
Lin, M., N. Duong, L. Deng, U. Hermann, T. Zubick, Z. Lei, and S. Adeeb. 2017. “An investigation of the distribution of mobile crane loads for construction projects.” In Proc., CSCE Leadership in Sustainable Infrastructure, 1–9. Vancouver, BC, Canada: Canadian Society of Civil Engineering.
Liu, H., C. Sydora, M. Sadiq Altaf, S. Han, and M. Al-Hussein. 2019. “Towards sustainable construction: BIM-enabled design and planning of roof sheathing installation for prefabricated buildings.” J. Cleaner Prod. 235 (Oct): 1189–1201. https://doi.org/10.1016/j.jclepro.2019.07.055.
Madireddy, M., D. J. Medeiros, and S. Kumara. 2011. “An agent based model for evacuation traffic management.” In Proc., 2011 Winter Simulation Conf. (WSC), 222–233. New York: IEEE. https://doi.org/10.1109/WSC.2011.6147753.
Mehr, E. 2019. “Using reinforcement learning to design a better rocket engine.” Insight. Accessed December 30, 2021. https://blog.insightdatascience.com/using-reinforcement-learning-to-design-a-better-rocket-engine-4dfd1770497a.
Melega, G. M., S. A. de Araujo, and R. Jans. 2018. “Classification and literature review of integrated lot-sizing and cutting stock problems.” Eur. J. Oper. Res. 271 (1): 1–19. https://doi.org/10.1016/j.ejor.2018.01.002.
Nourinejad, M., and M. J. Roorda. 2016. “Agent based model for dynamic ridesharing.” Transp. Res. Part C: Emerging Technol. 64 (Mar): 117–132. https://doi.org/10.1016/j.trc.2015.07.016.
Octarina, S., F. M. Puspita, and S. S. Supadi. 2020. “The greedy randomized adaptive search procedure method in formulating set covering model on cutting stock problem.” J. Phys. Conf. Ser. 1663 (1): 012062. https://doi.org/10.1088/1742-6596/1663/1/012062.
Oliveira, W. A., D. J. Fiorotto, X. Song, and D. F. Jones. 2021. “An extended goal programming model for the multiobjective integrated lot-sizing and cutting stock problem.” Eur. J. Oper. Res. 295 (3): 996–1007. https://doi.org/10.1016/j.ejor.2021.03.049.
Pang, K., B. Zhu, H. Zhang, N. Liu, M. Xu, and L. Zhang. 2021. “An approach based on demand prediction with LSTM for solving multi-batch 2D cutting stock problems.” In Proc., Advances in Artificial Intelligence and Security. Communications in Computer and Information Science (ICAIS 2021), edited by X. Sun, X. Zhang, Z. Xia, and E. Bertino, 3–15. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-78618-2_1.
Reddy, H. R., and K. Varghese. 2002. “Automated path planning for mobile crane lifts.” Comput.-Aided Civ. Infrastruct. Eng. 17 (6): 439–448. https://doi.org/10.1111/0885-9507.00005.
Sivakumar, P. Á., K. Varghese, and N. R. Babu. 2003. “Automated path planning of cooperative crane lifts using heuristic search.” J. Comput. Civ. Eng. 17 (3): 197–207. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:3(197).
Soman, R. K., and M. Molina-Solana. 2022. “Automating look-ahead schedule generation for construction using linked-data based constraint checking and reinforcement learning.” Autom. Constr. 134 (Feb): 104069. https://doi.org/10.1016/j.autcon.2021.104069.
Sutton, R. S. 1988. “Learning to predict by the methods of temporal differences.” Mach. Learn. 3 (Aug): 9–44. https://doi.org/10.1007/BF00115009.
Sutton, R. S. 1996. “Generalization in reinforcement learning: Successful examples using sparse coarse coding.” In Proc., Advances in Neural Information Processing Systems, 1038–1044. Cambridge, MA: MIT Press.
Sutton, R. S., and A. G. Barto. 2018. Reinforcement learning: An introduction. 2nd ed. Cambridge, MA: MIT Press.
Taghaddos, H., U. Hermann, and A. Abbasi. 2018. “Automated crane planning and optimization for modular construction.” Autom. Constr. 95 (Nov): 219–232. https://doi.org/10.1016/j.autcon.2018.07.009.
Tak, A. N., H. Taghaddos, A. Mousaei, A. Bolourani, and U. Hermann. 2021. “BIM-based 4D mobile crane simulation and onsite operation management.” Autom. Constr. 128 (Aug): 103766. https://doi.org/10.1016/j.autcon.2021.103766.
Tam, C. M., T. K. L. Tong, and W. K. W. Chan. 2001. “Genetic algorithm for optimizing supply locations around tower crane.” J. Constr. Eng. Manage. 127 (4): 315–321. https://doi.org/10.1061/(ASCE)0733-9364(2001)127:4(315).
Wang, Y.-H., T.-H. S. Li, and C.-J. Lin. 2013. “Backward Q-learning: The combination of SARSA algorithm and Q-learning.” Eng. Appl. Artif. Intell. 26 (9): 2184–2193. https://doi.org/10.1016/j.engappai.2013.06.016.
Watkins, C. 1989. “Learning from delayed rewards.” Doctoral dissertation, King’s College.
Watkins, C., and P. Dayan. 1992. “Technical note: Q-learning.” Mach. Learn. 8 (3–4): 279–292. https://doi.org/10.1007/BF00992698.
Waxenegger-Wilfing, G., K. Dresia, J. C. Deeken, and M. Oschwald. 2020. “A reinforcement learning approach for transient control of liquid rocket engines.” Preprint, submitted June 19, 2020. https://arxiv.org/abs/2006.11108.
Wiering, M. A., and H. Van Hasselt. 2008. “Ensemble algorithms in reinforcement learning.” IEEE Trans. Syst. Man Cybern. Part B Cybern. 38 (4): 930–936. https://doi.org/10.1109/TSMCB.2008.920231.
Wilson, J. 2019. “The potential of prefab: How modular construction can be green.” Building Green. Accessed August 25, 2021. https://www.buildinggreen.com/feature/potential-prefab-how-modular-construction-can-be-green.
Zhao, Q. 2011. “Cause analysis of US crane-related accidents.” Master’s dissertation, Dept. of Building Construction, Univ. of Florida.

Information & Authors

Information

Published In

Go to Journal of Construction Engineering and Management
Journal of Construction Engineering and Management
Volume 149Issue 8August 2023

History

Received: Jul 4, 2022
Accepted: Mar 27, 2023
Published online: Jun 5, 2023
Published in print: Aug 1, 2023
Discussion open until: Nov 5, 2023

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Ph.D. Candidate, Dept. of Civil and Environmental Engineering, Univ. of Alberta, Edmonton, AB, Canada T6G 2R3 (corresponding author). ORCID: https://orcid.org/0000-0002-1335-6191. Email: [email protected]
Ahmed Bouferguene
Professor, Campus Saint-Jean, Univ. of Alberta, Edmonton, AB, Canada T6G 2R3.
Mohamed Al-Hussein, M.ASCE https://orcid.org/0000-0002-1774-9718
Professor, Dept. of Civil and Environmental Engineering, Univ. of Alberta, Edmonton, AB, Canada T6G 2R3. ORCID: https://orcid.org/0000-0002-1774-9718

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share