Parallel Computation of a Dam-Break Flow Model Using OpenACC Applications
Publication: Journal of Hydraulic Engineering
Volume 143, Issue 1
Abstract
Two key factors in dam-break modeling are accuracy and speed. Therefore, high-performance calculations are of great importance to the simulation of dam-break events. In this study, we develop a two-dimensional hydrodynamic model based on the finite volume method to simulate the dam-break flow routing process. Roe’s approximate Riemann solution is adopted to solve the interface flux of grid cells and accurately simulate the discontinuous flow. A graphics processing unit (GPU)-based parallel method, OpenACC, is used to realize parallel computing. Because an explicit discrete technique is used to solve the governing equations, and there is no correlation between grid calculations in a single time step, the parallel dam-break model can be easily realized by adding OpenACC directives to the loop structure of the grid calculations. To analyze the performance of the model, we considered the Pangtoupao flood storage area in China using a Nvidia Tesla K20c card and four different grid division schemes. By carefully studying the implementation method and optimization of data transportation in the parallel algorithm, a speedup factor of 20.70 can be achieved. This acceleration is better than that of the OpenMP method with a 16-kernel computer. Further analysis reveals that models involving a larger number of calculations exhibit greater efficiency and a higher speedup rate. In addition, the OpenACC parallel mode has good portability, making it easy to realize parallel computation from the original serial model. This GPU-based parallel computation has the advantages of high performance and easily available required hardware.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This study was supported by the 12th Five-Year National Key Technology R&D Program (2012BAB05B05), the National Natural Science Foundation of China (51379076), and the Fundamental Research Funds for the Central Universities (2014ZD12).
References
Brodtkorb, A. R., Sætra, M. L., and Altinakar, M. (2012). “Efficient shallow water simulations on GPUs: Implementation, visualization, verification, and validation.” Comput. Fluids, 55, 1–12.
Brufau, P., García-Navarro, P., and Vázquez-Cendón, M. E. (2004). “Zero mass error using unsteady wetting-drying conditions in shallow flows over dry irregular topography.” Int. J. Numer. Method. Fluid., 45(10), 1047–1082.
Dai, F. C., Lee, C. F., Deng, J. H., and Tham, L. G. (2005). “The 1786 earthquake-triggered landslide dam and subsequent dam-break flood on the Dadu River, southwestern China.” Geomorphology, 65(3-4), 205–221.
De La Asunción, M., Mantas, J. M., and Castro, M. J. (2011). “Simulation of one-layer shallow water systems on multicore and CUDA architectures.” J. Supercomput., 58(2), 206–214.
Ghimire, B., Chen, A. S., Guidolin, M., Keedwell, E. C., Djordjević, S., and Savić, D. A. (2013). “Formulation of a fast 2D urban pluvial flood model using a cellular automata approach.” J. Hydroinform., 15(3), 676–686.
Ghosh, S., Liao, T., and Calandra, H. (2012). “Experiences with OpenMP, PGI, HMPP and OpenACC directives on ISO/TTI kernels.” High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, IEEE, Piscataway, NJ, 691–700.
Grillo, L., De Sande, F., Fumero, J. J., and Reyes, R. (2013). “Programming for GPUs: The directive-based approach.” 8th Int. Conf. on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), IEEE, Piscataway, NJ, 612–617.
Hart, A., Ansaloni, R., and Gray, A. (2012). “Porting and scaling OpenACC applications on massively-parallel, GPU-accelerated supercomputers.” Eur. Phys. J. Spec. Top., 210(1), 5–16.
Herdman, J. A., et al. (2012). “Accelerating hydrocodes with OpenACC, OpenCL and CUDA.” High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, IEEE, Piscataway, NJ, 465–471.
Hoshino, T., Maruyama, N., Matsuoka, S., and Takaki, R. (2013). “CUDA vs OpenACC: Performance case studies with kernel benchmarks and a memory-bound CFD application.” 13th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing (CCGrid), IEEE, Piscataway, NJ, 136–143.
Hydrology Bureau of Ministry of Water Resources (HBMWR), and Hydrology Bureau of Songliao Water Resources Commission (HBSWRC). (2002). 1998 Songhua River flood, China Water & Power Press, Beijing.
Intel Visual Fortran 11.0 [Computer software]. Intel Corporation, Santa Clara, CA.
Karim, F., et al. (2015). “Assessing the impacts of climate change and dams on floodplain inundation and wetland connectivity in the wet-dry tropics of northern Australia.” J. Hydrol., 522, 80–94.
Kelly, J. M., Divo, E. A., and Kassab, A. J. (2014). “Numerical solution of the two-phase incompressible Navier-Stokes equations using a GPU-accelerated meshless method.” Eng. Anal. Boundary Elem., 40, 36–49.
Komoda, T., Miwa, S., Nakamura, H., and Maruyama, N. (2013). “Integrating multi-GPU execution in an OpenACC compiler.” 42nd Int. Conf. on Parallel Processing (ICPP), IEEE, Piscataway, NJ, 260–269.
Krupka, M., Wallis, S., Pender, S., and Neélz, S. (2007). “Some practical aspects of flood inundation modelling.” Publications of the Institute of Geophysics, Polish Academy of Sciences, 129–135.
Kuan, L., Neves, J., Pratas, F., Tomas, P., and Sousa, L. (2014). “Accelerating phylogenetic inference on GPUs: An OpenACC and CUDA comparison.” Proc., IWBBIO 2014: Int. Work-Conf. on Bioinformatics and Biomedical Engineering, IEEE, Piscataway, NJ, 589–600.
Lastra, M., Mantas, J. M., Ureña, C., Castro, M. J., and García-Rodríguez, J. A. (2009). “Simulation of shallow-water systems using graphics processing units.” Math. Comput. Simulat., 80(3), 598–618.
Leandro, J., Chen, A. S., and Schumann, A. (2014). “A 2D parallel diffusive wave model for floodplain inundation with variable time step (P-DWave).” J. Hydrol., 517, 250–259.
Lhomme, J., Sayers, P., Gouldby, B., Samuels, P., Wills, M., and Mulet-Marti, J. (2008). “Recent development and application of a rapid flood spreading method.” Proc., Flood Risk 2008 Conf., Taylor and Francis Group, London, 15–24.
McManamay, R. A., Orth, D. J., and Dolloff, C. A. (2012). “Revisiting the homogenization of dammed rivers in the southeastern US.” J. Hydrol., 424, 217–237.
Neal, J., Fewtrell, T., and Trigg, M. (2009). “Parallelisation of storage cell flood models using OpenMP.” Environ. Modell. Software, 24(7), 872–877.
Neal, J. C., Fewtrell, T. J., Bates, P. D., and Wright, N. G. (2010). “A comparison of three parallelisation methods for 2D flood inundation models.” Environ. Modell. Software, 25(4), 398–411.
Oger, G., et al. (2016). “On distributed memory MPI-based parallelization of SPH codes in massive HPC context.” Comput. Phys. Commun., 200, 1–14.
Ouyang, C., He, S., and Xu, Q. (2015). “MacCormack-TVD finite difference solution for dam break hydraulics over erodible sediment beds.” J. Hydraul. Eng., 06014026.
Pau, J. C., and Sanders, B. F. (2006). “Performance of parallel implementations of an explicit finite-volume shallow-water model.” J. Comput. Civ. Eng., 99–110.
Penna, I. M., Derron, M. H., Volpi, M., and Jaboyedoff, M. (2013). “Analysis of past and future dam formation and failure in the Santa Cruz River (San Juan province, Argentina).” Geomorphology, 186, 28–38.
PGI Visual Fortran 14.9 [Computer software]. Portland Group, Portland.
Pickering, B. P., Jackson, C. W., Scogland, T. R. W., Feng, W. C., and Roy, C. J. (2015). “Directive-based GPU programming for computational fluid dynamics.” Comput. Fluids, 114, 242–253.
Reyes, R., López, I., Fumero, J. J., and De Sande, F. (2012a). “Directive-based programming for GPUs: A comparative study.” 14th Int. Conf. on High Performance Computing and Communication & 9th Int. Conf. on Embedded Software and Systems (HPCC-ICESS), IEEE, Piscataway, NJ, 410–417.
Reyes, R., López-Rodríguez, I., Fumero, J. J., and De Sande, F. (2012b). “accULL: An OpenACC implementation with CUDA and OpenCL support.” Euro-Par 2012 Parallel Processing, Springer, Berlin, 871–882.
Singh, J., Altinakar, M. S., and Ding, Y. (2011). “Two-dimensional numerical modeling of dam-break flows over natural terrain using a central explicit scheme.” Adv. Water Resour., 34(10), 1366–1375.
Teal, M. J., and Goodell, C. (2008). “Hawaii technical dam break studies: Hydraulic studies and dam break scenarios.” World Environmental and Water Resources Congress, ASCE, Reston, VA.
Toro, E. F. (2009). Riemann solvers and numerical methods for fluid dynamics: A practical introduction, Springer Science & Business Media, Berlin.
Visual Studio 2008 [Computer software]. Microsoft Corporation, Redmond, WA.
Wang, B. L., and Liu, H. (2010). “Application of SPH method on free surface flows on GPU.” J. Hydrodyn. Ser. B., 22(5), 912–914.
Wang, X., Shangguan, Y, Onodera, N., Kobayashi, H., and Aoki, H. (2014). “Direct numerical simulation and large eddy simulation on a turbulent wall-bounded flow using lattice Boltzmann method and multiple GPUs.” Math. Problems Eng., 2014, 742432.
Wienke, S., Springer, P., Terboven, C., and An Meyet, D. (2012). “OpenACC—First experiences with real-world applications.” Euro-Par 2012 Parallel Processing, Springer, Berlin, 859–870.
Xia, X., and Liang, Q. (2016). “A GPU-accelerated smoothed particle hydrodynamics (SPH) model for the shallow water equations.” Environ. Modell. Software, 75, 28–43.
Zhang, D., Li, D., and Wang, X. (2008). “Numerical modeling of dam2break water flow with wetting and drying change based on unstructured grids.” J. Hydroelectr. Eng., 27(5), 98–102 (in Chinese).
Zhang, S., Wang, T., and Zhao, B. (2014a). “Calculation and visualization of flood inundation based on a topographic triangle network.” J. Hydrol., 509, 406–415.
Zhang, S., Xia, Z., Yuan, R., and Jiang, X. (2014b). “Parallel computation of a dam-break flow model using OpenMP on a multicore computer.” J. Hydrol., 512, 126–133.
Zoppou, C., and Roberts, S. (2003). “Explicit schemes for dam-break simulations.” J. Hydraul. Eng., 11–34.
Information & Authors
Information
Published In
Journal of Hydraulic Engineering
Volume 143 • Issue 1 • January 2017
Copyright
© 2016 American Society of Civil Engineers.
History
Received: Sep 10, 2015
Accepted: Jun 15, 2016
Published online: Aug 11, 2016
Published in print: Jan 1, 2017
Discussion open until: Jan 11, 2017
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.