GPU Implementation and Optimization of a High-Order Spectral Difference Method for Aeroacoustic Problems
Publication: Journal of Aerospace Engineering
Volume 37, Issue 3
Abstract
This study focuses on the implementation of the spectral difference (SD) method on hexahedral elements to NVIDIA graphics processing units (GPUs) using the Compute Unified Device Architecture (CUDA) for aeroacoustic problems. Three problems were addressed in the implementation of this study: thread parallelism strategy optimization within the GPU, data access patterns management, and multi-GPU parallelization implementation. Computational speed testing showed that the three factors significantly affect the efficiency of the code on the GPU. The implemented GPU solver was validated using an inviscid problem and a viscous problem. The numerical results show that the GPU solver achieves the same level of accuracy as the CPU program, with remarkable speed improvements. Specifically, compared with a single CPU core with a turbo boost frequency of 3.2 GHz (Intel Xeon Silver 4210), the inviscid case tested on an RTX 2070 Super GPU achieved acceleration of , and the viscous case conducted on an RTX 3090 GPU achieved acceleration of . Additionally, the GPU solver exhibits a parallel efficiency exceeding 93% when performing parallel computing on a platform with multiple RTX 3090 GPU cards. Furthermore, the GPU-accelerated computational aeroacoustics solver was applied to compute the noise from a low-speed propeller. The computed results were compared with experimental data, and the excellent agreement demonstrated the effectiveness and feasibility of the GPU implementation of the SD solver.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported by NSFC-51876003, the National Key Research and Development Project (2018YFA0703300), the National Science and Technology Major Project (J2019-II-0006-0026), and the Science Center for Gas Turbine Project of China (P2022-A-II-003-001).
References
Castonguay, P., D. M. Williams, P. E. Vincent, M. Lopez, and A. Jameson. 2011. “On the development of a high-order, multi-GPU enabled, compressible viscous flow solver for mixed unstructured grids.” In Proc., 20th AIAA Computational Fluid Dynamics Conf. 2011-3229. Reston, VA: American Institute of Aeronautics and Astronautics.
Farassat, F. 1981. “Linear acoustic formulas for calculation of rotating blade noise.” AIAA J. 19 (9): 1122–1130. https://doi.org/10.2514/3.60051.
Gao, J. H. 2022. “A sliding-mesh interface method for three dimensional high order spectral difference solver.” J. Comput. Phys. 454 (Apr): 110988. https://doi.org/10.1016/j.jcp.2022.110988.
Gao, J. H., Z. G. Yang, and X. D. Li. 2012. “An optimized spectral difference scheme for CAA problems.” J. Comput. Phys. 231 (14): 4848–4866. https://doi.org/10.1016/j.jcp.2012.04.009.
Hoffmann, M., C. D. Munz, and Z. J. Wang. 2012. “Efficient implementation of the CPR formulation for the Navier-Stokes equations on GPUs.” In Proc., 7th Int. Conf. on Computational Fluid Dynamics. Parkes, Australia: National Library of Australia.
Hu, F. Q., M. Y. Hussaini, and J. L. Manthey. 1996. “Low-dissipation and low-dispersion Runge–Kutta schemes for computational acoustics.” J. Comput. Phys. 124 (1): 177–191. https://doi.org/10.1006/jcph.1996.0052.
Huynh, H. T. 2007. “A flux reconstruction approach to high-order schemes including discontinuous Galerkin methods.” In Proc., 18th AIAA Computational Fluid Dynamics Conf. 2007-4097. Reston, VA: American Institute of Aeronautics and Astronautics.
Jacobsen, D. A., J. C. Thibault, and I. Senocak. 2010. “An MPI-CUDA implementation for massively parallel incompressible flow computations on multi-GPU clusters.” In Proc., 48th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition. Reston, VA: American Institute of Aeronautics and Astronautics.
Ju, P. F., and F. F. Ning. 2014. “Accelerated CFD computing of turbomachinery on GPU platform.” J. Aerosp. Power 29 (5): 1154–1162. https://doi.org/10.13224/j.cnki.jasp.2014.05.022.
Klockner, A., T. Warburton, J. Bridge, and J. S. Hesthaven. 2009. “Nodal discontinuous Galerkin methods on graphics processors.” J. Comput. Phys. 228 (21): 7863–7882. https://doi.org/10.1016/j.jcp.2009.06.041.
Kopriva, D. A., and J. H. Kolias. 1996. “A conservative staggered-grid Chebyshev multidomain method for compressible flows.” J. Comput. Phys. 125 (1): 244–261. https://doi.org/10.1006/jcph.1996.0091.
Kravchenko, A. G., and P. Moin. 2000. “Numerical studies of flow over a circular cylinder at .” Phys. Fluids (1994) 12 (2): 403–417. https://doi.org/10.1063/1.870318.
Lesaint, P., and P. A. Raviart. 1974. “On a finite element method for solving the neutron transport equation.” In Mathematical aspects of finite elements in partial differential equations, 89–123. Cambridge, MA: Academic Press. https://doi.org/10.1016/B978-0-12-208350-1.50008-X.
Liang, C. L., S. Premasuthan, and A. Jamson. 2009. “Large eddy simulation of compressible turbulent channel flow with spectral difference method.” In Proc., 47th AIAA Aerospace Sciences Meeting Including The New Horizons Forum and Aerospace Exposition. Reston, VA: American Institute of Aeronautics and Astronautics.
Liu, Y., M. Vinokur, and Z. J. Wang. 2006. “Spectral difference method for unstructured grids I: Basic formulation.” J. Comput. Phys. 216 (2): 780–801. https://doi.org/10.1016/j.jcp.2006.01.024.
López-Morales, M. R., et al. 2014. “Verification and validation of HiFiLES: A high-order LES unstructured solver on multi-GPU platforms.” In Proc., 32nd AIAA Applied Aerodynamics Conf. 2014-3168. Reston, VA: American Institute of Aeronautics and Astronautics.
Miao, S., X. Zhang, O. G. Parchment, and X. Chen. 2015. “A fast GPU based bidiagonal solver for computational aeroacoustics.” Comput. Methods Appl. Mech. Eng. 286 (Apr): 22–39. https://doi.org/10.1016/j.cma.2014.12.020.
Mostafazadeh, B., F. Marti, B. Pourghassemi, and F. Liu. 2017. “Unsteady Navier-Stokes computations on GPU architectures.” In Proc., 23rd AIAA Computational Fluid Dynamics Conf. 2017-4508. Reston, VA: American Institute of Aeronautics and Astronautics.
Norberg, C. 1987. Effects of Reynolds number and low-intensity free stream turbulence on the flow around a circular cylinder. Gothenburg, Sweden: Chalmers Univ. of Technology.
Romero, J., J. Crabill, J. E. Watkins, F. D. Witherden, and A. Jameson. 2020. “ZEFR: A GPU-accelerated high-order solver for compressible viscous flows using the flux reconstruction method.” Comput. Phys. Commun. 250 (May): 107169. https://doi.org/10.1016/j.cpc.2020.107169.
Rusanov, V. V. 1962. “Calculation of interaction of non-steady shock waves with obstacles.” USSR Comput. Math. Math. Phys. 1 (2): 304–320. https://doi.org/10.1016/0041-5553(62)90062-9.
Sidebottom, W., A. Ooi, and D. Jones. 2012. “Large eddy simulation of flow past a circular cylinder at Reynolds number 3900.” In Proc., 18th Australasian Fluid Mechanics Conf. Launceston, TAS, Australia: Australasian Fluid Mechanics Society.
Stanescu, D., and W. G. Habashi. 1998. “-storage low dissipation and dispersion Runge-Kutta schemes for computational acoustics.” J. Comput. Phys. 143 (2): 674–681. https://doi.org/10.1006/jcph.1998.5986.
Sun, Y., Z. J. Wang, and Y. Liu. 2006. “High-order multidomain spectral difference method for the Navier-Stokes equations.” In Proc., 44th AIAA Aerospace Sciences Meeting and Exhibit 2006–301. Reston, VA: American Institute of Aeronautics and Astronautics.
Tam, C. K. W. 2008. “Computational aeroacoustics: An overview of computational challenges and applications.” Int. J. Comput. Fluid Dyn. 18 (6): 547–567. https://doi.org/10.1080/10618560410001673551.
Tam, C. K. W., and Z. Dong. 1996. “Radiation and outflow boundary conditions for direct computation of acoustic and flow disturbances in a nonuniform mean flow.” J. Comput. Acoust. 4 (2): 175–201. https://doi.org/10.1142/S0218396X96000040.
Thibault, J. C., and I. Senocak. 2009. “CUDA implementation of a Navier-Stokes solver on multi-GPU desktop platforms for incompressible flows.” In Proc., 47th AIAA Aerospace Sciences Meeting including The New Horizons Forum and Aerospace Exposition. Reston, VA: American Institute of Aeronautics and Astronautics.
Van den Abeele, K., T. Broeckhoven, and C. Lacor. 2007. “Dispersion and dissipation properties of the 1D spectral volume method and application to a p-multigrid algorithm.” J. Comput. Phys. 224 (2): 616–636. https://doi.org/10.1016/j.jcp.2006.10.022.
Vandenhoeck, R., and A. Lani. 2021. “Development of a GPU-enabled high-order flux reconstruction solver for high-speed flows.” In Proc., AIAA Scitech 2021 Forum. Reston, VA: American Institute of Aeronautics and Astronautics.
Vermeire, B. C., F. D. Witherden, and P. E. Vincent. 2017. “On the utility of GPU accelerated high-order methods for unsteady flow simulations: A comparison with industry-standard tools.” J. Comput. Phys. 334 (Apr): 497–521. https://doi.org/10.1016/j.jcp.2016.12.049.
Watkins, J., J. Romero, and A. Jameson. 2016. “Multi-GPU, implicit time stepping for high-order methods on unstructured grids.” In Proc., 46th AIAA Fluid Dynamics Conf. 2016-3965. Reston, VA: American Institute of Aeronautics and Astronautics.
Witherden, F. D., A. M. Farrington, and P. E. Vincent. 2014. “PyFR: An open source framework for solving advection-diffusion type problems on streaming architectures using the flux reconstruction approach.” Comput. Phys. Commun. 185 (11): 3028–3040. https://doi.org/10.1016/j.cpc.2014.07.011.
Xue, W., C. W. Jackson, and C. J. Roy. 2021. “An improved framework of GPU computing for CFD applications on structured grids using OpenACC.” J. Parallel Distrib. Comput. 156 (Jun): 64–85. https://doi.org/10.1016/j.jpdc.2021.05.010.
Ye, C., P. Zhang, Z. Wan, R. Yan, and D. Sun. 2022. “Accelerating CFD simulation with high order finite difference method on curvilinear coordinates for modern GPU clusters.” Adv. Aerodyn. 4 (1): 7. https://doi.org/10.1186/s42774-021-00098-3.
Zhou, J. J., X. Hao, Z. L. Fu, B. Liang, and P. Zhou. 2021. “Noise tests of pusher-propeller.” J. Aerosp. Power 36 (2): 225–232. https://doi.org/10.13224/j.cnki.jasp.2021.02.001.
Zimmerman, B. J., Z. J. Wang, and M. R. Visbal. 2013. “High-order spectral difference: Verification and acceleration using GPU computing.” In Proc., 21st AIAA Computational Fluid Dynamics Conf. Reston, VA: American Institute of Aeronautics and Astronautics.
Information & Authors
Information
Published In
Journal of Aerospace Engineering
Volume 37 • Issue 3 • May 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Aug 31, 2023
Accepted: Dec 11, 2023
Published online: Feb 28, 2024
Published in print: May 1, 2024
Discussion open until: Jul 28, 2024
ASCE Technical Topics:
- Architectural engineering
- Architecture
- Computing in civil engineering
- Construction engineering
- Construction management
- Engineering fundamentals
- Graphic methods
- Information management
- Methodology (by type)
- Models (by type)
- Numerical methods
- Optimization models
- Research methods (by type)
- Standards and codes
- Validation
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.