Technical Papers
Jun 24, 2023

Observing Architectural Engineering Graduate Students’ Design Optimization Behaviors Using Eye-Tracking Methods

Publication: Journal of Civil Engineering Education
Volume 149, Issue 4

Abstract

Parametric optimization techniques allow building designers to pursue multiple performance objectives, which can benefit the overall design. However, the strategies used by architecture and engineering graduate students when working with optimization tools are unclear, and ineffective computational design procedures may limit their success as future designers. In response, this research identifies several designerly behaviors of graduate students when responding to a conceptual building design optimization task. It uses eye-tracking, screen recording, and empirical methods to code their behaviors following the situated function-behaviour-structure (FBS) framework. From these data streams, three different types of design iterations emerge: one by the designer alone, one by the optimizer alone, and one by the designer incorporating feedback from the optimizer. Based on the timing and frequency of these loops, student participants were characterized as completing partial, crude, or complete optimization cycles while developing their designs. This organization of optimization techniques establishes reoccurring strategies employed by developing designers, which can encourage future pedagogical approaches that empower students to incorporate complete optimization cycles while improving their designs. It can also be used in future research studies to establish clear links between types of design optimization behavior and design quality.

Practical Applications

Increasingly, building designers use digital, optimization tools to explore and improve designs. This research identifies and categorizes several distinct design behaviors when using optimization tools that have not been previously recognized. Applying these categories to describe graduate student designer behavior allows educators to find opportunities for improving design education. While there is no set standard for how optimization tools should be used, different strategies range in the potential they create for simulation feedback to improve the design. Although all study participants were able to implement an optimization feature, they did not all fully integrate the feedback into their design decisions. From this research we observe that it is not enough to explain algorithms and show a student how to run an optimization tool, but these tools must be taught in the context of robust design approaches. Educators wishing to identify their students’ design strategies can use the methods and language established in this paper to assess student comprehension of optimization techniques. Future work can apply the behaviors that investigate other dimensions of optimization in design, such as design quality and comparing categories of designers.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

All data, models, or code generated or used during the study (eye-tracking files, screen recordings, researcher notes) are proprietary or confidential in nature and may only be provided with restrictions with accommodation from the International Review Board.

Acknowledgments

This material is based upon research supported by the National Science Foundation under CMMI Grant No. 2033332.

References

Atman, C. J., R. S. Adams, M. E. Cardella, J. Turns, S. Mosborg, and J. Saleem. 2007. “Engineering design processes: A comparison of students and expert practitioners.” J. Eng. Educ. 96 (4): 359–379. https://doi.org/10.1002/j.2168-9830.2007.tb00945.x.
Attia, S. 2012. “Computational optimization zero energy building design: Interviews with 28 international experts.” In International energy agency (IEA) task 40: Towards net zero energy buildings subtask B. Ottignies-Louvain-la-Neuve, Belgium: Université Catholique de Louvain.
Brown, N. C. 2020. “Design performance and designer preference in an interactive, data-driven conceptual building design scenario.” Des. Stud. 96 (4): 359–379. https://doi.org/10.1016/j.destud.2020.01.001.
Brown, N. C., and S. Bunt. 2022. “Optimization tools as a platform for latent qualitative design education of technical designers.” In Proc., National Conf. on Beginning Design Students, 62–69. Raleigh, NC: Lulu.
Brown, N. C., V. Jusiega, and C. T. Mueller. 2020. “Implementing data-driven parametric building design with a flexible toolbox.” Autom. Constr. 118 (Jun): 103252. https://doi.org/10.1016/j.autcon.2020.103252.
Brown, N. C., and C. T. Mueller. 2016a. “Design for structural and energy performance of long span buildings using geometric multi-objective optimization.” Energy Build. 127 (Aug): 748–761. https://doi.org/10.1016/j.enbuild.2016.05.090.
Brown, N. C., and C. T. Mueller. 2016b. “The effect of performance feedback and optimization on the conceptual design process.” In Proc., IASS Annual Symp. Madrid, Spain: International Association for Shell and Spatial Structures.
Brown, N. C., and C. T. Mueller. 2018. “Gradient-based guidance for controlling performance in early design exploration.” In Proc., IASS Annual Symp. Madrid, Spain: International Association for Shell and Spatial Structures.
Burry, M. 2003. “Between intuition and process: Parametric design and rapid prototyping.” In Architecture in the digital age. 1st ed., 147–162. New York: Taylor Francis.
Caetano, I., L. Santos, and A. Leitão. 2020. “Computational design in architecture: Defining parametric, generative, and algorithmic design.” Front. Archit. Res. 9 (2): 287–300. https://doi.org/10.1016/j.foar.2019.12.008.
Carter, B. T., and S. G. Luke. 2020. “Best practices in eye tracking research.” Int. J. Psychophysiol. 155 (Jun): 49–62. https://doi.org/10.1016/j.ijpsycho.2020.05.010.
Cascini, G., G. Fantoni, and F. Montagna. 2007. “Design performance and designer preference in an interactive, data-driven conceptual building design scenario.” Des. Stud. 35 (5): 636–662. https://doi.org/10.1016/j.destud.2012.12.001.
Chase, S. C. 2005. “Generative design tools for novice designers: Issues for selection.” Autom. Constr. 14 (6): 689–698. https://doi.org/10.1016/j.autcon.2004.12.004.
Creswell, J. W., and J. D. Creswell. 2017. Research design: Qualitative, quantitative, and mixed methods approaches. New York: SAGE.
Cross, N. 2011. Design thinking: Understanding how designers think and work. Oxford, UK: Berg.
Cross, N., H. Christiaans, and K. Dorst. 1994. “Design expertise amongst student designers.” J. Art Des. Educ. 13 (1): 39–56. https://doi.org/10.1111/j.1476-8070.1994.tb00356.x.
Cross, N., and N. Roozenburg. 1992. “Modelling the design process in engineering and in architecture.” J. Eng. Des. 3 (4): 325–337. https://doi.org/10.1080/09544829208914765.
Danhaive, R. A., and C. T. Mueller. 2015. “Combining parametric modeling and interactive optimization for high-performance and creative structural design.” In Proc., IASS Annual Symp. Madrid, Spain: International Association for Shell and Spatial Structures.
Deininger, M., S. R. Daly, K. H. Sienko, and J. C. Lee. 2017. “Novice designers’ use of prototypes in engineering design.” Des. Stud. 51 (Jun): 25–65 https://doi.org/10.1016/j.destud.2017.04.002.
Dorst, K., and P. E. Vermaas. 2005. “John Gero’s function-behaviour-structure model of designing: A critical analysis.” Res. Eng. Des. 16 (1): 17–26. https://doi.org/10.1007/s00163-005-0058-z.
EyeTracking. 2011. “Eyeworks software.” Accessed February 20, 2022. https://www.eyetracking.com/eyeworks-software/.
Felkner, J., E. Chatzi, and T. Kotnik. 2013. “Interactive particle swarm optimization for the architectural design of truss structures.” In Proc., 2013 IEEE Symp. on Computing Intelligence for Engineering Solution, 15–22. New York: IEEE.
Galle, P. 2009. “The ontology of Gero’s fbs model of designing.” Des. Stud. 30 (4): 321–339. https://doi.org/10.1016/j.destud.2009.02.002.
Gerber, D. J., and S. E. Lin. 2009. “Designing in complexity: Simulation, integration, and multidisciplinary design optimization for architecture.” Simulation 90 (8): 936–959. https://doi.org/10.1177/0037549713482027.
Gero, J. S. 1990. “Design prototypes: A knowledge representation schema for design.” AI Mag. 11 (4): 26–36. https://doi.org/10.1609/aimag.v11i4.854.
Gero, J. S., and U. Kannengiesser. 2004. “The situated function–behaviour–structure framework.” Des. Stud. 25 (4): 373–391. https://doi.org/10.1609/aimag.v11i4.854.
Geyer, P., and K. Beucke. 2010. “An integrative approach for using multidisciplinary design 611 optimization in AEC.” In Proc., Int. Conf. on Computing in Civil Building Engineering. Nottingham, UK: Nottingham University Press.
Gu, C., J. Hu, Y.-H. Peng, and S. Li. 2012. “Fcbs model for functional knowledge representation in conceptual design.” J. Eng. Des. 23 (8): 577–596. https://doi.org/10.1080/09544828.2011.629318.
Harding, J., S. Joyce, P. Shepherd, and C. Williams. 2012. “Thinking topologically at early stage parametric design.” Adv. Archit. Geom. 2012 (1): 67–76. https://doi.org/10.1080/09544828.2011.629318.
Haymaker, J., et al. 2018. “Design space construction: A framework to support collaborative, parametric decision making.” J. Inf. Technol. 23 (Jul): 157–178.
Heiselberg, P., H. Brohus, A. Hesselholt, H. Rasmussen, E. Seinre, and S. Thomas. 2009. “Application of sensitivity analysis in design of sustainable buildings.” Renewable Energy 34 (9): 2030–2036. https://doi.org/10.1016/j.renene.2009.02.016.
Hessels, R. S., C. Kemner, C. Boomen, and I. T. C. Hooge. 2016. “The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli.” Behav. Res. 48 (Apr): 1694–1712 https://doi.org/10.3758/s13428-015-0676-y.
Howard, T. J., S. J. Culley, and E. Dekoninck. 2008. “Describing the creative design process by the integration of engineering design and cognitive psychology literature.” Des. Stud. 29 (2): 160–180. https://doi.org/10.1016/j.destud.2008.01.001.
Jbara, A., and D. G. Feitelson. 2017. “How programmers read regular code: A controlled experiment using eye tracking.” Empirical Software Eng. 22 (Aug): 1440–1477. https://doi.org/10.1007/s10664-016-9477-x.
Kalkan, E., F. Y. Okur, and A. C. Altunışık. 2018. “Applications and usability of parametric modeling.” J. Constr. Eng. Manage. 1 (3): 139–146. https://doi.org/10.31462/jcemi.2018.03139146.
Kollat, J., and P. Reed. 2007. “A framework for visually interactive decision-making and design using evolutionary multi-objective optimization (video).” Environ. Modell. Software 22 (12): 1691–1704. https://doi.org/10.1016/j.envsoft.2007.02.001.
Kruchten, P. 2005. “Casting software design in the function-behavior-structure framework.” IEEE 631 Software 22 (2): 52–58. https://doi.org/10.1109/MS.2005.33.
Lawson, B. 2006. How designers think. 4th ed. Abingdon, UK: Routledge.
Lee, J., N. Gu, and A. P. Williams. 2014. “Parametric design strategies for the generation of creative designs.” Int. J. Archit. Comput. 12 (3): 263–282. https://doi.org/10.1260/14786360771.12.3.263.
Liping, W., W. N. Hien, and L. Shuo. 2007. “Façade design optimization for naturally ventilated residential buildings in Singapore.” Energy Build. 39 (8): 954–961. https://doi.org/10.1016/j.enbuild.2006.10.011.
Mark, E. 2012. “Optimizing solar insolation in transformable fabric architecture: A parametric search design process.” Autom. Constr. 22 (Jan): 2–11. https://doi.org/10.1016/j.autcon.2011.11.001.
Marler, R. T., and J. S. Arora. 2004. “Survey of multi-objective optimization methods for engineering.” Struct. Multidiscip. Optim. 26 (Apr): 369–395. https://doi.org/10.1007/s00158-003-0368-6.
Megahed, N. A. 2015. “Digital realm: Parametric-enabled paradigm in architectural design 640 process.” Int. J. Archit. Eng. Constr. 4 (3): 174–183. https://doi.org/10.7492/IJAEC.2015.0181.
Mehta, P., M. Malviya, C. McComb, G. Manogharan, and C. P. Berdanier. 2020. “Mining design heuristics for additive manufacturing via eye-tracking methods and hidden Markov modelling.” J. Mech. Des. 142 (12): 124502. https://doi.org/10.1115/1.4048410.
Mueller, C. T. 2014. “Computational exploration of the structural design space.” Ph.D. thesis, Dept. of Architecture, Massachusetts Institute of Technology.
Mueller, C. T., and J. A. Ochsendorf. 2015. “Combining structural performance and designer preferences in evolutionary design space exploration.” Autom. Constr. 52 (Jun): 70–82. https://doi.org/10.1016/j.autcon.2015.02.011.
Nguyen, A., S. Reiter, and P. Rigo. 2014. “A review on simulation-based optimization methods applied to building performance analysis.” Appl. Energy 113 (6): 1043–1058. https://doi.org/10.1016/j.apenergy.2013.08.061.
Nocedal, J., and S. J. Wright. 2006. “Chapter 1 introduction.” In Numerical optimization. 2nd ed. New York: Springer.
Oliveira, C. J., L. O. Steffen, C. A. M. Vasconcellos, and P. F. Sanchez. 2018. “Structural topology optimization as a teaching tool in architecture.” Rev. Ensino Eng. 37 (3): 180039. https://doi.org/10.5935/2236-0158.20180039.
Oxman, R. 2017. “Thinking difference: Theories and models of parametric design thinking.” Des. Stud. 52 (Jun): 4–39. https://doi.org/10.1016/j.destud.2017.06.001.
Pasternak, A., and K. Kwiecinski. 2015. “High-rise building optimization—A design studio curriculum.” In Proc., 33rd eCAADe Conf., 305–314 Brussels, Belgium: eCAADe.
Preisinger, C., and M. Heimrath. 2014. “Karamba—A toolkit for parametric structural design.” Struct. Eng. Int. 24 (2): 217–221. https://doi.org/10.2749/101686614X13830790993483.
Radford, A. D., and J. S. Gero. 1980. “On optimization in computer aided architectural design.” Build. Environ. 15 (2): 73–80. https://doi.org/10.1016/0360-1323(80)90011-6.
Rowe, P. 1987. Design thinking. London: MIT Press.
Rutten, D. 2013. “Galapagos: On the logic and limitations of generic solvers.” Archit. Des. 83 (2): 132–135. https://doi.org/10.1002/ad.1568.
Saldana, J. 2015. The coding manual for qualitative researchers. 3rd ed. New York: SAGE.
Schnabel, M. A. 2013. “Learning parametric designing.” Ind. Eng. 2013 (1): 197–210. https://doi.org/10.4018/978-1-4666-1945-6.ch013.
Simpson, T., and J. Martins. 2011. “Multidisciplinary design optimization for complex engineered systems: Report from a national science foundation workshop.” J. Mech. Des. 133 (Jun): 101002. https://doi.org/10.1115/1.4004465.
Stals, A., S. Jancart, and C. Elsen. 2021. “Parametric modeling tools in small architectural offices: Towards an adapted design process model.” Des. Stud. 72 (Apr): 100978. https://doi.org/10.1016/j.destud.2020.100978.
Stones, C., and T. Cassidy. 2010. “Seeing and discovering: How do student designers reinterpret sketches and digital marks during graphic design ideation?” Des. Stud. 31 (5): 439–460. https://doi.org/10.1016/j.destud.2010.05.003.
Touloupaki, E., and T. Theodosiou. 2017a. “Optimization of building form to minimize energy consumption through parametric modelling.” Procedia Environ. Sci. 38 (Jul): 509–514. https://doi.org/10.1016/j.proenv.2017.03.114.
Touloupaki, E., and T. Theodosiou. 2017b. “Performance simulation integrated in parametric 3D modeling as a method for early stage design optimization—A review.” Energies 10 (5): 637. https://doi.org/10.3390/en10050637.
Tschetwertak, J., S. Schneider, A. Hollberg, D. Donath, and J. Ruth. 2017. “A matter of sequence.” In Proc., CAAD Futures 2017, 100–120. Singapore: Springer Nature Singapore.
Turrin, M., P. von Buelow, and R. Stouffs. 2011. “Design explorations of performance driven geometry in architectural design using parametric modeling and genetic algorithms.” Adv. Eng. Inf. 25 (4): 656–675. https://doi.org/10.1016/j.aei.2011.07.009.
Uflacker, M., and A. Zeier. 2008. “Extending the situated function-behaviour-structure framework for user-centered software design.” In Proc., Design Computing and Cognition ’08, 241–259. Berlin: Springer.
Wallacei, X. 2018. “Makki.” Accessed March 5, 2021. https://www.wallacei.com.
Walther, J., N. W. Sochacka, L. C. Benson, A. E. Bumbaco, N. Kellam, A. L. Pawley, and C. M. L. Phillips. 2017. “Qualitative research quality: A collaborative inquiry across multiple methodological perspectives.” J. Eng. Educ. 106 (3): 398–430. https://doi.org/10.1002/jee.20170.
Wortmann, T., and B. Tunçer. 2017. “Differentiating parametric design: Digital workflows in contemporary architecture and construction.” Des. Stud. 52 (Aug): 173–197. https://doi.org/10.1016/j.destud.2017.05.004.
Yan, M. 1993. “Representing design knowledge as a network of function, behaviour and structure.” Des. Stud. 14 (3): 314–329. https://doi.org/10.1016/0142-694X(93)80027-A.
Yang, D., Y. Sun, M. Turrin, P. V. Buelow, and J. Paul. 2015. “Multi-objective and multidisciplinary design optimization of a large sports building envelopes: A case study.” In Proc., Int. Association for Shell and Spatial Structures 2015 Symp., 1–14. Madrid, Spain: International Association for Shell and Spatial Structures.
Yu, B., T. Honda, M. Sharqawy, and M. Yang. 2016. “Human behavior and do main knowledge in parameter design of complex systems.” Des. Stud. 45 (1): 242–267. https://doi.org/10.1016/j.destud.2016.04.005.
Yu, R., and J. Gero. 2015. An empirical foundation for design patterns in parametric design, 551–560. Hong Kong: Association for Computer-Aided Architectural Design Research in Asia.
Yu, R., J. Gero, and N. Gu. 2015. “Architects’ cognitive behaviour in parametric design.” Int. J. Archit. Comput. 13 (1): 83–101. https://doi.org/10.1016/0142-694X(93)80027-A.
Zalewski, A., K. Borowa, and A. Ratkowski. 2017. “On cognitive biases in architecture decision making.” Software Archit. 2017 (1): 123–137. https://doi.org/10.1007/978-3-319-65831-59.

Information & Authors

Information

Published In

Go to Journal of Civil Engineering Education
Journal of Civil Engineering Education
Volume 149Issue 4October 2023

History

Received: Aug 15, 2022
Accepted: Apr 27, 2023
Published online: Jun 24, 2023
Published in print: Oct 1, 2023
Discussion open until: Nov 24, 2023

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Dept. of Architectural Engineering, Penn State Univ., University Park, PA 16802 (corresponding author). ORCID: https://orcid.org/0000-0001-6658-8802. Email: [email protected]
Catherine G. P. Berdanier, Ph.D. https://orcid.org/0000-0003-3271-4836
Dept. of Mechanical Engineering, Penn State Univ., University Park, PA 16802. ORCID: https://orcid.org/0000-0003-3271-4836
Dept. of Architectural Engineering, Penn State Univ., University Park, PA 16802. ORCID: https://orcid.org/0000-0003-1538-9787

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share