A Vehicle Driving Simulator Based on Mixed Reality

To solve the problem of the user being separated from the real world in a simulator based on virtual reality, a vehicle driving simulator based on mixed reality in designed in this paper. Three-dimensional (3D) graphics technology and physical driving control devices are used in the simulator to build the vehicle model, virtual traffic environment, and physical environment. The user operation of the driving control devices will be mapped into the virtual scene in real time to achieve the purpose of providing a more natural way of interaction. A camera calibration algorithm is designed and implemented to achieve spatial matching of the physical scene and the virtual scene by calculating the camera’s internal and external parameters. The overall design of the system is also given in this paper. The result has shown that this mixed-reality-based simulator helps to improve the fidelity of the driving simulation.