Research on motion capture method of dynamic target based on binocular vision

Tracking and locating moving targets in real time and analyzing the motion of moving targets are extremely important for sports on ice. In practical applications, the moving target may exceed the field of view of a still camera, which makes it impossible to perform accurate motion capture and three-dimensional position positioning, and there is interference from factors such as illumination and shadows. In order to alleviate the above-mentioned problems, a method for motion capture of dynamic targets based on binocular vision is proposed. First, the binocular camera is calibrated by Zhang Zhengyou's calibration method, the internal parameters, external parameters and distortion parameters of the binocular camera are obtained, and the image distortion is corrected. Then the binocular camera is mounted on the smart car, and the motion capture method based on neural network is used to obtain the two-dimensional coordinates of the 18 key points of the target. The binocular camera obtains the disparity map through stereo matching, and the moving target can be obtained according to the stereo vision three-dimensional measurement method. The three-dimensional coordinates of the key point in the camera coordinate system. The binocular camera estimates its movement through IMU information and visual odometer information during movement, and finally calculates the three-dimensional coordinates of the moving target in the world coordinate system. Experiments show that this method can analyze the movement of moving targets in real time and overcome the limitation of the field of view of a still camera.