This paper investigates the influence of the workpiece pose errors on gear skiving accuracy. First, based on the theory of homogeneous coordinate transformation, the mapping relationship between the tooth flank of the workpiece and the skiving tool is established according to the principle of gear skiving. Second, the workpiece pose errors are defined, and the relationship between each workpiece pose error and cutting depth is analyzed. According to the kinematic chain of the machine tool, a method for measuring the workpiece pose errors based on actual inverse kinematics is proposed. Third, the tooth deviations from individual workpiece pose errors, and the coupling workpiece pose errors are studied. The sensitive errors are obtained from the tooth deviation by numerical simulation. Finally, the numerical analysis is verified by gear skiving experiments, and the proposed method can be used to identify the possible workpiece pose errors. Furthermore, the PSO algorithm is introduced to guide the workpiece setting pose errors in the gear skiving process.