In stock farming, the body size parameters and weight of yaks can reasonably reflect the growth and development characteristics, production performance and genetic characteristics of yaks. However, it is difficult for herders to measure the body size and weight of yaks by traditional manual methods. Fortunately, with the development of edge computing, herders can use mobile devices to estimate the yak’s body size and weight. The purpose of this paper is to provide a machine vision-based yak weight estimation method for the edge equipment and establish a yak estimation comprehensive display system based on the user’s use of the edge equipment in order to maximize the convenience of herdsmen’s work. In our method, a set of yak image foreground extraction and measurement point recognition algorithm suitable for edge equipment were developed to obtain yak’s measurement point recognition image, and the ratio between body sizes was transmitted to the cloud server. Then, the body size and weight of yaks were estimated using the data mining method, and the body size estimation data were constantly displayed in the yak estimation comprehensive display system. 25 yaks in different age groups were randomly selected from the herd to perform experiments. The experimental results show that the foreground extraction method can obtain segmentation image with good boundary, and the yak measurement point recognition algorithm has good accuracy and stability. The average error between the estimated values and the actual measured values of body height, oblique length, chest depth, cross height and body weight is 1.95%, 3.11%, 4.91%, 3.35% and 7.79%, respectively. Compared with the traditional manual measurement method, the use of mobile end to estimate the body size and weight of yaks can improve the measurement efficiency, facilitate the herdsmen to breed yaks, reduce the stimulation of manual measurement on yaks, and lay a solid foundation for the fine breeding of yaks in Sanjiangyuan region.