3D HUMAN POSE ESTIMATION FROM SPORT VIDEOS USING MEDIAPIPE FRAMEWORK

Authors

  • Do Huu Son Tan Trao University, Viet Nam
  • Dinh Thai Son Hung Vuong University, Phu Tho, Vietnam
  • Luong Thi Thanh Minh ICTU
  • Phan Van Nam Tan Trao University, Viet Nam
  • Te Trung Hieu Tan Trao University, Viet Nam
  • Le Van Hung Tan Trao University, Viet Nam

DOI:

https://doi.org/10.51453/2354-1431/2023/975

Keywords:

3D human skeleton, Convolutional, Neural, Networks, Hand action recognition.

Abstract

Human posture estimation is important research applied in many fields such as human-machine interaction, surveillance, sports anal-ysis, etc. From there, it is possible to build intuitive and practical applications with science, technology and life. Therefore, fast and accurate estimation of human posture is a pre-processing step but very important in the process of building applications. In this paper, we propose to use Mediapipe, which is a Microsoft built-in frame-work for 3D human pose estimation. The test was evaluated against the MADS (Martial Arts, Dancing, and Sports Dataset) database, in which we focused on sports videos such as: basketball, volleyball, football, rugby, tennis and badminton. The average estimate error is between 100-200mm. The 3D human posture estimation results are a good result in supporting sports analysis.

Downloads

Download data is not yet available.

References

[1] Y. Lin, X. Jiao, L. Zhao, “Detection of 3D Hu¬man Posture Based on Improved Mediapipe,” Journal of Computer and Communications, 11(02), 102-121, 2023, doi:10.4236/jcc.2023.112008.

[2] S. Radhakrishna, A. Balasubramanyam, “Economical Quaternion Extraction from a Human Skeletal Pose Estimate using 2-D Cameras,” 2023.

[3] S. Radhakrishna, A. Balasubramanyam, “Pedes¬trian Intention Classifier using ID3 Mod¬elled Decision Trees for IoT Edge Devices,” https://arxiv.org/abs/2304.00206, 2023.

[4] V.A.R.Barao, R.C.Coata, J.A.Shibli, M.Bertolini, J.G.S.Souza, “APPLICATIONS OF GOOGLE ME-DIAPIPE POSE ESTIMATION USING A SINGLE CAMERA,” Braz Dent J., 33(1), 1-12, 2022.

[5] J. W. Kim, J. Y. Choi, E. J. Ha, J. H. Choi, “Hu¬man Pose Estimation Using MediaPipe Pose and Op¬timization Method Based on a Humanoid Model,” Applied Sciences (Switzerland), 13(4), 2023, doi:10. 3390/app13042700.

[6] Bazarevsky, V., Grishchenko, I. On-Device, “Real-Time Body Pose Tracking with MediaPipe BlazePose,” Google Research, 2020.

[7] Denavit, J., Hartenberg, R.S, “A kinematic notation for lower-pair mechanisms based on matrices,” Appl. Mech. 1955, 77, 215-221, 1955.

[8] Kim, Tran, Dang, Kang, “Motion and walking stabi¬lization of humanoids using sensory reflex control,” Int. J. Adv. Robot. Syst, 2016.

[9] V. Goldberg, Available online, https://www.vicon.com/, 2021.

[10] J. W. Kim, T. Kim, J. Y. Choi, S. W. Kim, “On the global convergence of univariate dynamic encoding algorithm for searches (uDEAS),” Int. J. Control Au- tom. Syst, 2008.

[11] J. Yun, Choi, J.-W. Kim, S. Kim, “ Automatic detec¬tion of cracks in raw steel block using Gabor filter op¬timized by univariate dynamic encoding algorithm for searches (uDEAS),” NDT E Int, 2009.

[12] E. Kim, M. Kim, S. Kim, J. Kim, “Trajectory gener¬ation schemes for bipedal ascending and descending stairs using univariate dynamic encoding algorithm for searches (uDEAS),” Int. J. Control Autom. Syst, 1061-1071,2010.

[13] J. Kim, H. Ahn, H. Seo, S. Lee, “Optimization of So- lar/Fuel Cell Hybrid Energy System Using the Com¬binatorial Dynamic Encoding Algorithm for Searches (cDEAS),” Energies 2022, 2779, 2022.

[14] D. Goldberg, “Genetic Algorithm in Search, Opti¬mization and Machine Learning,” Addison Wesley: Berkeley, CA, USA, 1999.

[15] J.-W. Kim, T. Kim, Y. Park, S. Kim, “ On load motor parameter identification using univariate dynamic en¬coding algorithm for searches (uDEAS),” IEEE Trans. Energy Convers, 804—-813, 2008.

Downloads

Published

2023-06-27

How to Cite

Đỗ, S., Đinh, S., Lương, M., Phan, N., Tề, H., & Lê, H. (2023). 3D HUMAN POSE ESTIMATION FROM SPORT VIDEOS USING MEDIAPIPE FRAMEWORK. SCIENTIFIC JOURNAL OF TAN TRAO UNIVERSITY, 9(3). https://doi.org/10.51453/2354-1431/2023/975

Issue

Vol. 9 No. 3 (2023): Natural Science - Engineering - Technology

Section

Natural Science and Technology

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All articles published in SJTTU are licensed under a Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA) license. This means anyone is free to copy, transform, or redistribute articles for any lawful purpose in any medium, provided they give appropriate attribution to the original author(s) and SJTTU, link to the license, indicate if changes were made, and redistribute any derivative work under the same license.

Copyright on articles is retained by the respective author(s), without restrictions. A non-exclusive license is granted to SJTTU to publish the article and identify itself as its original publisher, along with the commercial right to include the article in a hardcopy issue for sale to libraries and individuals.

Although the conditions of the CC BY-SA license don't apply to authors (as the copyright holder of your article, you have no restrictions on your rights), by submitting to SJTTU, authors recognize the rights of readers, and must grant any third party the right to use their article to the extent provided by the license.