Home
Call For Papers
Submission
Author
Registration
Publications
About
Contact Us

  Human Action Recognition System for Automation Application  
  Authors : Sai Kailash; Purav M Shah; Sai Karthik; B Madhukar; K Vijaya
  Cite as:

 

An increasing demand for comfort in personal life has motivated a deep research in home automation systems. Several automation techniques in existence utilize sensors and actuators but the use of video processing system in automation systems would benefit for physically challenged especially the visually challenged for using the automation system effectively. The main theme behind this project lies in automating the process of human activity recognition through visual based recognition systems. While traditional approaches operate on 2-D images and use very computationally intensive algorithms and high dimensional features for activity recognition, recently the introduction of RGB depth cameras has motivated the development of a recognition system with lower dimensional features, system uses less complex algorithms and a faster system. The automation system developed here uses a visual recognition system implemented using Matlab. The recognition system uses a Kinect camera as a video capture device and Fuzzy Inference system for making decisions. The Automation system was developed using a hardware setup consisting of Microcontroller unit and Devices to be automated. The complete system consisting of a video capture device, action recognition system and an Automation system was implemented. The proposed Action recognition system is designed to recognize four different actions from a user which is indicated by controlling four different devices. The implemented system shows a real time performance and suitable for smart home automation systems.

 

Published In : IJCSN Journal Volume 7, Issue 3

Date of Publication : June 2018

Pages : 146-157

Figures :20

Tables : 01

 

Sai Kailash : is a final year B.E student of Electronics and Communication department in BMS College of Engineering under Visvesvaraya Technological University, Belgaum (VTU). Currently he is interning as a Network Security Engineer in QoS Technology, Bangalore and will be pursuing a career in the Cyber Security domain.

Sai Karthik : is a final year B.E student of Electronics and Communication department in BMS College of Engineering under Visvesvaraya Technological University, Belgaum (VTU).

Purav M Shah : is a final year B.E student of Electronics and Communication department in BMS College of Engineering under Visvesvaraya Technological University, Belgaum (VTU).

B Madhukar : is a final year B.E student of Electronics and Communication department in BMS College of Engineering under Visvesvaraya Technological University, Belgaum (VTU). Currently he is interning as Network Security Engineer in QoS Technology, Bangalore and will be pursuing a career in the Cyber Security domain.

K. Vijaya : is working as an assistant professor under the Electronics and Communication department in BMS College of Engineering under Visvesvaraya Technological University, Belgaum (VTU).

 

Matlab, Kinect, Automation, Recognition

A Human Activity Recognition system which forms a part of the video surveillance system was designed and implemented. The recognition system was designed based on the Human skeletal features which were obtained using a Kinect sensor. The recognition system was developed as a software system which takes inputs from the Kinect sensor and delivers the detection result to an Automation system. The Automation system was designed as an automation system with four devices controlled for four different actions from the user. The system was successfully designed and implemented on Matlab along with the necessary hardware and software resources. The results showed that the devices were controlled from actions made by user. The system can be updated to recognize more number of actions in the future. The system can also be updated to work with 3-D images.

 

[1]. Akila.K and Chitrakala.S, “A Comparative Analysis of Various Representations of Human Action Recognition in a Video", IJIRCCE, Vol. 2, Issue 1, January 2014. [2]. Taha, Ahmed, et al. "Human activity recognition for surveillance applications." Proceedings of the 7th International Conference on Information Technology. 2015. [3]. Ahmed Taha, Hala H. Zayed, M. E. Khalifa and El-Sayed M. ElHorbaty, "Exploring Behavior Analysis in Video Surveillance Applications," In The International Journal of Computer Applications (IJCA), Foundation of Computer Science, New York, USA, Volume 93, Number 14, pp. 22-32. May 2014. [4]. Jyotsna E, Akhil P V, Arun Kumar,” Silhouette based human action recognition using PCA and ISOMAP”, International Journal of Advanced Research in Computer and Communication Engineering Vol. 2, Issue 11, November 2013. [5]. Ahmed Taha, Hala H. Zayed, M. E. Khalifa and El-Sayed M. ElHorbaty, "Exploring Behavior Analysis in Video Surveillance Applications," In The International Journal of Computer Applications (IJCA), Foundation of Computer Science, New York, USA, Volume 93, Number 14, pp. 22-32. May 2014. [6]. Lulu Chen, Hong Wei, James Ferryman, "A survey of human motion analysis using depth imagery," In Pattern Recognition Letters, Elsevier Science Inc., Volume 34, Issue 15, pp. 1995- 2006, November 2013. [7]. Raviteja Vemulapalli, Felipe Arrate and Rama Chellappa, "Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group," In Proceedings of the International IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, pp.588-595, June 2014. [8]. Ahmad Jalal, Shaharyar Kamal and Daijin Kim, "A Depth Video Sensor-Based Life-Logging Human Activity Recognition System for Elderly Care in Smart Indoor Environments," In the International Journal of Sensors, Volume 14, Number 7, pp. 11735-11759, July 2014. [9]. Samuele Gasparrini, Enea Cippitelli, Susanna Spinsante and Ennio Gambi, "A Depth-Based Fall Detection System Using a Kinect Sensor," In the International Journal of Sensors, Volume 14, Issue 2, pp. 2756- 2775, February 2014. [10]. Salah Althloothia, Mohammad H. Mahoora, Xiao Zhanga, Richard M. Voylesb, "Human Activity Recognition Using Multi-Features and Multiple Kernel Learning," In Pattern Recognition Journal, Volume 47, Issue 5, pp. 1800–1812, May 2014. [11]. Jiang Wang, Zicheng Liu, Ying Wu, Junsong Yuan, "Mining Actionlet Ensemble for Action Recognition with Depth Cameras," In Proceedings of the International IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island, USA, pp. 1290-1297, June 2012. [12]. Ferda Ofli, Rizwan Chaudhry, Gregorij Kurillo, René Vidal, and Ruzena Bajcsy, "Sequence of the Most Informative Joints (SMIJ): A New Representation for Human Skeletal Action Recognition," In proceedings of the IEEE Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, Rhode Island, USA, PP. 8-13, June 2012. [13]. Kavita V. Bhaltilak, Harleen Kaur, Cherry Khosla, "Human Motion Analysis with the Help of Video Surveillance: A Review," In the International Journal of Computer Science Engineering and Technology (IJCSET), Volume 4, Issue 9, pp. 245-249, September 2014. [14]. Chen Change Loy, "Activity Understanding and Unusual Event Detection in Surveillance Videos," PhD dissertation, Queen Mary University of London, 2010. [15]. Choudhury, Ananya, Anjan Kumar Talukdar, and Kandarpa Kumar Sarma. "A Review on Vision- Based Hand Gesture Recognition and Applications." Intelligent Applications for Heterogeneous System Modeling and Design. IGI Global, 2015. 256-281. [16]. Osunkoya, Toyin, and Johng-Chern Chern. "Gesture-based human-computer-interaction using Kinect for Windows mouse control and Powerpoint presentation." Department of Mathematics and Computer Science, Chicago State University, Chicago, IL 60628 (2013). [17]. Khan, Rafiqul Zaman, and Noor Adnan Ibraheem. "Hand gesture recognition: a literature review." International journal of artificial Intelligence & Applications 3.4 (2012): 161. [18]. Cai, Xingquan, et al. "Infrared Human Posture Recognition Method for Monitoring in Smart Homes Based on Hidden Markov Model." Sustainability 8.9 (2016): 892. [19]. David, Nathan, et al. "Design of a home automation system using arduino." International Journal of Scientific & Engineering Research 6.6 (2015): 795-801. [20]. S. Imran J.Vignesh, V.Singh, Dr.T. Prasath “Smart Home Automation Based On Iot Using Arduino Mega”, International Conference on Current Research in Engineering Science and Technology (ICCREST-2016). [21]. Zhang, Zhengyou. "Microsoft kinect sensor and its effect." IEEE multimedia 19.2 (2012): 4-10. [22]. AIAA OC Rocketry (Revision 3 April 27, 2014 - http://aiaaocrocketry.org) [23]. Smith, Alan G. "Introduction to Arduino." Reference book, September 30 (2011): 1-172. [24]. Arduino Uno “A Product Review”. [25]. https://www.tutorialspoint.com/fuzzy_logic/fuzzy _logic_inference_system.htm