An increasing demand for comfort in personal life has motivated a deep research in home automation systems. Several
automation techniques in existence utilize sensors and actuators but the use of video processing system in automation systems would
benefit for physically challenged especially the visually challenged for using the automation system effectively. The main theme behind
this project lies in automating the process of human activity recognition through visual based recognition systems. While traditional
approaches operate on 2-D images and use very computationally intensive algorithms and high dimensional features for activity
recognition, recently the introduction of RGB depth cameras has motivated the development of a recognition system with lower
dimensional features, system uses less complex algorithms and a faster system. The automation system developed here uses a visual
recognition system implemented using Matlab. The recognition system uses a Kinect camera as a video capture device and Fuzzy
Inference system for making decisions. The Automation system was developed using a hardware setup consisting of Microcontroller unit
and Devices to be automated. The complete system consisting of a video capture device, action recognition system and an Automation
system was implemented. The proposed Action recognition system is designed to recognize four different actions from a user which is
indicated by controlling four different devices. The implemented system shows a real time performance and suitable for smart home
automation systems.
Published In:IJCSN Journal Volume 7, Issue 3
Date of Publication : June 2018
Pages : 146-157
Figures :20
Tables : 01
Sai Kailash : is a final year B.E student of Electronics and
Communication department in BMS College of Engineering under
Visvesvaraya Technological University, Belgaum (VTU). Currently
he is interning as a Network Security Engineer in QoS Technology,
Bangalore and will be pursuing a career in the Cyber Security
domain.
Sai Karthik : is a final year B.E student of Electronics and
Communication department in BMS College of Engineering under
Visvesvaraya Technological University, Belgaum (VTU).
Purav M Shah : is a final year B.E student of Electronics and
Communication department in BMS College of Engineering under
Visvesvaraya Technological University, Belgaum (VTU).
B Madhukar : is a final year B.E student of Electronics and
Communication department in BMS College of Engineering under
Visvesvaraya Technological University, Belgaum (VTU). Currently
he is interning as Network Security Engineer in QoS Technology, Bangalore and will be pursuing a career in the Cyber Security
domain.
K. Vijaya : is working as an assistant professor under the
Electronics and Communication department in BMS College of
Engineering under Visvesvaraya Technological University,
Belgaum (VTU).
Matlab, Kinect, Automation, Recognition
A Human Activity Recognition system which forms a part
of the video surveillance system was designed and
implemented. The recognition system was designed based
on the Human skeletal features which were obtained using
a Kinect sensor. The recognition system was developed as
a software system which takes inputs from the Kinect
sensor and delivers the detection result to an Automation
system. The Automation system was designed as an
automation system with four devices controlled for four
different actions from the user. The system was
successfully designed and implemented on Matlab along
with the necessary hardware and software resources. The
results showed that the devices were controlled from
actions made by user.
The system can be updated to recognize more number of
actions in the future. The system can also be updated to
work with 3-D images.
[1]. Akila.K and Chitrakala.S, “A Comparative
Analysis of Various Representations of Human
Action Recognition in a Video", IJIRCCE, Vol.
2, Issue 1, January 2014.
[2]. Taha, Ahmed, et al. "Human activity recognition
for surveillance applications." Proceedings of the
7th International Conference on Information
Technology. 2015.
[3]. Ahmed Taha, Hala H. Zayed, M. E. Khalifa and
El-Sayed M. ElHorbaty, "Exploring Behavior
Analysis in Video Surveillance Applications," In
The International Journal of Computer
Applications (IJCA), Foundation of Computer
Science, New York, USA, Volume 93, Number
14, pp. 22-32. May 2014.
[4]. Jyotsna E, Akhil P V, Arun Kumar,” Silhouette
based human action recognition using
PCA and ISOMAP”, International Journal of
Advanced Research in Computer and
Communication Engineering Vol. 2, Issue 11,
November 2013.
[5]. Ahmed Taha, Hala H. Zayed, M. E. Khalifa and
El-Sayed M. ElHorbaty, "Exploring Behavior
Analysis in Video Surveillance Applications," In
The International Journal of Computer
Applications (IJCA), Foundation of Computer
Science, New York, USA, Volume 93, Number
14, pp. 22-32. May 2014. [6]. Lulu Chen, Hong Wei, James Ferryman, "A
survey of human motion analysis using depth imagery," In Pattern Recognition Letters, Elsevier
Science Inc., Volume 34, Issue 15, pp. 1995-
2006, November 2013.
[7]. Raviteja Vemulapalli, Felipe Arrate and Rama
Chellappa, "Human Action Recognition by
Representing 3D Skeletons as Points in a Lie
Group," In Proceedings of the International IEEE
Conference on Computer Vision and Pattern
Recognition (CVPR), Columbus, Ohio, USA,
pp.588-595, June 2014.
[8]. Ahmad Jalal, Shaharyar Kamal and Daijin Kim,
"A Depth Video Sensor-Based Life-Logging
Human Activity Recognition System for Elderly
Care in Smart Indoor Environments," In the
International Journal of Sensors, Volume 14,
Number 7, pp. 11735-11759, July 2014.
[9]. Samuele Gasparrini, Enea Cippitelli, Susanna
Spinsante and Ennio Gambi, "A Depth-Based
Fall Detection System Using a Kinect Sensor," In
the International Journal of Sensors, Volume 14,
Issue 2, pp. 2756- 2775, February 2014.
[10]. Salah Althloothia, Mohammad H. Mahoora, Xiao
Zhanga, Richard M. Voylesb, "Human Activity
Recognition Using Multi-Features and Multiple
Kernel Learning," In Pattern Recognition Journal,
Volume 47, Issue 5, pp. 1800–1812, May 2014.
[11]. Jiang Wang, Zicheng Liu, Ying Wu, Junsong
Yuan, "Mining Actionlet Ensemble for Action
Recognition with Depth Cameras," In
Proceedings of the International IEEE Conference
on Computer Vision and Pattern Recognition
(CVPR), Providence, Rhode Island, USA, pp.
1290-1297, June 2012.
[12]. Ferda Ofli, Rizwan Chaudhry, Gregorij Kurillo,
René Vidal, and Ruzena Bajcsy, "Sequence of the
Most Informative Joints (SMIJ): A New
Representation for Human Skeletal Action
Recognition," In proceedings of the IEEE
Computer Vision and Pattern Recognition
Workshops (CVPRW), Providence, Rhode Island,
USA, PP. 8-13, June 2012.
[13]. Kavita V. Bhaltilak, Harleen Kaur, Cherry
Khosla, "Human Motion Analysis with the Help
of Video Surveillance: A Review," In the
International Journal of Computer Science
Engineering and Technology (IJCSET), Volume
4, Issue 9, pp. 245-249, September 2014.
[14]. Chen Change Loy, "Activity Understanding and
Unusual Event Detection in Surveillance Videos,"
PhD dissertation, Queen Mary University of
London, 2010.
[15]. Choudhury, Ananya, Anjan Kumar Talukdar, and
Kandarpa Kumar Sarma. "A Review on Vision-
Based Hand Gesture Recognition and
Applications." Intelligent Applications for
Heterogeneous System Modeling and Design. IGI
Global, 2015. 256-281.
[16]. Osunkoya, Toyin, and Johng-Chern Chern.
"Gesture-based human-computer-interaction
using Kinect for Windows mouse control and
Powerpoint presentation." Department of
Mathematics and Computer Science, Chicago
State University, Chicago, IL 60628 (2013).
[17]. Khan, Rafiqul Zaman, and Noor Adnan
Ibraheem. "Hand gesture recognition: a literature
review." International journal of artificial
Intelligence & Applications 3.4 (2012): 161.
[18]. Cai, Xingquan, et al. "Infrared Human Posture
Recognition Method for Monitoring in Smart
Homes Based on Hidden Markov
Model." Sustainability 8.9 (2016): 892.
[19]. David, Nathan, et al. "Design of a home
automation system using arduino." International
Journal of Scientific & Engineering Research 6.6
(2015): 795-801.
[20]. S. Imran J.Vignesh, V.Singh, Dr.T. Prasath
“Smart Home Automation Based On Iot Using
Arduino Mega”, International Conference on
Current Research in Engineering Science and
Technology (ICCREST-2016).
[21]. Zhang, Zhengyou. "Microsoft kinect sensor and
its effect." IEEE multimedia 19.2 (2012): 4-10.
[22]. AIAA OC Rocketry (Revision 3 April 27, 2014 -
http://aiaaocrocketry.org)
[23]. Smith, Alan G. "Introduction to
Arduino." Reference book, September 30 (2011):
1-172.
[24]. Arduino Uno “A Product Review”.
[25]. https://www.tutorialspoint.com/fuzzy_logic/fuzzy
_logic_inference_system.htm