Published In : IJCSN Journal Volume 9, Issue 2

Date of Publication : April 2020

Pages : 79-92

Figures :04

Tables : 02

 

Chirag Kamath : is pursuing his Bachelor of Engineering degree and is a final year student at BMSCE, Department of Information Science and Engineering. He is currently an Associate Software Engineering Intern at Sabre Corp and has previous industry experience as a summer intern at IBM. His research interests include AI & image processing.

Neha Prakash : is currently pursuing her Bachelor of Engineering degree at BMSCE, Department of Information Science and Engineering. She is currently working at Clumio Inc as a Software Engineering Intern. She has previously interned at American Express.

Dr Radhika K R : is a professor at B.M.S College of Engineering. She has an experience of 23 years in teaching a wide area of subjects in Information Science Department at BMSCE. She received her Phd in 2010 and Mtech in 2000 from Vishesvaraya and Bangalore University respectively. She has 40+ publications in various reputed journal. She is a senior member of IEEE. Her area of interests is network security, data mining, cloud security and Biometrics.

 

OCR, text extraction, language translation, skew correction

In this work, a fast and robust document translation service is presented that makes use of both OCR and language translation functionalities. The entire service is semi-automated, thereby requiring minimum effort from the user. The input image is first transferred from the user's phone to a high-performance computing system by means of Bluetooth technology. The image is fed into the application which makes use of a extraction algorithm that accurately extracts the document representing the ROI and further improves image quality using de-noising techniques. The processed image is fed into the Tesseract OCR engine for retrieval of English data and language translation capabilities of Google translate API is leveraged to efficiently translate the English text to Kannada.

 

[1] J. Shang, J. Liu, M. Jiang, X. Ren, C. R. Voss and J. Han, "Automated Phrase Mining from Massive Text Corpora", IEEE Transactions on Knowledge and Data Engineering, vol. 30, pp. 1825 - 1837,Oct. 2018 [2] K.G. Prasad, H. Mathivanan, M. Jayaprakasam and T.V.Geetha, "Document Summarization and Information Extraction for Generation of Presentation Slides" in 2009 International Conference on Advances in Recent Technologies in Communication and Computing, Kottayam, Kerala, India, 27-28 Oct. 2009 [3] N. M. Chidiac, P. Damien and C. Yaacoub, "A Robust Algorithm for Text Extraction from Images" in 2016 39th International Conference on Telecommunications and Signal Processing (TSP), Vienna, Austria, 27-29 Jun. 2016 [4] J. Yuan, Y. Zhang, K. K. Tan and T. H. Lee, "Text Extraction from Images Captured via Mobile and Digital Devices" in IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Singapore, Singapore, 14-17 Jul. 2009 [5] C. Yi and Y. Tian, "Scene Text Recognition in Mobile Applications by Character Descriptor and Structure Configuration", IEEE Transactions on Image Processing, vol. 23, pp. 2972 - 2982, Jul. 2014 [6] Z. Zhu, X. Baojie and W. Guoxin, "Canny edge detection based on Open CV", 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI), Yangzhou, China, 20-22 Oct. 2017 [7] B. Wang and S. S. Fan, "An Improved CANNY Edge Detection Algorithm" in Second International Workshop on Computer Science and Engineering, Qingdao, China, 28-30 Oct. 2009 [8] J. Chen, G. Bai, S. Liang and Z. Li, "Automatic Image Cropping: A Computational Complexity Study" in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 Jun. 2016 [9] C. Cao, J. Liu and Y. Zuo, "Automatic image cropping via the novel saliency detection algorithm" in IEEE 4th International Conference on Software Engineering and Service Science, Beijing, China, 23-25 May. 2013 [10] Y. L. Chen, T. W. Huang, K. H. Chang, Y. C. Tsai, H. T. Chen and B. Y. Chen, "Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study" in IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA, 24-31 Mar. 2017 [11] Y. Kao, R. He and K. Huang, "Automatic image cropping with aesthetic map and gradient energy map" in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA, 5-9 Mar. 2017 [12] G. Guo, H. Wang, C. Shen, Y. Yan and H. Y. M. Liao, "Automatic Image Cropping for Visual Aesthetic Enhancement Using Deep Neural Networks and Cascaded Regression", IEEE Transactions on Multimedia, vol. 20, pp. 2073 - 2085, Aug. 2018 [13] W. Li, M. Breier and D. Merhof, "Skew correction and line extraction in binarized printed text images" in IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada, 27-30 Sep. 2015 [14] M. Wagdy, I. Faye and D. Rohaya, "Document image skew detection and correction method based on extreme points" in International Conference on Computer and Information Sciences (ICCOINS), Kuala Lumpur, Malaysia, 3-5 Jun. 2014 [15] M. Golpardaz and H. Nezamabadi-Pour, "Perspective Rectification and Skew Correction in Camera-Based Farsi Document Images", 7th Iranian Conference on Machine Vision and Image Processing, Tehran, Iran, 16-17 Nov. 2011 [16] C. Sun and. Si, "Skew and slant correction for document images using gradient direction" in Proceedings of the Fourth International Conference on Document Analysis and Recognition, Ulm, Germany, Germany, 18-20 Aug. 1997 [17] Z. Junyou, "A Quickly Skew Correction Algorithm of Bill Image" in 2010 Third International Conference on Information and Computing, Wuxi, China, 4-6 Jun. 2010 [18] S. Malakar, B. Seraogi, R. Sarkar, N. Das, S. Basu and M. Nasipuri, "Two-stage skew correction of handwritten Bangla document images" in Third International Conference on Emerging Applications of Information Technology, Kolkata, India, 30 Nov.-1 Dec. 2012 [19] H. Y. Wang, R. Z. Zhao and J. A. Cui, "Fast and robust skew correction in scanned document images based on low-rank matrix decomposition" in International Conference on Machine Learning and Cybernetics, Lanzhou, China, 13-16 Jul. 2014 [20] L. Junjuan and T. Guoxin, "An Efficient Algorithm for Skew-Correction of Document Image Based on Cyclostyle Matching" in International Conference on Computer Science and Software Engineering, Hubei, China, 12-14 Dec. 2008 [21] Q. Yuan and C.L. Tan, "Text extraction from gray scale document images using edge information" in Proceedings of Sixth International Conference on Document Analysis and Recognition, Seattle, WA, USA, USA, 13 Sep. 2001 [22] Antony P.J, Ajith V.P. and Soman K.P., "Kernel Method for English to Kannada Transliteration" in International Conference on Recent Trends in Information, Telecommunication and Computing, Kochi, Kerala, India, 12-13 Mar. 2010 [23] M. M. Kodabagi and S. A. Angadi, "A methodology for machine translation of simple sentences from Kannada to English language" in 2nd International Conference on Contemporary Computing and Informatics (IC3I), Noida, India, 14-17 Dec. 2016 [24] S. Parameswarappa and V.N. Narayana, "Sense disambiguation of simple prepositions in English to Kannada Machine Translation" in International Conference on Data Science & Engineering (ICDSE), Cochin, Kerala, India, 18-20 Jul. 2012 [25] T. C. Wei, U. U. Sheikh and A. A. A. Rahman, "Improved optical character recognition with deep neural network", 2018 IEEE 14th International Colloquium on Signal Processing & Its Applications (CSPA), Batu Feringghi, Malaysia, 9-10 Mar. 2018 [26] S. Thakare, A. Kamble, V. Thengne and U.R. Kamble, "Document Segmentation and Language Translation Using Tesseract-OCR" in 2018 IEEE 13th International Conference on Industrial and Information Systems (ICIIS), Rupnagar, India, 1-2 Dec. 2018 [27] R. Smith, "An Overview of the Tesseract OCR Engine" in Ninth International Conference on Document Analysis and Recognition (ICDAR 2007),Parana, Brazil, 23-26 Sept. 2007 [28] D. Berchmans and S. S. Kumar, "Optical character recognition: An overview and an insight" in International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT), Kanyakumari, India, 10-11 Jul. 2014 [29] B. Dhruv, N. Mittal and M. Modi "Analysis of different filters for noise reduction in images" in Recent Developments in Control, Automation & Power Engineering (RDCAPE), Noida, India, 26-27 Oct. 2017 [30] R. K. Pandey, S.R.Maiya and A. G Ramakrishnan, "A new approach for upscaling document images for improving their quality" in 14th IEEE India Council International Conference (INDICON), Roorkee, India, 15-17 Dec. 2017 [31] K. He, X. C. Luan, C. H. Li and R. Lui, "Gaussian Noise Removal of Image on the Local Feature" in Second International Symposium on Intelligent Information Technology Application, Shanghai, China, 20-22 Dec. 2008 [32] N. U. Khan, K.V. Arya and M. Pattanaik, "An efficient image noise removal and enhancement method" in IEEE International Conference on Systems, Man and Cybernetics, Istanbul, Turkey, Istanbul, Turkey, Istanbul, Turkey [33] C. Yi, "An English POS Tagging Approach Based on Maximum Entropy" in International Conference on Intelligent Transportation, Big Data and Smart City, Halong Bay, Vietnam,19-20 Dec. 2015 [34] X. Han, Y. Dang, L. Mei, Y. Wang, S. Li and X. Zhou, "A Novel Part of Speech Tagging Framework for NLP Based Business Process Management" in 2019 IEEE International Conference on Web Services (ICWS), Milan, Italy, 8-13 Jul. 2019 [35] M. Zhang, N. Yu and G. Fu, "A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 26, pp. 1528 - 1538, Sep. 2018 [36] D. N. Mati, M. Hamiti, J. Ajdari, B. Selimi, and B. Raufi, "A Systematic Mapping Study of Language Features Identification from Large Text Collection" in 8th Mediterranean Conference on Embedded Computing (MECO), Budva, Montenegro, 10-14 Jun. 2019 [37] Ankita and K. A. Abdul Nazeer, "Part-of-speech Tagging and Named Entity Recognition Using Improved Hidden Markov Model and Bloom Filter" in International Conference on Computing, Power and Communication Technologies, Greater Noida, Uttar Pradesh, India, 28-29 Sep. 2018 [38] Kemal Kurniawan and Alham Fikri Aji, "Toward a Standardized and More Accurate Indonesian Part-of-Speech Tagging" in International Conference on Asian Language Processing (IALP), Bandung, Indonesia,15-17 Nov. 2018 [39] L. Q. Zuo, H. M. Sun, Q. C. Mao, R. Qi and R. S. Jia, "Natural Scene Text Recognition Based on Encoder-Decoder Framework", IEEE Access, vol. 7, pp. 62616 - 62623, May. 2019 [40] A. Pawar, S. Du, V. Mago and H. Kaur Janda, "Syntactic, Semantic and Sentiment Analysis: The Joint Effect on Automated Essay Evaluation", IEEE Access, vol. 7, pp. 108486 - 108503, Aug. 2019 [41] J. L. Wu and W. Y. Ma, "A Deep Learning Framework for Coreference Resolution Based on Convolutional Neural Network" in IEEE 11th International Conference on Semantic Computing (ICSC), San Diego, CA, USA, 30 Jan.-1 Feb. 2017 [42] Y. Huang, A. Li, J. Huang, L. Lan, X. Yin and Y. Jia, "Person Entity Attribute Extraction Based on Siamese Network", IEEE Access, vol. 7, pp. 64506 - 64516, May. 2019 [43] S. Joty, G. Carenini, R. Ng and G. Murray, "Discourse Processing and Its Applications in Text Mining" in 2018 IEEE International Conference on Data Mining (ICDM), Singapore, 17-20 Nov. 2018 [44] P. Gamallo, M. Garcia, C. Pineiro, R. Martinex-Costani and J. C. Pichel, "LinguaKit: a Big Data-based multilingual tool for linguistic analysis and information extraction" in 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS), Valencia, Spain, 15-18 Oct. 2018 [45] P. Das, A. K. Das, J. Nayak, D. Pe5.lusi and W. Ding, "A Graph based Clustering Approach for Relation Extraction from Crime Data", IEEE Access, vol. 7, pp. 101269 - 101282, Jul. 2019 [46] J. Xu, H. He, X. Sun, X. Ren and S. Li, "Cross-Domain and Semi-Supervised Named Entity Recognition in Chinese Social Media: A Unified Model", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 26, pp. 2142 - 2152, Jul. 2018 [47] T. Tran and D. T. Nguyen, "Text Generation from Abstract Semantic Representation for Summarizing Vietnamese Paragraphs Having Co-references" in 5th NAFOSTED Conference on Information and Computer Science (NICS), Ho Chi Minh City, Vietnam, 23-24 Nov. 2018 [48] H. Li, J. Zhu, C. Ma, J. Zhang and C. Zong, "Read, Watch, Listen and Summarize: Multi-modal Summarization for Asynchronous Text, Image, Audio and Video", IEEE Transactions on Knowledge and Data Engineering, vol. 31, pp. 996 - 1009, May. 2019 [49] S. García-Méndez, M. Fernández-Gavilanes, E. Costa-Montenegro, J. Juncal-Martínez, F. J. González-Castaño and E. Reiter, "A System for Automatic English Text Expansion", IEEE Access, vol. 7, pp. 123320 - 123333, Aug. 2019 [50] Shivakumar K.M, Shivaraju N, V. Sreekanta and D. Gupta, "Comparitive Study of Factored SMT with Baseline SMT for English to Kannada", 2016 International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India, 26-27 Aug. 2016 [51] M. Bansal and G. Jain, "Improvement of English-Hindi Machine Translation using ConceptNet", 2017 recent Developments in Control, Automation & Power Engineering (RDCAPE), Noida, India, 26-27 Oct. 2017 [52] K. K. Yadav and U. C. Jaiswal, "A Survey Paper on Performance Improvement of Word Alignment in English to Hindi Translation System", 2017 International Conference on Intelligent Computing and Control (I2C2), Coimbatore, India, 23-24 June 2017 [53] J. Nair, A. Krishnan, R. Deetha, "An Efficient English to Hindi Machine Translation System Using Hybrid Mechanism", 2016 Intl. Conference on Advances in Computing, Communications and Informatics (ICACCI), Jaipur, India, Sept. 21-24, 2016. [54] P. Kumar, S. Srivastava and M. Joshi, "Syntax directed translator for English to Hindi language", 2015 IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Kolkata, India, 20-22 Nov. 2015 [55] M. Kasthuri and S. B. R. Kumar, "Rule Based Machine Translation System from English to Tamil", 2014 World Congress on Computing and Communication Technologies, Trichirappalli, India, 27 Feb.-1 March 2014 [56] S. Rajpirathap, S. Sheeyam, K. Umasuthan and A. Chelvarajah, "Real-time direct translation system for Sinhala and Tamil languages", 2015 Federated Conference on Computer Science and Information Systems (FedCSIS), Lodz, Poland, 13-16 Sept. 2015 [57] V. Goyal and G. S. Lehal, "Hindi to Punjabi Machine Translation System", International Conference on Information Systems for Indian Languages, vol. 139, pp 236-241. Springer, Berlin, Heidelberg [58] K. A. Patel and J. S. Pareek, "GH-MAP: translation system for sibling language pair Gujarati-Hindi", CSI Transactions on ICT, vol. 1, pp. 183-192, June 2013 [59] Z. Islam, J. Tieddemann and A. Eisele, "English to Bangla Phrase-Based Machine Translation", EAMT, St. Raphael, France, May 2010 [60] R. Narayan, V. P. Singh and S. Chakraverty, "Quantum Neural Network Based Machine Translator for Hindi to English", The Scientific World Journal, vol. 2014, 27 Feb. 2014 [61] B. Epshtein, E. Ofek, and Y. Wexler, "Detecting Text in Natural Scenes with stroke width transform," IEEE Conf. Comput. Vis. Pattern Recognit, no. d, pp. 2963-2970, 2010. [62] V. Yadav and N. Ragot, "Text Extraction in Document Images: Highlight on Using Corner Points", 2016 12th IAPR Workshop on Document Analysis Systems (DAS), Santorini, Greece, 11-14 April 2016 [63] Wahyono, M. Jeong, and J. Kang-Hyun, "Multi Language Text Detection Using Fast Stroke Width Transform," 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Jan. 2015. [64] G. Sahoo, T. Kumar, B. L. Raina and C. M. Bhatial, "Text extraction and enhancement of binary images using cellular automata", International Journal of Automation and Computing, Aug. 2009 [65] R. Islam, Md. R. Islam and K. H. Talukder, "An approach to extract text regions from scene image", 2016 International Conference on Computing, Analytics and Security Trends (CAST), Pune, India, 19-21 Dec. 2016 [66] A. Park, K. Jung. (2007) Automatic Word Detection System for Document Image Using Mobile Devices. In: Jacko J.A. (eds) Human-Computer Interaction. Interaction Platforms and Techniques. HCI 2007. Lecture Notes in Computer Science, vol 4551. Springer, Berlin, Heidelberg [67] R. Smith "Hybrid Page Layout Analysis via Tab-Stop Detection" in 10th International Conference on Document Analysis and Recognition, Barcelona, Spain, 26-29 Jul, 2009. [68]S. Chernenko. "Free Google Translate API" Available: https://github.com/sergei4e/gtrans [Accessed Apr. 22, 2019] [69] "OpenCV Documentation", Jun, 2000. [Online]. Available: https://docs.opencv.org/master/. [Accessed: Mar. 12, 2019].