Recurrent Neural Networks for Decoding Lip Read Speech
Conference paper
Fenghour, S, Chen, D and Xiao, P (2019). Recurrent Neural Networks for Decoding Lip Read Speech. 2019 8th International Conference on Software and Information Engineering (ICSIE 2019). Cairo 09 - 12 Apr 2019
| Authors | Fenghour, S, Chen, D and Xiao, P |
|---|---|
| Type | Conference paper |
| Abstract | The success of automated lip reading has been constrained by the inability to distinguish between homopheme words, which are words have different characters and produce the same lip movements (e.g. ”time” and ”some”), despite being intrinsically different. One word can often have different phonemes (units of sound) producing exactly the viseme or visual equivalent of phoneme for a unit of sound. Through the use of a Long-Short Term Memory Network with word embeddings, we can distinguish between homopheme words or words that produce identical lip movements. The neural network architecture achieved a character accuracy rate of 77.1% and a word accuracy rate of 72.2%. |
| Year | 2019 |
| Accepted author manuscript | License CC BY 4.0 |
| Publication dates | |
| 09 Apr 2019 | |
| Publication process dates | |
| Deposited | 20 Mar 2019 |
| Accepted | 18 Mar 2019 |
Permalink -
https://openresearch.lsbu.ac.uk/item/866z8
62
total views38
total downloads7
views this month5
downloads this month
Related outputs
Design of a voice control 6DoF grasping robotic arm based on ultrasonic sensor, computer vision and Alexa voice assistance
Wang, Z, Chen, D and Xiao, P (2019). Design of a voice control 6DoF grasping robotic arm based on ultrasonic sensor, computer vision and Alexa voice assistance. International Conference on Information Technology in Medicine and Education. Qingdao, China 23 - 25 Aug 2019Towards automated cost analysis, benchmarking and estimating in construction: a machine learning approach
Chen, D, Hajderanj, L and Fiske, J (2019). Towards automated cost analysis, benchmarking and estimating in construction: a machine learning approach. 13th Multi Conference on Computer Science and Information Systems (MCCSIS). Porto, Portugal 16 - 18 Jul 2019In-Vivo Skin Capacitive Image Classification Using AlexNet Convolution Neural Network
Zhang, X, Pan, W and Xiao, P (2018). In-Vivo Skin Capacitive Image Classification Using AlexNet Convolution Neural Network. 2018 3rd International Conference on Image, Vision and Computing (ICIVC 2018). Chongqing, China 27 - 29 Jun 2018 pp. 439-443 doi:10.1109/ICIVC.2018.8492860
Educational Network Bandwidth Analysis and Prediction
Oumar, O A, Dyllon, S and Xiao, P (2018). Educational Network Bandwidth Analysis and Prediction. the 14th International Conference on Machine Learning and Data Mining (MLDM'2018) July 14-19, 2018. New York, USA 14 - 19 Jul 2018Educational Bandwidth Traffic Prediction using Non-Linear Autoregressive Neural Networks
Oumar, O A, Dyllon, S, Xiao, P and Hong, T (2018). Educational Bandwidth Traffic Prediction using Non-Linear Autoregressive Neural Networks. The 21st International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines - CLAWAR 2018. Panama 10 - 12 Sep 2018Micro-relief analysis with skin capacitive imaging
Bontozoglou, C, Zhang, X and Xiao, P (2019). Micro-relief analysis with skin capacitive imaging. Skin Research and Technology. 25 (2), pp. 165-170.Improving Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnosis via RBF Networks trained with EKF models
Adegoke, V, Chen, D and Banissi, E (2019). Improving Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnosis via RBF Networks trained with EKF models. International Journal of Computer Information Systems and Industrial Management.On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
Qin, C, Gao, X and Chen, D (2016). On Distributed Deep Network for Processing Large-Scale Sets of Complex Data. 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC). Hangzhou, China. 27 - 28 Aug 2016 doi:10.1109/IHMSC.2016.55Decoder-Encoder LSTM for Lip Reading
Fanghour, S, Chen, D and Xiao, P (2019). Decoder-Encoder LSTM for Lip Reading. 2019 8th International Conference on Software and Information Engineering (ICSIE 2019). Cairo, Eygpt 09 - 12 Apr 2019Learning Bayesian network parameters via minimax algorithm
Gao, X, Gao, G, Ren, H, Chen, D and He, C (2019). Learning Bayesian network parameters via minimax algorithm. International Journal of Approximate Reasoning. 108, pp. 62-75.A New Supervised t-SNE with Dissimilarity Measure for Effective Data Visualization and Classification
Hajderanj, L, Weheliye, I and Chen, D (2019). A New Supervised t-SNE with Dissimilarity Measure for Effective Data Visualization and Classification. 2019 8th International Conference on Software and Information Engineering. Cairo 09 - 12 Apr 2019Learning Bayesian Networks using the Constrained Maximum a Posteriori Probability Method
Yang, Y, Gao, X, Guo, Z and Chen, D (2019). Learning Bayesian Networks using the Constrained Maximum a Posteriori Probability Method. Pattern Recognition. 91, pp. 123-134.Contour Mapping for Speaker-Independent Lip Reading System
Fenghour, S, Chen, D and Xiao, P (2018). Contour Mapping for Speaker-Independent Lip Reading System. The 11th International Conference on Machine Vision (ICMV 2018). Munich, Germany 01 - 03 Nov 2018Applications of Capacitive Imaging in Human Skin Texture and Hair Analysis
Bontozoglou, C. and Xiao, P. (2019). Applications of Capacitive Imaging in Human Skin Texture and Hair Analysis . MDPI Applied Sciences. 10 (1), p. 256.A Task Scheduling Algorithm for Phased Array Radar Based on Dynamic Three-way Decision
Li, Bo, Tian, Linyu, Chen, Daqing and Han, Yue (2019). A Task Scheduling Algorithm for Phased Array Radar Based on Dynamic Three-way Decision. Sensors.A Task Scheduling Algorithm for Phased Array Radar Based on Dynamic Three-way Decision
Li, Bo, Tian, Linyu, Chen, Daqing and Han, Yue (2019). A Task Scheduling Algorithm for Phased Array Radar Based on Dynamic Three-way Decision. Sensors.Intelligent Flight Control of Combat Aircraft Based on Autoencoder
Li, Bo, Gao, Peixin, Liang, Shiyang and Chen, Daqing (2019). Intelligent Flight Control of Combat Aircraft Based on Autoencoder. 2019 The 4th International Conference on Robotics, Control and Automation. GuangZhou 26 - 28 Jul 2019 doi:https://www.doi.org/10.1145/3351180.3351210Skin Capacitive Imaging Analysis Using Deep Learning GoogLeNet
Zhang, X., Pan, W., Bontozoglou, C., Chirikhina, E., Chen, D. and Xiao, P. (2019). Skin Capacitive Imaging Analysis Using Deep Learning GoogLeNet. Computing Conference 2020. London, UK 16 - 17 Jul 2019 Springer.FRS: A Simple Knowledge Graph Embedding Model for Entity Prediction
Wang, L.F., Lu, X., Jiang, Z., Zhang, Z., Li, R., Zhao, M. and Chen, D. (2019). FRS: A Simple Knowledge Graph Embedding Model for Entity Prediction. Mathematical Biosciences and Engineering. 16 (6), pp. 7789-7807.Predicting Customer Profitability Dynamically over Time: An Experimental Comparative Study
Chen, D., Guo, K. and Li, B. (2019). Predicting Customer Profitability Dynamically over Time: An Experimental Comparative Study. 24th Iberoamerican Congress on Pattern Recognition (CIARP 2019). Havana, Cuba 28 - 31 Oct 2019In Vivo Human Hair Hydration Measurements by Using Opto-Thermal Radiometry
Bontozoglou, C, Zhang, X, Patel, A, Lane, ME and Xiao, P (2019). In Vivo Human Hair Hydration Measurements by Using Opto-Thermal Radiometry. International Journal of Thermophysics. 40 (2).Epsilon Interactive Virtual User Manual (VUM)
Hashimi, OA and Xiao, P (2019). Epsilon Interactive Virtual User Manual (VUM). 2018 International Conference on Computing, Electronics and Communications Engineering, ICCECE 2018. Southend-on-Sea 16 - 17 Aug 2018 pp. 138-143 doi:10.1109/iCCECOME.2018.8658872Enhancing Ensemble Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnostic using optimized EKF-RBFN trained prototypes, The 10th International Conference on Soft Computing and Pattern Recognition
Adegoke, V, Chen, D, Banissi, E and Barikzai, S (2019). Enhancing Ensemble Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnostic using optimized EKF-RBFN trained prototypes, The 10th International Conference on Soft Computing and Pattern Recognition. The 10th International Conference on Soft Computing and Pattern Recognition. Porto, Portugal 13 - 15 Dec 2018Distributed deep networks based on Bagging-Down SGD algorithm
Qin, C, Gao, X and Chen, D (2019). Distributed deep networks based on Bagging-Down SGD algorithm. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics. 41 (5), pp. 1021-1027.Visual analytics in the public sector: An analysis on diversities and similarities of London’s wards
Chen, D, Sanz, BM and Zhao, E (2018). Visual analytics in the public sector: An analysis on diversities and similarities of London’s wards. International Conference on Big Data Analytics, Data Mining and Computational Intelligence 2018 (BigDaCI 2018). Madrid, Spain 18 - 20 Jul 2018 Bigdaci.Developing a web based interactive 3D virtual environment for novel skin measurement instruments
Xiao, P and Al Hashimi, O (2018). Developing a web based interactive 3D virtual environment for novel skin measurement instruments. 2018 Advances in Science and Engineering Technology International Conferences (ASET). Dubai, Sharjah, Abu Dhabi, United Arab Emirates 06 - 07 Feb 2018 London South Bank University. doi:10.1109/ICASET.2018.8376823