An Artificial Intelligence-based language modeling framework

Karim Ouazzane, Jun Li, Hassan B. Kazemian, Yanguo Jing, Richard Boyd

Research output: Contribution to journalArticle

Abstract

The text entry interaction between human and computer could be noisy. The typing stream is a reflection of users' typing behavior that includes ones' fluency of vocabulary, typing habits and typing performance. This research develops an original intermediate layer language modeling framework called Adaptive Language Modeling Intermediate Layer (ALMIL), which can be seen as a communication language layer between human and computer to analyze noisy language stream data and provide users with Text Prediction and Text Correction functions. Then, the ALMIL framework is applied to QWERTY keyboard producing an Intelligent Keyboard hybrid framework, which can be used to analyze users' typing stream, and accordingly correct typing mistakes and predict users typing intention. An extendable Focused Time-Delay Neural Network (FTDNN) n-gram prediction algorithm is also developed to learn from the users' typing history and produce text entry prediction and correction based on historical typing stream. Overall, this research pioneers a comprehensive neural network language modeling process based on cross-experiments between extendible inputs, hidden neurons and noise rates, while statistics based traditional methods have failed to consider possible noises of a language stream. The Computer Simulation Results demonstrate that the proposed Intelligent Keyboard performs better than the conventional keyboard in Text Prediction and Text Correction. In practice, a higher prediction rate could be achieved by combining the First Three Hitting Rate with an English word dictionary.

Original languageEnglish
Pages (from-to)5960-5970
Number of pages11
JournalExpert Systems with Applications
Volume39
Issue number5
DOIs
Publication statusPublished - 1 Apr 2012
Externally publishedYes

Keywords

  • Focused Time-Delay Neural Network
  • Language Modeling Intermediate Layer
  • Neural network
  • Noisy language modeling

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'An Artificial Intelligence-based language modeling framework'. Together they form a unique fingerprint.

  • Cite this