Context-FOFE Based Deep Learning Models for Text Classification and Modeling

dc.contributor.advisorJiang, Hui
dc.creatorLin, Yuping
dc.date.accessioned2018-03-01T14:10:04Z
dc.date.available2018-03-01T14:10:04Z
dc.date.copyright2017-08-16
dc.date.issued2018-03-01
dc.date.updated2018-03-01T14:10:04Z
dc.degree.disciplineComputer Science
dc.degree.levelMaster's
dc.degree.nameMSc - Master of Science
dc.description.abstractText classification is a fundamental task in natural language processing. Many recently proposed deep learning models have leveraged context information in documents and achieved great successes. However, most of these models use complicated recurrent structures to handle the variable-length text and to record context information, which are hard to train. In this case, we propose a simple and efficient encoding scheme called context-FOFE that can encode context of variable-length documents into fixed-size representations. Our encoding is unique and reversible for any text sequence. Based on the encoded representations of documents, we further use two feed-forward neural network models and a generative HOPE model for text classification and modeling. We tested the models on the 20 Newsgroups text classification dataset and the IMDB sentiment analysis dataset. Experimental results show that our models can achieve competitive performance as the existing best models while using much simpler context encoding mechanism and network structure.
dc.identifier.urihttp://hdl.handle.net/10315/34392
dc.language.isoen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subjectComputer science
dc.subject.keywordsText classification
dc.subject.keywordsText modeling
dc.subject.keywordsContext
dc.subject.keywordsDeep learning
dc.subject.keywordsFeed-forward neural network
dc.subject.keywordsHOPE
dc.subject.keywordsFOFE
dc.titleContext-FOFE Based Deep Learning Models for Text Classification and Modeling
dc.typeElectronic Thesis or Dissertation

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Lin_Yuping_2017_Masters.pdf
Size:
1.38 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
license.txt
Size:
1.83 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.38 KB
Format:
Plain Text
Description: