| Augmenting Latent Dirichlet Allocation and Rank Threshold Detection with Ontologies Contributor(s): Air Force Institute of Technology (Author) |
|
 |
ISBN: 1502959488 ISBN-13: 9781502959485 Publisher: Createspace Independent Publishing Platform OUR PRICE: $12.30 Product Type: Paperback Published: October 2014 |
| Additional Information |
| BISAC Categories: - Technology & Engineering |
| Physical Information: 0.22" H x 8.5" W x 11.02" (0.58 lbs) 104 pages |
| Descriptions, Reviews, Etc. |
| Publisher Description: In an ever-increasing data rich environment, actionable information must be extracted, filtered, and correlated from massive amounts of disparate often free text sources. The usefulness of the retrieved information depends on how we accomplish these steps and present the most relevant information to the analyst. One method for extracting information from free text is Latent Dirichlet Allocation (LDA), a document categorization technique to classify documents into cohesive topics. Although LDA accounts for some implicit relationships such as synonymy (same meaning) it often ignores other semantic relationships such as polysemy (different meanings), hyponym (subordinate), meronym (part of), and troponomys (manner). To compensate for this deficiency, we incorporate explicit word ontologies, such as WordNet, into the LDA algorithm to account for various semantic relationships. Experiments over the 20 Newsgroups, NIPS, OHSUMED, and IED document collections demonstrate that incorporating such knowledge improves perplexity measure over LDA alone for given parameters. In addition, the same ontology augmentation improves recall and precision results for user queries. |