Title:
Knowledge Reasoning with Graph Neural Networks
Knowledge Reasoning with Graph Neural Networks
| dc.contributor.advisor | Zhang, Chao | |
| dc.contributor.advisor | Song, Le | |
| dc.contributor.author | Zhang, Yuyu | |
| dc.contributor.committeeMember | Yang, Diyi | |
| dc.contributor.committeeMember | Xie, Yao | |
| dc.contributor.committeeMember | Ramamurthy, Arun | |
| dc.contributor.department | Computational Science and Engineering | |
| dc.date.accessioned | 2022-01-14T16:13:31Z | |
| dc.date.available | 2022-01-14T16:13:31Z | |
| dc.date.created | 2021-12 | |
| dc.date.issued | 2021-12-15 | |
| dc.date.submitted | December 2021 | |
| dc.date.updated | 2022-01-14T16:13:32Z | |
| dc.description.abstract | Knowledge reasoning is the process of drawing conclusions from existing facts and rules, which requires a range of capabilities including but not limited to understanding concepts, applying logic, and calibrating or validating architecture based on existing knowledge. With the explosive growth of communication techniques and mobile devices, much of collective human knowledge resides on the Internet today, in unstructured and semi-structured forms such as text, tables, images, videos, etc. It is overwhelmingly difficult for human to navigate the gigantic Internet knowledge without the help of intelligent systems such as search engines and question answering systems. To serve various information needs, in this thesis, we develop methods to perform knowledge reasoning over both structured and unstructured data. This thesis attempts to answer the following research questions on the topic of knowledge reasoning: (1) How to perform multi-hop reasoning over knowledge graphs? How should we leverage graph neural networks to learn graph-aware representations efficiently? And, how to systematically handle the noise in human questions? (2) How to combine deep learning and symbolic reasoning in a consistent probabilistic framework? How to make the inference efficient and scalable for large-scale knowledge graphs? Can we strike a balance between the representation power and the simplicity of the model? (3) What is the reasoning pattern of graph neural networks for knowledge-aware QA tasks? Can those elaborately designed GNN modules really perform complex reasoning process? Are they under- or over-complicated? Can we design a much simpler yet effective model to achieve comparable performance? (4) How to build an open-domain question answering system that can reason over multiple retrieved documents? How to efficiently rank and filter the retrieved documents to reduce the noise for the downstream answer prediction module? How to propagate and assemble the information among multiple retrieved documents? (5) How to answer the questions that require numerical reasoning over textual passages? How to enable pre-trained language models to perform numerical reasoning? We explored the research questions above and discovered that graph neural networks can be leveraged as a powerful tool for various knowledge reasoning tasks over both structured and unstructured knowledge sources. On structured graph-based knowledge source, we build graph neural networks on top of the graph structure to capture the topology information for downstream reasoning tasks. On unstructured text-based knowledge source, we first identify graph-structured information such as entity co-occurrence and entity-number binding, and then employ graph neural networks to reason over the constructed graphs, working together with pre-trained language models to handle unstructured part of the knowledge source. | |
| dc.description.degree | Ph.D. | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | http://hdl.handle.net/1853/66172 | |
| dc.language.iso | en_US | |
| dc.publisher | Georgia Institute of Technology | |
| dc.subject | Knowledge graph | |
| dc.subject | Graph neural networks | |
| dc.title | Knowledge Reasoning with Graph Neural Networks | |
| dc.type | Text | |
| dc.type.genre | Dissertation | |
| dspace.entity.type | Publication | |
| local.contributor.advisor | Zhang, Chao | |
| local.contributor.advisor | Song, Le | |
| local.contributor.corporatename | College of Computing | |
| local.contributor.corporatename | School of Computational Science and Engineering | |
| relation.isAdvisorOfPublication | 56737267-494f-4a81-bdf3-a271680c1bf1 | |
| relation.isAdvisorOfPublication | b279cef1-4f3d-40b1-852c-1ccfe5fbbd26 | |
| relation.isOrgUnitOfPublication | c8892b3c-8db6-4b7b-a33a-1b67f7db2021 | |
| relation.isOrgUnitOfPublication | 01ab2ef1-c6da-49c9-be98-fbd1d840d2b1 | |
| thesis.degree.level | Doctoral |