Exploratory Analysis of Construction Job Opening Advertisements for Investigating Actual Labor Needs Using Web scraping and Text Analytics

Author(s)
Oh, Heung Jin
Advisor(s)
Editor(s)
Associated Organization(s)
Organizational Unit
Organizational Unit
School of Building Construction
School established in 2009
Supplementary to:
Abstract
A comprehensive analysis of construction job opening advertisements was conducted to extract detailed information on wages, locations, and job requirements. This study utilized web scraping and text mining techniques to collect a dataset comprising over 1.4 million job openings across the United States. The research employed a combination of natural language processing (NLP), machine learning (ML), statistical methods, application programming interfaces (APIs), and chatbots across three main chapters. Chapter 1 focused on identifying skill sets required for multiskilled laborers in the construction industry. Chapter 2 examined wage disparities to address issues of workforce equity. In Chapter 3, chatbots were employed to explore additional dynamics within the construction job market. This dissertation introduces an innovative approach to capturing and analyzing large-scale data from construction job advertisements using web scraping and text analytics. The findings aim to revolutionize the understanding and management of the construction job market, providing valuable insights for industry stakeholders. The anticipated long-term benefits include improved strategic decision-making, enhanced workforce management strategies, and greater adaptability to dynamic market changes.
Sponsor
Date
2024-07-09
Extent
Resource Type
Text
Resource Subtype
Dissertation
Rights Statement
Rights URI