Integrating Natural Language and Visualizations for Exploring Data on Smartwatch

dc.contributor.advisorPrince, Enamul Hoque
dc.contributor.authorVaradarajan, Kaavya
dc.date.accessioned2024-07-18T21:20:35Z
dc.date.available2024-07-18T21:20:35Z
dc.date.copyright2024-04-11
dc.date.issued2024-07-18
dc.date.updated2024-07-18T21:20:34Z
dc.degree.disciplineInformation Systems and Technology
dc.degree.levelMaster's
dc.degree.nameMA - Master of Arts
dc.description.abstractSmartwatches are increasingly popular for collecting and exploring personal data, including health, stocks, and weather information. However, the use of micro-visualizations to present such data faces challenges due to limited screen size and interactivity. To address this problem, we propose integrating natural language (voice) with micro-visualizations (charts) to enhance user comprehension and insights. Leveraging a large language model like ChatGPT, we automatically summarize micro-visualizations and combine them with audio narrations and interactive visualizations to aid users in understanding the data. A user study with sixteen participants suggests that the combination of voice and charts results in superior accuracy, preference, and usefulness compared to presenting charts alone. This highlights the efficacy of integrating natural language with visualizations on smartwatches to improve user interaction and data comprehension.
dc.identifier.urihttps://hdl.handle.net/10315/42147
dc.languageen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subjectArtificial intelligence
dc.subjectInformation technology
dc.subject.keywordsData visualization
dc.subject.keywordsSmartwatch
dc.subject.keywordsChatGPT
dc.subject.keywordsVoice interaction
dc.subject.keywordsCharts
dc.titleIntegrating Natural Language and Visualizations for Exploring Data on Smartwatch
dc.typeElectronic Thesis or Dissertation

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Varadarajan_Kaavya_2024_Masters.pdf
Size:
6.37 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
license.txt
Size:
1.87 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.39 KB
Format:
Plain Text
Description: