Query-Aware Data Systems Tuning via Machine Learning

Simple item page
dc.contributor.advisorSzlichta, Jarek
dc.contributor.authorHenderson, Connor Dustin
dc.date.accessioned2023-12-08T14:24:02Z
dc.date.available2023-12-08T14:24:02Z
dc.date.issued2023-12-08
dc.date.updated2023-12-08T14:24:02Z
dc.degree.disciplineComputer Science
dc.degree.levelMaster's
dc.degree.nameMSc - Master of Science
dc.description.abstractModern data systems have hundreds of system configuration parameters which heavily influence the performance of business queries. Manual configuration by experts is painstaking and time consuming. We propose a query-informed tuning system called BLUTune which uses deep reinforcement learning based on advantage actor-critic neural networks to tune configurations within defined resource constraints. We translate high-dimensional query execution plans into a low-dimensional embedding space and illustrate the usefulness of query embeddings for the downstream task of data systems tuning. We train our model based on the estimated cost of queries then fine-tune it using query execution times. We present an experimental study over various synthetic and real-world workloads. One model uses TPC-DS queries such that there are tables from the schema that are not seen during training time. The second is trained under resource constraints to show how the model performs when we limit the memory the system has access to.
dc.identifier.urihttps://hdl.handle.net/10315/41611
dc.languageen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subjectComputer science
dc.subjectArtificial intelligence
dc.subject.keywordsData systems
dc.subject.keywordsKnob tuning
dc.subject.keywordsData science
dc.subject.keywordsMachine learning
dc.subject.keywordsReinforcement learning
dc.subject.keywordsRepresentation learning
dc.subject.keywordsGraph machine learning
dc.titleQuery-Aware Data Systems Tuning via Machine Learning
dc.typeElectronic Thesis or Dissertation

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Connor_Henderson_D_2023_Masters.pdf
Size:
1.9 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
license.txt
Size:
1.87 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.39 KB
Format:
Plain Text
Description:
Download

Collections

Computer Science

All items in the YorkSpace institutional repository are protected by copyright, with all rights reserved except where explicitly noted.