|
Math @ Duke
|
Publications [#383826] of Kyle J. Lafata
Papers Published
- Ray, A; Lafata, K; Zhang, Z; Xiong, Y; Chakrabarty, K, Privacy-preserving Job Scheduler for GPU Sharing,
Proceedings 23rd IEEE ACM International Symposium on Cluster Cloud and Internet Computing Workshops Ccgridw 2023
(January, 2023),
pp. 337-339 [doi]
(last updated on 2026/01/17)
Abstract: Machine learning (ML) training jobs are resource intensive. High infrastructure costs of computing clusters encourage multi-tenancy in GPU resources. This invites a scheduling problem in assigning multiple ML training jobs on a single GPU while minimizing task interference. Our paper introduces a clustering-based privacy-preserving job scheduler that minimizes task interference without accessing sensitive user data. We perform ML workload characterization, made available publicly [1], and do exploratory data analysis to cluster ML workloads. Consequently, we build a knowledge base of inter and intra-cluster task interference to minimize task interference.
|
|
|
|
dept@math.duke.edu
ph: 919.660.2800
fax: 919.660.2821
| |
Mathematics Department
Duke University, Box 90320
Durham, NC 27708-0320
|
|