[MLBench'25] Fifth Workshop on
Benchmarking and Performance of Machine Learning Workloads on Emerging Hardware

About

With evolving system architectures, hardware and software stacks, diverse machine learning (ML) workloads, and data, it is important to understand how these components interact with each other. Well-defined benchmarking procedures help evaluate and reason the performance gains with ML workload-to-system mappings. In this MLBench workshop, we welcome all novel submissions in benchmarking machine learning workloads from all disciplines, such as image and speech recognition, language processing, drug discovery, simulations, and scientific applications.

Key problems that we seek to address are:
(i) which representative ML benchmarks cater to workloads seen in industry, national labs, and interdisciplinary sciences;
(ii) how to characterize the ML workloads based on their interaction with hardware;
(iii) which novel aspects of hardware, such as heterogeneity in compute, memory, and networking, will drive their adoption;
(iv) performance modeling and projections to next-generation hardware.

Along with selected publications, the workshop program will also have experts in these research areas presenting their recent work and potential directions to pursue. This year, MLBench will be co-located with ASPLOS and EuroSys. Also, MLCommons will sponsor a best student paper award for an outstanding submission!

The program details from the previous workshops held are at MLSys'23, MLSys'22, MLSys'21 and MLSys'20.

Call for Papers

We solicit both full papers (8-10 pages) and short/position papers (4-6 pages). Submissions are double-blinded. The page limit includes figures, tables, and appendices, but excludes references. Please use standard LaTeX or Word ACM templates. All submissions will need to be made via EasyChair (submission website: here). Each submission will be reviewed by at least three reviewers from the program committee. Papers will be reviewed for novelty, quality, technical strength, and relevance to the workshop. All accepted papers will be published here.

Important dates

Submission Deadline: 2/11/25
Acceptance Notification: 2/21/25
Camera Ready Submission Deadline: 3/14/25
Workshop date: 3/30/25
All deadlines are at midnight anywhere on earth (AoE), and are firm.