Shrinking Sample Search Algorithm for Automatic Tuning of GPU Kernels

Xiang Li, Gagan Agrawal

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Autotuning has been widely studied in high performance computing as a very effective mechanism for improving application performance. Such an approach has become particularly crucial for architectures like the modern GPUs, where obtaining the best performance involves a complex interaction between the architecture and the applications. Autotuning methods rely upon a search strategy, which is designed to search through the (potentially very large) space. A large number of search methods have been proposed in the past, and include both local and global strategies. We observe that on GPU applications, high performing configurations are likely to be spatially clustered. Based on this observation, we propose to apply a strategy we refer to as shrinking sample. This method searches in all areas of the entire space, looking for combinations of different parameter values, and without relying on random (initial) choices that may miss a part of the space. The efficacy and efficiency of this method has been tested against state-of-the-art local and global search algorithms on seven benchmark GPU kernels. Our experiments show that the shrinking-sample method can achieve around 99% percent of the performance from exhaustive search (on average) with orders of magnitude much less tuning time.

    Original languageEnglish (US)
    Title of host publicationProceedings - 2021 IEEE 28th International Conference on High Performance Computing, Data, and Analytics, HiPC 2021
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages262-271
    Number of pages10
    ISBN (Electronic)9781665410168
    DOIs
    StatePublished - 2021
    Event28th IEEE International Conference on High Performance Computing, Data, and Analytics, HiPC 2021 - Virtual, Bangalore, India
    Duration: Dec 17 2021Dec 18 2021

    Publication series

    NameProceedings - 2021 IEEE 28th International Conference on High Performance Computing, Data, and Analytics, HiPC 2021

    Conference

    Conference28th IEEE International Conference on High Performance Computing, Data, and Analytics, HiPC 2021
    Country/TerritoryIndia
    CityVirtual, Bangalore
    Period12/17/2112/18/21

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications
    • Hardware and Architecture
    • Information Systems

    Fingerprint

    Dive into the research topics of 'Shrinking Sample Search Algorithm for Automatic Tuning of GPU Kernels'. Together they form a unique fingerprint.

    Cite this