DPC++

krisrak

24.5K views

01 Learn DPC++

Hello DPC++ Memory Management » Buffers and Accessors » Unified Shared Memory Offload Computation

02 Test DPC++

Playground Quiz

Previous: Hello DPC++ Next: » Buffers and Accessors

DPC++ Memory Management

The sections below shows different ways to manage memory when offloading computation to heterogeneous devices.

Buffers and Accessors
Unified Shared Memory (USM)

Buffers and Accessors are new concepts introduced in SYCL specification, it is powerful, handles data dependency elegantly and makes handling 1-2-3 dimentional data objects easy, but may make the code more verbose since it requires creating buffers for each data object and corresponding accessor need to be created to manage memory on device side.

Unified Shared Memory uses a more familiar pointer-based approach to manage memory in heterogeneous programming and may be more easy to get started coming from C++ programming background. Code is also easy to follow since host and device side use the same data objects. Easy when dealing with pointer data objects.

Below are basic examples using both the concepts of memory management, the next couple lessons explains each in more details.

Buffers and Accessors

SYCL specification introduces concepts of Buffers and Accessors to move, control and modify memory on device. Buffers encapsulate the data object that need to be managed on device and Accessors are used to request control of buffer objects to access or modify the memory.

buffer.cpp

#include <CL/sycl.hpp>
using namespace sycl;
static const int N = 16;
int main(){
  queue q;
  std::cout << "Device: " << q.get_device().get_info<info::device::name>() << std::endl;
  int *data = (int *)malloc(N * sizeof(int));
  for(int i=0; i<N; i++) data[i] = i;
  buffer<int, 1> buf(data, range<1>(N));
  q.submit([&] (handler &h){
    auto A = buf.get_access<access::mode::read_write>(h);
    h.parallel_for(range<1>(N), [=](id<1> i){
      A[i] *= 2;
    });
  });
  buf.get_access<access::mode::read>();
  
  for(int i=0; i<N; i++) std::cout << data[i] << std::endl;
  free(data);
  return 0;
}

Unified Shared Memory

USM is pointer-based approach to manage memory in DPC++ language.

usm.cpp

#include <CL/sycl.hpp>
using namespace sycl;
static const int N = 16;
int main(){
  queue q;
  std::cout << "Device: " << q.get_device().get_info<info::device::name>() << std::endl;
  int *data = malloc_shared<int>(N, q);
  for(int i=0; i<N; i++) data[i] = i;
  q.parallel_for(range<1>(N), [=] (id<1> i){
    data[i] *= 2;
  }).wait();
  for(int i=0; i<N; i++) std::cout << data[i] << std::endl;
  free(data, q);
  return 0;
}