P2P Simple Example XRT (XRT Native API’s)

This is simple example of vector increment to describe P2P between FPGA and NVMe SSD using xrt native api’s.

KEY CONCEPTS: P2P, NVMe SSD, SmartSSD

KEYWORDS: xrt::bo::flags::p2p, pread, pwrite, O_DIRECT, O_RDWR

This example illustrates the date transfer between FPGA device and NVMe device using p2p without migrating the data via host memory space. In this example we create p2p buffer using p2p flag.

xrt::bo::flags flags = xrt::bo::flags::p2p;
auto p2p_bo0 = xrt::bo(device, vector_size_bytes, flags, krnl.group_id(0));

Following is the real log reported while running on U50 platform and NVMe:

Open the device0
Load the xclbin ./adder.xclbin
############################################################
                  Writing data to SSD
############################################################
INFO: Successfully opened NVME SSD /dev/nvme0n1
synchronize input buffer data to device global memory
Execution of the kernel
Now start P2P Write from device buffers to SSD

############################################################
                  Reading data from SSD
############################################################
INFO: Successfully opened NVME SSD /dev/nvme0n1
Allocate Buffer in Global Memory
Now start P2P Read from SSD to device buffers

Execution of the kernel
Get the output data from the device
TEST PASSED

EXCLUDED PLATFORMS:

  • All Embedded Zynq Platforms, i.e zc702, zcu102 etc

  • Alveo U25 SmartNIC

  • Alveo U30

  • All Versal Platforms, i.e vck190 etc

  • AWS VU9P F1

  • All Platforms with 201910 Version

  • Alveo U50 gen3x16 xdma 2019 Version

DESIGN FILES

Application code is located in the src directory. Accelerator binary files will be compiled to the xclbin directory. The xclbin directory is required by the Makefile and its contents will be filled during compilation. A listing of all the files in this example is shown below

data/sample.txt
src/adder.cpp
src/host.cpp

Access these files in the github repo by clicking here.

COMMAND LINE ARGUMENTS

Once the environment has been configured, the application can be executed by

./p2p_simple_xrt -x <adder XCLBIN> -f ./data/sample.txt