Checklist - xilinx-u50lv-gen3x4-xdma-base-2

Package information

xbtest information

Release number

3522863

Description (what’s new)

Initial release

Platform information

Development platform (XSA)

xilinx-u50lv-gen3x4-xdma-2-202010-1-dev-1-2902115

Deployment platform (shell, CMC, SC)

xilinx-cmc-u50-1.0.40-3398385

xilinx-sc-fw-u50-5.2.18-1.bf9ba46

xilinx-u50lv-gen3x4-xdma-base-2-2902115

xilinx-u50lv-gen3x4-xdma-validate-2-2902115

System information

System information

OS

RedHatEnterprise / 8.3

Architecture

x86_64

Server type

PowerEdge R740

AUX cable

N/A

Card S/N

501211101A11

XRT version

2.13.425

Measured download time

10.4 seconds

Requirement - Platform high level features

Platform and card requirements

Platform and card requirements

FPGA part

xcu50-fsvh2104-2LV-e

PCIe speed and width

gen3x4

DMA type

xdma

DDR: speed, size and quantity

not available

HBM: size, quantity and power rail

32 Pseudo-Channels; 8192MB; 3v3_pex

Host memory support

not available

P2P support

not available

GTs: type, quad, SLR location

GT[0]: GTY, Quad_X0Y7 (SLR1)

Power rails requirements

Power rail

Card limit (W)

Note

12v_pex

65W

3v3_pex

11W

HBM only power source

Calibration - Power CU - Results

Description

Results

Power, temperature & toggle rate graph

<TBC>

Maximum toggle rate reached (%)

83

Power consumption balance achieved:

  • Yes/no and justification (why are some rails not close to their critical current limit?)

No:

  • HBM is powered exclusively from the 3v3_pex and user logic is on the 12v_pex. So the power CU has no effect on the 3v3_pex and thus 3v3_pex current is not close to its critical current limit.

3v3_pex current (A)

Measurement

0.637A

Critical limit

3.3A (11W)

12v_pex current (A)

Measurement

5.148A

Critical limit

5.4A (65W)

Calibration - Memory CU power

Memory

Description

simultaneous_wr_rd

only_rd

only_wr

HBM

Is there enough power for memory?

No, HBM is powered from the 3v3_pex power rail.

Power rail name

3v3_pex

3v3_pex

3v3_pex

Power throttle limit (W)

10

10

10

20% below power throttle limit (W)

8

8

8

CU rate (%) @ 20% below limit

26

50

57

Power graph

<TBC>
<TBC>
<TBC>

BW graph

<TBC>
<TBC>
<TBC>

Latency graphs

<TBC>
<TBC>
<TBC>
<TBC>

Calibration - Memory bandwidth and latency

Note

  • N/A: not applicable

  • 1

    The outstanding write/read is the maximum number of outstanding reads just before the read pipeline is full, giving the best BW and latency results.

Memory

Description

simultaneous_wr_rd

only_rd

only_wr

HBM

QoS / power reduction rate

N/A

N/A

N/A

Best write BW (MBps)

2026

N/A

4410

Best write latency (ns)

80

N/A

80

Best read BW (MBps)

2026

3814

N/A

Best read latency (ns)

208

199

N/A

Outstanding write/read 1

Write = 2 / read = 4

2

2

BW/latency graphs (do one for read and one for write)

<TBC>
<TBC>
<TBC>
<TBC>

Checklist questionnaire

Runtime

Question

Answer / justification / problem tracker reference number

Have you updated the default download time?

  • FYI:

    • u250 xclbin (90Mb) downloads in 3.9 sec (PCIe 3x16).

    • HBM requires calibration which may take time.

Yes, HBM requires calibration which may take time.

"download_time": 20

Sensors

Question

Answer / justification / problem tracker reference number

Do you need to monitor more mechanical sources than the default one (fpga_fan_1)?

No

Do you need to monitor more thermal sources than the default one (fpga0)?

No

Do you need to monitor more electrical sources than the default ones (power_consumption, 12v_pex, 12v_aux, 3v3_pex and vccint)?

No

GT

Question

Answer / justification / problem tracker reference number

GT

GT[0]

Have you updated GT default settings to maximize signal integrity?

  • Run all GT pre-canned tests.

"0": {
    "name": "top",
    "transceiver_settings": {
        "module": {
            "tx_differential_swing_control": 11,
            "tx_pre_emphasis": 0,
            "tx_post_emphasis": 0,
            "rx_equaliser": "DFE"
        },
        "cable": {
            "tx_differential_swing_control": 11,
            "tx_pre_emphasis": 0,
            "tx_post_emphasis": 0,
            "rx_equaliser": "DFE"
        }
    }
}

Memory

Question

Answer / justification / problem tracker reference number

Memory

HBM

Have you defined specific DMA bandwidths (dma_bw)?

  • This not applicable for host memory.

No

Have you defined optimum DMA settings (buffer_size and total_size) or are default settings enough?

  • Run dma pre-canned test.

"dma_config": {
    "buffer_size": 128
}

Have you defined specific P2P CARD bandwidths (p2p_card_bw)?

  • This not applicable for host memory.

N/A

Have you defined optimum P2P CARD settings (buffer_size and total_size) or are default settings enough?

  • Run p2p_card pre-canned test.

N/A

Have you defined specific P2P NVME bandwidths (p2p_nvme_bw)?

  • This not applicable for host memory.

N/A

Have you defined optimum P2P NVME settings (buffer_size and total_size) or are default settings enough?

  • Run p2p_nvme pre-canned test.

N/A

Have you reduced the CU rate to avoid over-power (cu_rate)?

"cu_rate": {
    "only_wr": {
        "write": {
            "nominal": 57
        }
    },
    "only_rd": {
        "read": {
            "nominal": 50
        }
    },
    "simul_wr_rd": {
        "write": {
            "nominal": 26
        },
        "read": {
            "nominal": 26
        }
    }
}

Have you defined cu_rate for simultaneous write/read bandwidth QoS?

No

Have you defined cu_bw?

  • For each test mode: only_wr, only_rd and simul_wr_rd

For host memory these values are depending on the PCIe speed.

"cu_bw": {
    "only_wr": {
        "write": {
            "average": 4410
        }
    },
    "only_rd": {
        "read": {
            "average": 3814
        }
    },
    "simul_wr_rd": {
        "write": {
            "average": 2026
        },
        "read": {
            "average": 2026
        }
    }
}

Have you defined cu_latency?

  • For each test mode: only_wr, only_rd and simul_wr_rd

"cu_latency": {
    "only_wr": {
        "write": {
            "high": 156,
            "low": 56
        }
    },
    "only_rd": {
        "read": {
            "high": 319,
            "low": 138
        }
    },
    "simul_wr_rd": {
        "write": {
            "high": 156,
            "low": 56
        },
        "read": {
            "high": 342,
            "low": 138
        }
    }
}

Have you defined cu_outstanding?

  • For each test mode: only_wr, only_rd and simul_wr_rd

"cu_outstanding": {
    "only_wr": {
        "write": {
            "nominal": 2
        }
    },
    "only_rd": {
        "read": {
            "nominal": 2
        }
    },
    "simul_wr_rd": {
        "write": {
            "nominal": 2
        },
        "read": {
            "nominal": 4
        }
    }
}

Have you defined cu_burst_size?

  • For each test mode: only_wr, only_rd and simul_wr_rd

No

Pre-canned tests

Question

Answer / justification / problem tracker reference number

Have you tested all provided pre-canned tests?

  • If not: list the skipped one and the reason?

Yes

Have you modified the pre-canned test template?

  • If yes:

    • Why?

    • Was it not possible to make a platform definition update (and thus, available for any test as default)?

    • Update next section with your modifications.

No

Have you saved all pre-canned results?

  • Update package information section of your checklist.

Yes

Issues tracking

Question

Answer / justification / problem tracker reference number

Did you modify the platform definition limits and range after running the pre-canned tests?

  • If yes:

    • List the problem tracker reference number

No

Pre-canned tests results

Pre-canned test modifications

Test name

Modification from original template

Justifications

/

No modification

/

dma pre-canned test

Memory

Write BW (MBps)

Read BW (MBps)

HBM

3294

3305

p2p_nvme pre-canned test

not applicable

p2p_card pre-canned test

not applicable

memory pre-canned test

Memory

Test mode

Write BW (MBps)

Read BW (MBps)

Write Latency (ns)

Read Latency (ns)

HBM

alternate_wr_rd

65369

65369

81

200

only_wr

141145

N/A

81

N/A

only_rd

N/A

122072

N/A

200

simultaneous_wr_rd

64851

64851

81

212

memory_host pre-canned test

not applicable