 Kria™ KR260 Robotics Starter Kit |
10GigE Machine Vision Camera Tutorial |
Overview¶
The Machine Vision (MV) Camera Defect Detect Application uses a Sony IMX547 sensor module, which interfaces to the KR260 with the widely adopted SLVS-EC interface standard.
The FPGA implements a SLVS-EC receiver IP core that is provided by third-party IP company Framos and a 10GigE Vision pipeline using a series of IP cores from third-party IP company Sensor-to-Image. As these third-party IPs are not open-source, contact the third-party contacts via Product Inquiry to create custom and product designs.
The KR260 carrier card has the interface for Euresys 10GigE. 10GigE pipeline consists of multiple IP such as GenDC, Framebuffer, 10GigE MAC, and so on. GenDC Front-End IP core implements GenICam protocol GenDC layer to be used together with additional machine vision interfacing IP cores provided by Sensor to Image(S2I). Frame Buffer companion IP implements a video frame buffering functionality, packetization, and optional packet resending. The data divided into packets is transmitted to the back-end IP cores implementing particular machine vision interfaces like GigE Vision. Using SFP+ packets are sent to host machine and displayed in the Sphinx GEV Viewer software.
From the capture pipeline, AXI broadcaster gives two outputs to 10gige pipeline and mv-defect detect pipeline, respectively. MV-Defect-Detect application uses AMD Vitis™ Vision libraries to examine each mango and mark its defects. This enables customers to strategically sell their best mangoes, leading to enhanced revenue and creates a mutually beneficial situation for both the customers and the consumers.
The MV-Camera high level pipeline is depicted in the following figure:
Features¶
IMX547 Camera Sensor with 5.1 Mega Pixel/2472 x 2128 pixel with max framerate of 122 fps.
Sphinx GEV Viewer to display the live streaming data through 10 GigE pipeline.
MV-Defect-Detect acceleration pipelines are to detect defects in the input mango images.