NLP SmartVision

The natural language processing (NLP) SmartVision implements keyword spotting (KWS) on the processing system (PS) and face detection, objectdetect, platedetect running on the programmable logic (PL). It showcases keywords based on dynamic switching between multiple tasks and modifying display properties.

Overview

• Introduction

Features

• Live video capture from Raspberry Pi Camera and USB webcam along with AR1335

• Live audio capture from USB Microphone

• 1024x768 resolution images

• DisplayPort and HDMI out

• User programmable Deep Learning models

Quick Start

• Setting Up the Board and Application Deployment

Tutorials

• Customizing AI Models Used in the Application
• Building the Design Components
• Building the Hardware Design Using Vivado
• Creating a Vitis Platform
• Generating Custom Firmware
• Kria Starter Kit Linux Boot
• Rebuilding Application Docker Containers
• Integrating New Sensors

Architecture

• Software Architecture - Platform
• Software Architecture - Accelerator
• Hardware Architecture - Platform
• Hardware Architecture - Accelerator

Repository

• Software Repository

Other

• Debugging
• Known Issues

AMD Support

This 22.1 guide and prebuilt is target for Ubuntu. The previous version of this application (21.1) is targeted to Petalinux and is still available at https://xilinx.github.io/kria-apps-docs/2020.2/build/html/index.html GitHub issues will be used for tracking requests and bugs. For questions, go to forums.xilinx.com.

License

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License.

You may obtain a copy of the License at apache.org/licenses/LICENSE-2.0.

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.