Building an ECS AMI for the Xilinx Video SDK¶
This page describes how to create a custom ECS AMI with the Xilinx Video SDK.
Instructions¶
Install and configure AWS Client. On the development machine, i.e., the machine that initiates the AMI build, install AWS CLI and Configure AWS CLI
Install Packer on the development machine
Create an EC2 instance with the base AL2 AMI
sshinto EC2 instance, install the ECS Agent with following commands:sudo amazon-linux-extras disable docker sudo amazon-linux-extras install -y ecs; sudo systemctl enable --now ecs
In the AWS EC2 console, right click target instance, select image and template => Create Image, the new AMI will be generated. (Check Installing the Amazon ECS container agent on an Amazon Linux 2 EC2 instance for details.)
Create the following Packer YAML file, updating the
variablessection as appropriate:{ "variables": { "region": "[replace with target region]", "flag": "ecs", "subnet_id": "[replace with your subnet_id]", "security_groupids": "[replace with your security_groupids]", "build_ami": "[replace with target AMI id]" }, "builders": [ { "type": "amazon-ebs", "region": "{{user `region`}}", "source_ami": "{{user `build_ami`}}", "run_tags": { "Name": "packer-vt-processor-{{user `flag`}}" }, "subnet_id": "{{user `subnet_id`}}", "security_group_ids": "{{user `security_groupids`}}", "instance_type": "vt1.3xlarge", "ssh_username": "ec2-user", "ami_name": "[Name of Your AMI]", "launch_block_device_mappings": [ { "delete_on_termination": true, "device_name": "/dev/xvda", "volume_size": 100, "throughput": 1000, "iops": 8000, "volume_type": "gp3" } ] } ], "provisioners": [ { "type": "shell", "expect_disconnect": true, "inline": [ "sudo yum update -y", "sudo amazon-linux-extras install lustre2.10 epel -y", "sudo yum install https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm -y", "sudo yum install boost-devel -y", "sudo yum install gcc-c++ -y", "sudo yum install python3 yum-utils cmake dkms mdadm git htop hwloc iftop kernel-tools rpm-build rpmdevtools numactl parallel pigz python3-distutils wget kernel-devel-$(uname -r) kernel-headers-$(uname -r) -y", "sudo yum groupinstall 'Development Tools' -y", "curl https://bootstrap.pypa.io/get-pip.py -o /tmp/get-pip.py && sudo python3 /tmp/get-pip.py", "uname -r", "sudo shutdown -r now" ] }, { "type": "shell", "inline": [ "uname -r", "wget -O /tmp/awscli2.zip https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip", "cd /tmp && sudo unzip /tmp/awscli2.zip", "sudo /tmp/aws/install", "aws configure set default.s3.max_concurrent_requests 100", "aws configure set default.s3.max_queue_size 10000", "aws configure set default.s3.multipart_threshold 64MB", "aws configure set default.s3.multipart_chunksize 16MB" ] }, { "type": "shell", "inline_shebang": "/bin/bash -xe", "inline": [ "echo '[Amzn2Artifactory]' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'name=Amzn2Artifactory' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'baseurl=https://packages.xilinx.com/artifactory/rpm-packages/x86_64/2' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'enabled=1' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgcheck=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgkey=https://packages.xilinx.com/artifactory/rpm-packages/x86_64/repodata/repomd.xml.key' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'sslverify=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo '[Artifactory]' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'name=Artifactory' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'baseurl=https://packages.xilinx.com/artifactory/rpm-packages/x86_64/' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'enabled=1' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgcheck=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgkey=https://packages.xilinx.com/artifactory/rpm-packages/x86_64/repodata/repomd.xml.key' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'sslverify=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo '[BaseArtifactory]' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'name=BaseArtifactory' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'baseurl=https://packages.xilinx.com/artifactory/rpm-packages/noarch/' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'enabled=1' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgcheck=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'gpgkey=https://packages.xilinx.com/artifactory/rpm-packages/noarch/repodata/repomd.xml.key' | sudo tee -a /etc/yum.repos.d/xilinx.repo", "echo 'sslverify=0' | sudo tee -a /etc/yum.repos.d/xilinx.repo" ] }, { "type": "shell", "inline_shebang": "/bin/bash -xe", "inline": [ "echo ' StrictHostKeyChecking no' | sudo tee -a /etc/ssh/ssh_config", "echo ' HostbasedAuthentication no' | sudo tee -a /etc/ssh/ssh_config", "echo ' CheckHostIP no' | sudo tee -a /etc/ssh/ssh_config" ] }, { "type": "shell", "inline_shebang": "/bin/bash -xe", "inline": [ "sudo yum update -y", "sudo yum install kernel-devel-$(uname -r) -y", "sudo yum install kernel-headers-$(uname -r) -y", "sudo yum install yum-plugin-versionlock -y", "sudo yum install xrt-2.11.722-1.x86_64 -y", "sudo yum versionlock xrt-2.11.722 -y", "sudo yum install xilinx-alveo-u30-core -y", "sudo yum install xilinx-alveo-u30-ffmpeg -y", "sudo yum install xilinx-alveo-u30-gstreamer -y", "sudo yum install xilinx-alveo-u30-examples -y", "sudo cp /opt/xilinx/xcdr/xclbins/transcode.xclbin /opt/xilinx/xcdr/xclbins/transcode_lite.xclbin", "sudo cp /opt/xilinx/xcdr/xclbins/on_prem/transcode.xclbin /opt/xilinx/xcdr/xclbins/transcode.xclbin", "sudo rm /opt/xilinx/firmware/sc-fw/u30/sc-fw-u30-6.3.8-fe416dd3cea1ac123bfe32afdfb9b9e9.txt", "sudo rm /opt/xilinx/xrt/share/fw/*", "sudo rm /opt/xilinx/firmware/u30/gen3x4/base/data/BOOT_golden.BIN", "sudo rm $HOME/.ssh/authorized_keys" ] }, { "type": "shell", "inline_shebang": "/bin/bash -xe", "inline": [ "distribution=$(. /etc/os-release;echo $ID$VERSION_ID)", "sudo amazon-linux-extras install docker -y", "sudo systemctl enable docker", "sudo sed -i 's/^OPTIONS/#&/' /etc/sysconfig/docker", "echo -e '{\"default-ulimits\":{\"memlock\":{\"Name\":\"memlock\",\"Soft\":-1,\"Hard\":-1}}}' | sudo tee /etc/docker/daemon.json", "sudo systemctl restart docker", "sudo usermod -aG docker ec2-user" ] }, { "type": "shell", "inline_shebang": "/bin/bash -xe", "inline": [ "sudo sed -i 's@{@{\"default-runtime\":\"xilinx\",\"runtimes\":{\"xilinx\":{\"path\":\"/usr/bin/xilinx-container-runtime\",\"runtimeArgs\":[]}},@' /etc/docker/daemon.json", "sudo systemctl restart docker" ] } ] }
Build the custom ECS AMI containing the Xilinx Video SDK:
packer build xilinx-vt-al2-ecs.yml
After the packer build finishes, the new ECS AMI will be available in the AWS console.