rhai-early-access/base-image-neuron-rhel9
Features
Download this image
Description
This container provides a robust foundation for AI workloads on AWS Neuron, delivering an enterprise-grade base image for Python libraries from the Red Hat Python Index. Built specifically for Neuron-accelerated computing, it provides a secure and optimized environment for developing and deploying AI applications, with access to curated Python packages essential for machine learning, data science workflows, and modern AI applications.
- Neuron-Accelerated Python Environment: The container provides a validated, accelerated stack to build containers for Red Hat AI, specifically optimized for AWS Neuron accelerator workloads. It includes essential packages for machine learning and Python AI libraries to work with the Red Hat AI Python Index, all of which are validated and tested for compatibility with AWS Neuron environments.
- Optimized for AWS Neuron Hardware: Specifically built and optimized for the AWS Neuron platform, this container enables you to leverage the full computational power of AWS Neuron accelerators, including matrix cores and advanced architecture features.
- Enterprise-Ready and Secure: Delivered as a hardened container based on Red Hat Enterprise Linux 9, it ensures the stability, security, and compliance required for mission-critical enterprise deployments. The container is an integral part of the Red Hat AI portfolio, offering a fully supported foundation for building and managing AI applications across all Red Hat AI products.
- Flexible Hybrid Cloud Deployment: Deploy consistently wherever you need it—in datacenters, clouds, or at the edge. This container is certified for and fully supported with Red Hat AI products. Use this container as the foundation for your AI infrastructure to build a powerful, standardized platform for Neuron-accelerated workloads on AWS.
Leverage this container as the base layer for your AI applications, providing immediate access to enterprise-grade Python libraries while ensuring optimal performance on AWS Neuron accelerator infrastructure.
If your goal is simply to serve a large language model, use instead the pre-built rhaiis/vllm-... containers, which are already optimized for this exact purpose.
Image specifications
The following information was extracted from the dockerfile and other sources.
| Canonical image ID | rhai-early-access/base-image-neuron-rhel9 |
| Summary | Red Hat AI Base Image for AWS Neuron |
| Description | Red Hat AI Base Image for AWS Neuron with index 3.4-EA2/neuron-ubi9, Python 3.12, and AI repo 3.4 |
| Provider | Red Hat |
| Maintainer | Red Hat, Inc. |
| Repository name | rhai-early-access/base-image-neuron-rhel9 |
| Image version | 9.6 |
| Architecture | amd64 |
| Working directory | MPI_/usr/lib64/openmpi |
Registry tokens
Use a registry service account token to authenticate your container client. This allows you to pull images without using your personal Red Hat credentials, which is recommended for CI/CD pipelines and automated deployments.
Using Podman login
Run the following command, then enter your registry token credentials when prompted by the terminal.
Pull the image
Image identifiers
Red Hat login
Use the following instructions to get images from a Red Hat container registry using your Red Hat login.
Using Podman login
Run the following command, then enter your login credentials when prompted by the terminal.
Pull the image
Image identifiers
Unauthenticated
Use the following instructions to get images from a Red Hat container registry without providing authentication.
Using podman
Use the following command(s) from a system with podman installed.
Image identifiers
Getting source containers
Source code is available for all Red Hat UBI-based images in the form of downloadable containers. Here are a few things you should know about Red Hat source containers.
- Although they are packaged as containers, source containers cannot be run. So instead of using podman pull to get them to your system, use the skopeo command.
- Source containers are named based on the binary containers they represent. So, for example, to get the source container for a particular standard RHEL UBI 8 container (registry.access.redhat.com/ubi8/ubi8.1-397) you simply append -source to get the source code container for that image (registry.access.redhat.com/ubi8/ubi8.1-397-source).
- Once a source container is copied to a local directory, you can use a combination of tar,gzip, and rpm commands to work with that content.
Step one
Use skopeo to copy the source image to a local directory
Step two
Inspect the image
Step three
Untar the contents
Step four
Begin examining and using the content.
