InfiniBand install with confluent

Driver update media:

Occasionally for network deployment of a RHEL or CentOS the modules included in the install initrd for the OS aren't sufficient to work with the network device being installed over (for example, if the network device is very new and the driver support hasn't been added to the OS yet). In that scenario a driver update media package for that network device can be used to provide support for that network device during and after the OS installation. See Using driver update media for RedHat/CentOS for the procedure.

Net config fixup postscript:

InfiniBand network configuration does not work as expected out of the box. If not installing Mellanox OFED, the following is an example of a postscript that can be added to correct that behavior:

# cat /var/lib/confluent/public/os/your-profile-here/scripts/pod.d/fixipoib
echo 'install mlx5_core /sbin/modprobe --ignore-install mlx5_core; /sbin/modprobe mlx5_ib; /sbin/modprobe ib_ipoib' >> /etc/modprobe.d/mlx.conf
echo 'add_drivers+="mlx5_ib ib_ipoib"' > /etc/dracut.conf.d/mlx.conf
dracut -f

Kernel command line configuration:

Change the profile.yaml file in the OS profile to be deployed to add:

rd.driver.pre="mlx5_ib,ib_ipoib"

on the kernel.args line.

Then run:

osdeploy updateboot <OS profile name>

Net config fixup postscript:

InfiniBand network configuration does not work as expected out of the box. If not installing Mellanox OFED, the following is an example of a postscript that can be added to correct that behavior:

# cat /install/postscripts/fixipoib
echo 'install mlx5_core /sbin/modprobe --ignore-install mlx5_core; /sbin/modprobe mlx5_ib; /sbin/modprobe ib_ipoib' >> /<profile dir>/scripts/post.d/mlx.conf
echo 'add_drivers+="mlx5_ib ib_ipoib"' > /<profile dir>/scripts/post.d/mlx.conf
dracut -f

Kernel command line configuration:

Change the profile.yaml file in the OS profile to be deployed to add:

insmod="ib_ipoib"

and run:

osdeploy updateboot <OS profile name>