I routinely use Ventoy, mainly for installing openSUSE and EndeavourOS, but did use it once for IPFire x86_64, without any issues.
You might need the latest Ventoy, which has the option to boot to GRUB.
You are putting the ISO, not the IMG.GZ on Ventoy stick ?