Please share the link to the file you use. I can give it a try on my RPI.
UPDATE: Tried the latest and found the same
U-Boot 2021.07 (Aug 09 2021 - 09:19:51 +0000) RPi4 - IPFire.org
DRAM: 7.9 GiB
RPI 4 Model B (0xd03114)
MMC: mmcnr@7e300000: 1, emmc2@7e340000: 0
Loading Environment from FAT... *** Warning - bad CRC, using default environment
In: serial
Out: serial
Err: serial
Net: eth0: ethernet@7d580000
PCIe BRCM: link up, 5.0 Gbps x1 (SSC)
starting USB...
Bus xhci_pci: probe failed, error -110
No working controllers found
Hit any key to stop autoboot: 0
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
2451 bytes read in 13 ms (183.6 KiB/s)
## Executing script at 02400000
114 bytes read in 6 ms (18.6 KiB/s)
Load uEnv.txt...
...
Set console to ttyAMA0,115200n8
"Synchronous Abort" handler, esr 0x96000004
elr: 00000000000a51b0 lr : 00000000000a51ec (reloc)
elr: 000000003e3761b0 lr : 000000003e3761ec
x0 : 000000003df5e880 x1 : 4e184e174e164e15
x2 : 000000003df4cd90 x3 : 0000000000000016
x4 : 000000003df4ce50 x5 : 4e244e234e224e21
x6 : 0000000000000016 x7 : 000000003e3d2b38
x8 : 000000003df64870 x9 : 0000000000000008
x10: 0000000000000001 x11: 0000000000000006
x12: 000000000000205e x13: 0000000000000001
x14: 0000000000080000 x15: 000000003df40e90
x16: 000000003e380190 x17: 68897ef610278cee
x18: 000000003df4cd90 x19: 0000000000000000
x20: 0000000000000006 x21: 0000000000000006
x22: 0000000000000000 x23: 000000003df3eb48
x24: 000000003e3bafe0 x25: 000000003df648c0
x26: 0000000000304000 x27: 000000003dfe8ac0
x28: 0000000000005400 x29: 000000003df3eac0
Code: 54000061 d2800000 d65f03c0 f9400401 (b9400821)
Resetting CPU ...
resetting ...
U-Boot 2021.07 (Aug 09 2021 - 09:19:51 +0000) RPi4 - IPFire.org
DRAM: 7.9 GiB
RPI 4 Model B (0xd03114)
MMC: mmcnr@7e300000: 1, emmc2@7e340000: 0
Loading Environment from FAT... *** Warning - bad CRC, using default environment
In: serial
Out: serial
Err: serial
Net: eth0: ethernet@7d580000
PCIe BRCM: link up, 5.0 Gbps x1 (SSC)
starting USB...
Bus xhci_pci: probe failed, error -110
No working controllers found
Hit any key to stop autoboot: 1
I think the kernel is not loading at the right place or the kernel file itself it not working.
Can you try an older image ? Coz I am off to sleep now.
UPDATE:
Raspberry Pi 4 Model B
RPi4 is supported since IPFire-2.27 core159 aarch64.
So this seem to be the first image.