Re: Porting Cora Z7 Board to barebox

[Johannes Roith <johannes@gnu-linux.rocks>]

Hi Sascha, 

thanks for the fast reply.

Am Mon, May 05, 2025 at 09:39:41AM +0200 schrieb Sascha Hauer:
> On Thu, May 01, 2025 at 02:16:39PM +0200, Johannes Roith wrote:
> > Hi,
> > 
> > thanks for the fast replies.
> > 
> > Am Tue, Apr 29, 2025 at 11:49:40AM +0200 schrieb Ahmad Fatoum:
> > > Hi,
> > > 
> > > On 4/29/25 10:34, Sascha Hauer wrote:
> > > > In case of the Zedboard you could take start_avnet_zedboard.pbl. This
> > > > contains all necessary components including device tree and barebox
> > > > proper.
> > > > 
> > > > However, this binary is linked to 0x0 and the FSBL will likely load it
> > > > there. I don't know where the FSBL itself is located.
> > 
> > Can I change the address to which barebox is linked to? E.g. in Vitis
> > the application is linked to 0x10000 and the FSBL starting this
> > application to 0x0.
> 
> First of all the barebox binary is relocatable, you can start it at any
> address.
> 
> You could change the address by adjusting ARCH_TEXT_BASE, but why would
> you? From the output below it seems your binary just starts fine from
> address 0x0.

The Zynq-7000 has a processor system (PS) with a Cortex-A9 and a
programmable logic (PL) which is basically a FPGA. With barebox I can't
load a bitstream to the FPGA. Or does barebox provides an interface for
loading FPGAs?

My idea was to use Xilinx FSBL which loads the bitstream to the FPGA and
then loads an ELF file. The problem is, if the ELF file is linked to
address 0x0 like the FSBL, the FSBL overwrites its code when loading the
ELF file and crashes.

But if I write a small application which is loaded by the FSBL I can read
start_dt_2nd.pblb from the mmc, put it somewhere in DRAM memory and jump to it.
This should start the barebox proper, right?

I set ARCH_TEXT_BASE to 0x1000_0000 as you suggested and create a Xilinx Boot
Image with start_dt_2nd.pbl inside, but the ELF file seems still be linked for
0x0. The FSBL loaded the FPGA but barebox never booted, so I guess the
FSBL overwrote itself.

> 
> > 
> > 
> > The good news is, I can boot barebox (PBL and proper) now and sometimes
> > also can Linux. Here is the output of my barebox:
> > 
> > Digilent Cora Z7 PBL
> > uncompress.c: memory at 0x00000000, size 0x20000000
> > mmu: enabling MMU, ttb @ 0x1ffd0000
> > endmem                = 0x20000000
> > arm_mem_scratch       = 0x1fff8000+0x00008000
> > arm_mem_stack         = 0x1ffe9000+0x0000f000
> > arm_mem_ttb           = 0x1ffd0000+0x00010000
> > arm_mem_barebox_image = 0x1fe00000+0x00200000
> > arm_mem_early_malloc  = 0x1fde0000+0x00020000
> > membase               = 0x00000000+0x20000000
> > uncompress.c: uncompressing barebox binary at 0x00006270 (size 0x00029c0c) to 0x1fe00000 (uncompressed size: 0x0006c0e8)
> > uncompress.c: jumping to uncompressed image at 0x1fe00000
> > 
> > 
> > barebox 2025.04.0-00215-gdacb19ae3252-dirty #11 Wed Apr 30 22:22:15 CEST 2025
> > 
> > 
> > Board: Digilent Cora Z7
> > ERROR: could not get clock /axi/dma-controller@f8003000:apb_pclk(0)
> > ERROR: could not get clock /axi/etb@f8801000:apb_pclk(0)
> > ERROR: could not get clock /axi/tpiu@f8803000:apb_pclk(0)
> > ERROR: could not get clock /axi/funnel@f8804000:apb_pclk(0)
> > ERROR: could not get clock /axi/ptm@f889c000:apb_pclk(0)
> > ERROR: could not get clock /axi/ptm@f889d000:apb_pclk(0)
> > mdio_bus: miibus0: probed
> > macb e000b000.ethernet@e000b000.of: Cadence GEM at 0xe000b000
> > arasan-sdhci e0100000.mmc@e0100000.of: registered as mmc0
> > malloc space: 0x17e00000 -> 0x1fdfffff (size 128 MiB)
> > arasan-sdhci e0100000.mmc@e0100000.of: error while transferring data for command 6
> > arasan-sdhci e0100000.mmc@e0100000.of: state = 0x01f70202 , interrupt = 0x00208000
> > mmc0: Card's startup fails with -74
> > barebox-environment chosen:environment-sd.of: probe failed: No such file or directory
> > environment load /dev/env0: No such file or directory
> > Maybe you have to create the partition.
> > 
> > 
> > Do you know what to do about the "could not get clock errors"? Do I have
> > to take care about them or just ignore them?
> 
> We don't have drivers for any of the devices that you fail to get a
> clock for, so that is not a problem.
> 
> Anyway, the clocks are registered by the clock driver, so normally they
> should be found.
> 
> Do you have BAREBOX_DEEP_PROBE_ENABLE() in your board file? If not,
> please add it. It makes sure the clock driver is probed once we need a
> clock.

Thanks, adding BAREBOX_DEEP_PROBE_ENABLE() fixed it. Now the errors do
no longer appear.
> 
> > 
> > The more critical error comes from the SD card. Every second boot I am
> > getting the errors shown above, sometimes the card is started correctly.
> > 
> > Also when barebox can startup the mmc0, when starting the Linux Kernel
> > sometimes the rootfs on /dev/mmcblk0p2 is not found and the SD Card is
> > not detected. So, there seems to be something wrong with the SD Card
> > interface...
> 
> You found out yourself, but yes, rootwait is needed to boot from SD/eMMC
> cards.
> 
> > 
> > In lowlevel.c I am setting the clock divider for the sdio0 interface to 10
> > and the Source for generated clock is IO PLL. Therefore, the sdio IP
> > should get a 100 MHz input clock. IS this correct? Do you know which
> > clockrate the driver expects? 
> > 
> > Or do you have any other idea what could case the error?
> > 
> > In case I can fix the remaining errors I would like to bring the changes
> > upstream and send a patch. Here I also have some questions:
> > 
> > I added the following files and folder:
> > 
> > 	arch/arm/boards/digilent-cora/
> > 	arch/arm/dts/zynq-cora.dts
> > 	dts/src/arm/xilinx/zynq-cora.dts
> > 
> > arch/arm/boards/digilent-cora/ is a copy of arch/arm/boards/avnet-zed/
> > with my changes applied. In the Copyright, should I keep the existing
> > name and just add mine as a second author?
> 
> I'd say in this case just replace the original author with your name.
> You would likely have come up with the same file if you had written it
> yourself.

OK, thanks.

> 
> > 
> > If I understand it correctly, the files in dts/src are imported from the
> > Linux kernel git repo, right?
> 
> Yes, right.
> 
> > In this case I should try to bring my
> > modified device tree mainline to Linux first and then commit my changes
> > to barebox? Or is there another file location I can drop my device tree
> > temporarily until it is available in Linux?
> 
> We thought about creating a an extra directory for dts files which are
> pending upstream, but we are not there yet.
> 
> Best practice is to separate the barebox specific dts stuff from the
> about-to-be-upstreamed stuff and put both files into arch/arm/dts.
> With this we can just drop the non-barebox specific file once it's in
> Linux upstream without losing the barebox specific changes.
> 

Currently both files are named zynq-cora.dts. What would be a good name
for the DT which will be replaced when upstreamed to Linux?
zynq-cora-linux.dts?

> > 
> > And a last question: How can I change the default boot method in barebox
> > from net to mmc0?
> 
> nv boot.default="mmc0". See https://www.barebox.org/doc/latest/user/variables.html
> and the output of the "magicvar" command

Ok, it now tries to boot from mmc0, but I am getting an error:

Board: Digilent Cora Z7
deep-probe: supported due to xlnx,zynq-cora
mdio_bus: miibus0: probed
macb e000b000.ethernet@e000b000.of: Cadence GEM at 0xe000b000
arasan-sdhci e0100000.mmc@e0100000.of: registered as mmc0
malloc space: 0x17e00000 -> 0x1fdfffff (size 128 MiB)
mmc0: detected SD card version 2.0
mmc0: registered mmc0

Hit any to stop autoboot:    3
barebox@Digilent Cora Z7:/ boot
Nothing bootable found on 'mmc0'
Nothing bootable found
barebox@Digilent Cora Z7:/ nv
  allow_color: true
  autoboot_timeout: 3
  boot.default: mmc0
  linux.bootargs.console: console=ttyPS1,115200 root=/dev/mmcblk0p2 rootwait
  user: none

I have an SD card with a FAT32 and an EXT4 partition. On the FAT32 I
have the zImage of the Linux kernel. Am I missing something here?

> 
> Regards,
>   Sascha
> 
> -- 
> Pengutronix e.K.                           |                             |
> Steuerwalder Str. 21                       | http://www.pengutronix.de/  |
> 31137 Hildesheim, Germany                  | Phone: +49-5121-206917-0    |
> Amtsgericht Hildesheim, HRA 2686           | Fax:   +49-5121-206917-5555 |

Best regard,
Johannes