FAI install with huge JBODs present - disk/by-id?

[Steffen Grunewald]

Hi Henning,

On Tue, 2024-12-17 at 14:13:00 +0100, Henning Glawe wrote:
> Moin,
> 
> are you booting via BIOS/legacy or UEFI (with the corresponding GRUB)?

UEFI, with the right GRUB.
It's not the first time I'm doing this, and it works without the JBODs connected.
I haven't even found a LEGACY setting in the BIOS of this AMD Genoa machine.

> "out of memory" sounds like something more likely to hit in a BIOS/legacy
> boot.

I'm seeing some unlikely error then...

- S

> 
> 
> On Tue, Dec 17, 2024 at 10:07:56AM +0100, Steffen Grunewald wrote:
> > Good morning,
> > 
> > after a very promising start, I experienced a set-back yesterday with an
> > otherwise proven-to-work FAI setup, and need an alternative now.
> > 
> > Over the past years, I wrote, used, and improved, a scheme that would
> > ignore disk_config completely and work with hooks, to create a ZFS root
> > pool (and possibly a data pool as well) over disks selected via patterns
> > (usually /dev/disk/by-id/ata-MANUFACTURER).
> > 
> > This initially also worked for my recent setup, a BeeGFS server with two
> > OS disks (ata-*), a handful NVMes and two times 60 disks over multipath,
> > in total 247 disks seen by the kernel.
> > 
> > After setting up multipath and storage zpools, I can no longer boot into
> > the system as long as at least one JBOD is connected - grub 2.06 gets an
> > "error: out of memory" and even refuses such elementary tasks as
> > "ls (...)/".
> > Upgrading to grub 2.12 (from bookworm-backports) makes things worse as
> > the screen stays dark, not even the greeting "Welcome to GRUB!" comes up.
> > 
> > I'm afraid I've got to go back to md raid, but with all disks connected,
> > how do I find the two system disks, if not via /dev/disk/by-id? (a quick
> > check with "sysinfo" shows them at /dev/sda and /dev/sddi)
> > 
> > Is there a regular way via disk_config, or do I have to invent a 17-sided
> > wheel myself?
> > 
> > Thanks for listening,
> >  S
> > 
> > -- 
> > Steffen Grunewald, Cluster Administrator
> > Max Planck Institute for Gravitational Physics (Albert Einstein Institute)
> > Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany
> > ~~~
> > Fon: +49-331-567 7274
> > Mail: steffen.grunewald(at)aei.mpg.de
> > ~~~
> 
> -- 
> Mit freundlichen Grüßen
> Henning Glawe
> 
> Dr. Henning Glawe
> Max-Planck-Institut für Struktur und Dynamik der Materie
> Geb. 900 (MPSD), Luruper Chaussee 149, 22761 Hamburg, Germany
> http://www.mpsd.mpg.de/, Email: henning.glawe at mpsd.mpg.de
> Building/Room: 900/O1.053, Phone: +49-40-8998-88392

-- 
Steffen Grunewald, Cluster Administrator
Max Planck Institute for Gravitational Physics (Albert Einstein Institute)
Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany
~~~
Fon: +49-331-567 7274
Mail: steffen.grunewald(at)aei.mpg.de
~~~