12th of June

Farm status
CPU Only
Two Ryzen 5900X running Einstein work.

Nvidia GPUs
Off.

Raspberry Pis
Running Einstein BRP4 work.

Debian 12 (Bookworm) release
The Debian project released their latest version of the operating system. Early signs were promising when I tested the beta version. At the moment I can't install the Nvidia drivers (which worked fine on the beta). There were 150 known bugs when they released on the 10th of June. The CPU only machines have been updated without any issues. I think the problem is the drivers are still listed as part of the testing release as a search for package nvidia-kernel-dkms on debian.org lists the (older) Bullseye version as being stable, however we are now on Bookworm.

Ntp is no longer included, they've switched to using systemd-timesyncd instead. If you try to install ntp it will install ntpsec instead. I was already using ntpsec on some machines so switching to it wasn't an issue for me.

Pi Hole doesn't work. It comes up and says Bookworm is an unsupported operating system when you try to install so we will need them to provide an updated version.

Raspberry Pi OS despite using the 6.1 kernel that Bookworm is using is still based on Debian Bullseye, so it needs updating.


Electricity prices
Electricity prices are going up on the 1st of July by approx 20-25% so I probably won't be using the Nvidia GPU machines much. I still need to organise replacements for the Ryzen 5900's as well. I think the replacements should use less power.


Update 13 June 2023
Pi Hole has been updated and now supports Debian 12 (Bookworm).

Update 17 June 2023
I worked out why the nvidia-driver wouldn't install. It seems parts of it are in the non-free archive, which I had selected via /etc/apt/sources.list, but other parts are in the contrib archive. It will install if you have both listed but not if you only have one of the them.

7th of May

Farm status
CPU only
Both Ryzen 5900X's doing Einstein and Universe@home work in the mornings

Nvidia GPUs
Off

Raspberry Pis
All running Einstein BRP4 work

For news on the Raspberry Pis see Marks Rpi Cluster


Other news
Its still warm during the day but nights are getting cooler as its Autumn in Sydney at the moment. I have been running the Ryzen 5900's first thing in the morning so they can warm the place up before the sun takes over.

I am waiting for the larger DDR5 memory modules to become available (and the prices to drop) before starting a couple of Ryzen 7900 (non-X) builds. My Ryzen 5900X machines have 4 x 16GB memory modules but with DDR5 they don't recommend using 4 sticks of memory as they have timing issues, they recommend either dropping the memory speed or only using 2 sticks.

I saw some tech news items talking about Ryzen 7900X3D's catching fire, with reports MSI has already issued a BIOS update to prevent overclocking. No news yet if this issue also effects the other CPU's in the Ryzen 7000 series. As with new tech (new CPU's and DDR5 memory) it is best to wait until they iron out the issues before buying.

Easter weekend 2023

After a 4 month hiatus we're back to crunching. The main issue was with the weather being hot and I won't use air conditioning. My discounted electricity rate also went from a 21% discount down to 5% and the rates also went up around 20% so I am being frugal with my crunching.

Since I was gone the Pi's have mostly been running, but even they had a break for almost a month. If you want to read about them see Marks Rpi Cluster

 

Current config
As of writing (10th of April 2023) the farm consists of:
2 x Ryzen 5900X machines
1 x Ampere Altra
4 x Ryzen 3600 with RTX 3060Ti GPUs
and Marks Rpi Cluster.

 

Future upgrades
Last time I posted I was looking at updating the Ryzen 5900X machines to Ryzen 7900X machines. Since then AMD have released the non-X CPUs which are faster than the 5900X but have a 65 watt TDP (they actually use more). My current thinking is maybe getting the non-X CPU's instead, but it still needs a new motherboard for the AM5 socket and DDR5 memory which isn't cheap.

Nvidia released their 4000 series of GPU's which are disappointing. Apart from using much more power the pricing is also somewhat higher so I will probably skip this entire generation of GPU's and see what comes next.

22nd of December

Farm status
CPU only
Idle. Have been running early mornings.

Nvidia GPUs
Off

Raspberry Pis
All running Einstein BRP4 work.

For news on the Raspberry Pis see Marks Rpi Cluster


Other news
I have been running the Ryzen 5900X machines early in the morning for the Universe@home project. They are an astronomy project studying black holes at the moment. The 5900X can do their work units between 30 minutes and 1 hour when running 24 at a time.

I had another look at the cost of upgrading the Ryzen 5900X to Zen 4 and its still rather expensive. In addition there doesn't seem to be any 32GB DDR5 memory modules available that can do 6GHz which is the sweet-spot for Zen 4. There are a few 16GB modules but they don't recommend using 4 memory modules due to timing issues. Another concern is the power consumption that a Zen 4 CPU will use and the additional cooling needed.