News: 1637238687

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Do not try this at home: Man spends $5,000 on a 48TB Raspberry Pi storage server

(2021/11/18)


YouTuber tech whizz Jeff Geerling has found it is possible to spend $5,000 on a Raspberry Pi build.

He did this silliness because he's a [1]self-described "creative person who builds great software" with a sponsorship from Lambda Labs that keeps him from redirecting his own paycheck to quirky projects.

He's also undoubtedly generating some income from Amazon referral links throughout [2]his post and hawking wares from his [3]merch store , but you know, capitalism. Can't blame the guy for seizing an opportunity.

[4]

Anyway, about that machine – Geerling started with this [5]Taco gizmo from Radxa , which is a complete NAS/router solution built on the Raspberry Pi Compute Module 4.

[6]

[7]

He then turned everything up to 11, adding as much SSD storage as he could afford to his Taco to "see what it could do." As it turned out, "what it could do" was five Samsung 870 QVO 8TB SSDs and one Sabrent Rocket Q NVMe SSD. The result was a NAS packing 48TB raw storage, albeit at slow speeds compared to a modern desktop.

But overall, the device's performance was ... mostly disappointing.

[8]

Despite being able to load it up with as many SATA III drives as one could want and choose a decent SATA controller, the thing was limited in bandwidth.

[9]Linux 5.16 to bring mainline support to Raspberry Pi 4 Compute Module – and the nifty devices built around it

[10]Bullseye! Debian-based Raspberry Pi OS scores an update with 'less closed-source proprietary code'

[11]Raspberry Pi Zero 2 W: Nippy stocking filler for the nerd in your life – if you can get one

[12]Chip shortage forces temporary Raspberry Pi 4 price rise for the first time

"All RAID levels (including RAIDZ1) basically maxed out the Pi's bus on sequential reads," said Geerling, who added that the Sabrent NVMe drive was bottlenecked, only seeing "a few hundred megabytes per second of throughput in the best case."

But where the machine really fell apart was when an increase in network traffic collided with the CPU bottlenecking.

"I think the ideal setup for a Pi-based storage device would be low-end SSDs (or even 3.5" HDDs – they work with the Taco too, though you will need SATA/power extension cables), and RAID 1 or RAID 10 (or ZFS stripe+mirror). That way the Pi's CPU will be free when it comes to putting through more network traffic," mused Geerling.

He reckons the Frankenserver is perfectly adequate over gigabit networks, less so for faster ones.

[13]

A board-only Taco should be available for sale for under $100 by the end of 2021. A full kit with the board, a nice metal case, and a Raspberry Pi Compute Module 4 will be available early next year for $200.

Does he recommend doing this at home? Well, no, he does not. And The Register doesn't either unless you also have a sponsorship. There's a reason things come off the shelf these days.

You can view his video below. ®

[14]Youtube Video

Get our [15]Tech Resources



[1] https://www.jeffgeerling.com/about

[2] https://www.jeffgeerling.com/blog/2021/i-built-5000-raspberry-pi-server-yes-its-ridiculous

[3] https://redshirtjeff.com

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YZaGwyR2wOY5pamZlcvgJwAAARc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[5] https://wiki.radxa.com/Taco

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YZaGwyR2wOY5pamZlcvgJwAAARc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YZaGwyR2wOY5pamZlcvgJwAAARc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YZaGwyR2wOY5pamZlcvgJwAAARc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[9] https://www.theregister.com/2021/11/09/linux_pi_compute/

[10] https://www.theregister.com/2021/11/08/raspberry_pi_os_bullseye/

[11] https://www.theregister.com/2021/10/28/pi_zero_2_w/

[12] https://www.theregister.com/2021/10/21/raspberry_pi_price_rise/

[13] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YZaGwyR2wOY5pamZlcvgJwAAARc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[14] https://youtu.be/G_px298IF2k

[15] https://whitepapers.theregister.com/



Coincidence

Anonymous Coward

I found his blog last night(*) - it became apparent quite quickly he wasn't so much interested in solutions, more "how far can I push this before it gets silly". A true engineer.

* while hunting for a Raspberry Pi on a PCIe card, not with a PCIe card - to use as a lights-out controller. No such thing apparently.

'"how far can I push this before it gets silly". A true engineer'

Mike 137

With respect from a chartered systems engineer, that's not a typical (or even desirable) attribute of engineers, whose duty is to provide solutions to real problems that are effective, reliable, convenient and efficient.

It approximates closer to the approach of wizards like Wozniak, who are innovators rather than engineers. And we need innovators, but their creations seldom stand any long term test as engineering. The engineers must take over once the innovators have delivered, to refine the concept into a product.

Re: '"how far can I push this before it gets silly". A true engineer'

Totally not a Cylon

A good Engineer should be both.

Able to build something exactly to spec....

And to look at something like a Raspberry Pi and go "I wonder if....."

Stevenson, Brunel, Watt and the rest all pushed the boundaries of what was possible.

An Engineer is someone who works with engines/structures.

Prototypes are blue-sky thinking and should make people go 'Wow, I did not think that was possible/sane'

Whereas Production should be accurate to the design.

Part of Today's problems is manglement don't know the difference......

Re: '"how far can I push this before it gets silly". A true engineer'

Mike 137

" An Engineer is someone who works with engines/structures "

This is a common misapprehension. "Engineer" derives from the same root semantically as "ingenious", not from "engine". Indeed "engine" drives independently from the same root.

This misapprehension has caused every technician and fitter to be miscalled "engineer", and has thus caused great confusion.

In reality, an engineer typically converts ideas and concepts into specifications of realisable deliverables via processes of planning and design, then passes those specifications to technicians to be implemented.

On the other hand, innovators are obliged to undertake the entire end to end process, specifically because everything from the idea to the implementation is likely to be novel. Consequently, the results will commonly be prototypes, rather than finished products.

Re: '"how far can I push this before it gets silly". A true engineer'

Anonymous Coward

And part of the engineer's role is to know the limits of the thing they're working with, so they can make sure that the design doesn't reach them.

For some things those limits are well known (eg tensile strength of a specific wire), but in other cases you may have to test to destruction to find those limits. And then design to a maximum of half that limit.

But in this instance, anyone with any Pi experience would be able to tell you that the throughput is far too small for that type of use. You don't have to build it to know that.

Re: '"how far can I push this before it gets silly". A true engineer'

Blackjack

I think you are confusing Wozniak with Steve Jobs who made the Mac III such a disaster because he remove the fan because it was too noisy. Wozniak actually made things that worked, it was Steve who just wanted things to be "cool."

Re: '"how far can I push this before it gets silly". A true engineer'

Flightmode

If he wanted it to be cool he shouldn't have removed the fan.

Re: '"how far can I push this before it gets silly". A true engineer'

Mike 137

" I think you are confusing Wozniak with Steve Jobs

Actually I'm not. Woz was an innovator, Jobs was a marketing wizard.

The design of the Apple II disk interface is an example of what I am referring to. It was cunning in that it avoided the use of an expensive chip, but it was not optimum as it occupied the entire CPU capacity during disk transfers by performing in software all the low level operations that a floppy disk interface chip would have done silently without burdening the CPU. Consequently it was great innovation but not brilliant engineering.

Re: Coincidence

yetanotheraoc

"I found his blog last night ..."

Not a coincidence. His SEO is working perfectly.

Even if money is not an issue

Pascal Monett

A Synology DS420+ goes for around €350. Add 4 [1]8TB SSDs at €830 a pop and you're still €1300 better off and you have a product for which bottlenecks will not occur so often.

I understand what a pet project is, but sometimes you need to look at the cold, hard numbers first.

[1] https://www.ldlc.com/fr-lu/fiche/PB00351657.html

Re: Even if money is not an issue

A Non e-mouse

In my experience, I see a lot of fancy/complex IT where a geek said "Oh, look how clever I am" without bothering to ask the fundatmental question of "Should I do this?"

Re: Even if money is not an issue

heyrick

Alternatively, "should I not so this?" is a question to ask.

Sometimes the only reason to not do something is common sense and/or logic. But living by those rules alone makes life boring. Where would we be without people crazy enough to think of controlling a massive explosion and turning it into a way to get into orbit... or to heat up water to spin a turbine to generate electricity?

Re: Even if money is not an issue

werdsmith

Should I do this?

Well, if you are Jeff then of course you should, because he is in the business of getting his YouTube videos seen and stuff like this gets attention. He's not out to put a storage server on the market.

And the rest of us who are interested can vicariously enjoy.

Re: Even if money is not an issue

Anonymous Coward

And anyone who vaguely thought it might be a good idea can realise such things need a bit more thought, before wasting their own money!

"overall, the device's performance was ... mostly disappointing"

Mike 137

Not surprising really. For all its multiplicity of peripherals, the Pi Compute processor's performance is little better than that of my most ancient (2010) palmtop.

Re: "overall, the device's performance was ... mostly disappointing"

DougMac

Plus, add on NIC port that can barely do 200Mbps.

The bang for the buck for the Pi is pretty amazing, and it gets by with so little because so many applications need so little.

But storage isn't one of those things.

Re: "overall, the device's performance was ... mostly disappointing"

druck

The Pi 4B is showing an iperf result of 968Mbps over gigabit Ethernet.

The Pi 3B+ wasn't true gigabit but could still do about 300Mbs.

But overall, the device's performance was ... mostly disappointing.

m-k

doesn't matter, what matters is publicity. But you can't blame anybody, cause capitalism, etc., eh?

Not surprised

BinkyTheMagicPaperclip

The Pi is useful for lower end, low power server stuff and I/O interfacing.

Recently I've tried using it to replace a Core2Quad Unix desktop with a fanless silent Linux based Pi 4 (sadly BSD on the Pi has unaccelerated Xorg).

I would describe the experience as painful. Raspbian is quite fragile, I see issues with USB that don't appear on an x86 PC, and it's considerably slower than the 2008 era Core2Quad system.

The takeaway so far is 'Windows is far better than this', although to be fair I expect Linux on x64 wouldn't experience all the issues I'm seeing.

Recommendations for silent small x64 boxes welcome.

Re: Not surprised

werdsmith

That last thing that Raspberry Pi OS based on Buster (it hasn't been called Raspbian for ages) is, is "fragile". It's as strong as it needs to be for an educational/experimental system, and that's pretty strong.

The new Bullseye based version needs to mature a bit.

I get along with it just fine for desktop use.

Rahbut

It was done for a bit of fun - I don't see the problem here...

Such opportunity. The like of which you've never seen...

Aristotles slow and dimwitted horse

I'm going to set up an, erm... "merch" store for my comments on El Reg and then hawk the url when I post comments. Then I'm going to set up a Patreon page so I can try to convince everyone else to pay for my lifestyle. If that doesn't work, then I guess I'll resort to thumbnails of girls in bikinis to try to lure people in. That seems to be the stock clickbait method on YT when a channel needs to up its stats.

When I bought my project sailboat last year I did actually think of setting up a YT channel to document the renovation. Then I remembered (A) how much I dislike Google, (B) how shit and desperate most of the YT stuff is, (C) that I couldn't actually be arsed and didn't want to be a slave to a camera, and (D) that I don't actually need the money (not that I'd have made much TBH).

Re: Such opportunity. The like of which you've never seen...

Yet Another Anonymous coward

Your sailboat reno video needs to include lots of pictures of you in a bikini (recommending you shave your back)

Doctor Syntax

However a Pi with a single disk and Nextcloud is quite a handy domestic server although over the last few releases log-on seems to have got rather slow - or is it just mine? Anyway there's no need to log on very often.

The engineering gospel

hammarbtyp

He who has not seen a product and said "I can build a better one and cheaper" and then spent loads more than the original product proving themselves wrong, may cast the first stone.

Re: The engineering gospel

KarMann

He who has not seen a product and said "I can build a better one and cheaper" and then spent loads more than the original product proving themselves wrong, may build the trebuchet to cast the first stone. FTFY

Re: The engineering gospel

Yet Another Anonymous coward

Is there any field of engineering that hasn't dreamed of building a Trebuchet?

It might even make control systems bearable

Re: The engineering gospel

elsergiovolador

Product development will cost more than the product you are trying to copy, but once you actually develop it, so it meets your requirements and is actually repeatable, then you have a chance at making it cheaper in volume.

Speed compensation

b0llchit

He should have added a whole lot of flashy LED strings, doing blinkenlights things without any reason. That would have improved the system's performance. Not in terms of raw speed, but entertainment value while waiting for your data.

And, if all fails, like missing all data, then you can make it shine in a fine red color. See, "performance" is in the eye of the beholder.

Re: Speed compensation

Yet Another Anonymous coward

Alternatively he could return the drives to Amazon for a refund while earning $$$ through YT ads and referable links while getting lots of free publicity from el'reg

Cloud storage is being upgraded

Version 1.0

Google Backup and Sync and Microsoft OneDrive are both being upgraded to stop them working on Windows 7 so we'll probably see a lot of people chasing their own cloud storage so that they can keep using it because it doesn't get "upgraded" to stop it working any more.

Re: Cloud storage is being upgraded

Yet Another Anonymous coward

1, Buy Synology box and stick 4x8tb spinning rust drives in it, go to pub

2, Buy HP microserver tower, install open source build of synology DSM, stick 4x8tb spinning rust drives in it, go to pub an hour later than 1

Not too bad

Pirate Dave

A video about building a $5000 storage device that works but is slow, isn't too naff. I've watched AvE tear into brand-new, relatively expensive tools in his BOLTR vids, and thought "there's no way he's getting that thing back together and working". And sometimes he doesn't. But I've never begrudged the $5 I donate every month - it's cheap entertainment.

microelectronic Riemannian curved-space fault in write-only file system