<div dir="auto">Thanks for all the info. Will be really looking into the CMR / SMR disks. For my disks I am running 9 small SSD drives. Might be worth buying 32g memory. </div><div dir="auto"><br></div><div dir="auto">As a side note I erased my first build and went with default install on new hardware with pcie 3.0. Seems to have made a big difference. </div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Aug 19, 2022 at 5:35 AM ABQLUG Events <<a href="mailto:community@abqlug.com">community@abqlug.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">I use a LSI 9211-8i (in IT mode) in my home media server. However, if I <br>
were to build another home media server today, this is what I would use.<br>
<br>
<a href="https://www.ebay.com/itm/144349058469" rel="noreferrer" target="_blank">https://www.ebay.com/itm/144349058469</a><br>
<br>
Any LSI HBA flashed to IT mode for direct disk passthru would work. <br>
Since you are wanting to use TrueNAS Scale, the options for HBA are a <br>
little more lax. But for FreeBSD based TrueNAS Core, you will want to <br>
stick with LSI. Just don't make sure you don't do hardware RAID, ZFS <br>
wants/needs to directly "talk" to each disk...<br>
<br>
I know people that use the onboard SATA ports on their motherboard as <br>
well, but for that many disks, you will typically need a PCIe card.<br>
<br>
As for performance, what model of drives are you using? In general, you <br>
will want to stick to using the same model of drive. Also, avoid SMR <br>
disks LIKE THE PLAGUE. You will basically need to stick to CMR disks <br>
(also known as PMR). Also, you will notice performance degradation when <br>
you use more than 80% capacity...<br>
<br>
<a href="https://www.wundertech.net/cmr-vs-smr-what-is-the-best-hard-drive/" rel="noreferrer" target="_blank">https://www.wundertech.net/cmr-vs-smr-what-is-the-best-hard-drive/</a><br>
<br>
Now, there are some issues with random 4K writes on TrueNAS Scale.<br>
<br>
<a href="https://www.youtube.com/watch?v=BoiHHnBDg0E&t=220s" rel="noreferrer" target="_blank">https://www.youtube.com/watch?v=BoiHHnBDg0E&t=220s</a><br>
<br>
But they are working on it...<br>
<br>
<a href="https://www.truenas.com/community/threads/performance-testing-core-12-vs-13-vs-scale.101326/" rel="noreferrer" target="_blank">https://www.truenas.com/community/threads/performance-testing-core-12-vs-13-vs-scale.101326/</a><br>
<br>
So basically, if you need ZFS but don't need to use docker. Then I <br>
recommend sticking with TrueNAS Core. If you need docker, then I would <br>
use TrueNAS Scale.<br>
<br>
For RAM, throw as much RAM as you can possible throw at it. ZFS caches <br>
it's data and metadata in RAM, though you can always tune this if you <br>
need some to save some RAM for containers or VMs. ECC is generally <br>
better, but it's not 100% necessary. What IS 100% necessary is to have <br>
multiple backups of your data!<br>
<br>
I would also recommend sticking with newer hardware, mostly for the <br>
power efficiency and higher performance with containers. Especially if <br>
TrueNAS is left powered on 24/7...<br>
<br>
<a href="https://www.youtube.com/watch?v=RWmfZHn2wLs" rel="noreferrer" target="_blank">https://www.youtube.com/watch?v=RWmfZHn2wLs</a><br>
<br>
As for the boot drive and USB support. The old recommendation is to use <br>
fast USB drives. However, that isn't true anymore. Especially for <br>
TrueNAS Scale since you most likely are going to use containers.<br>
<br>
<a href="https://www.truenas.com/docs/scale/gettingstarted/scalehardwareguide/#minimum-hardware-requirements" rel="noreferrer" target="_blank">https://www.truenas.com/docs/scale/gettingstarted/scalehardwareguide/#minimum-hardware-requirements</a><br>
<br>
Hope this helps!<br>
<br>
~ Jared<br>
<br>
<br>
On 8/14/22 21:11, Wesley Robbins wrote:<br>
> Thanks. Ended up getting new hardware and did a total rebuild. But <br>
> this time built the root disk on two usb disks. Now I have a 9+2 zfs <br>
> raid. :).<br>
> <br>
> If you are interested, bought two asm1166 Sata cards that are 4xpcie <br>
> 3.0. The 1x pcie Sata card seemed to be the biggest issue. It was <br>
> really old.<br>
> <br>
> <br>
> <br>
> On Sat, Aug 13, 2022 at 1:43 PM Jonathan Haack <br>
> <<a href="mailto:jonathan@jonathanhaack.com" target="_blank">jonathan@jonathanhaack.com</a> <mailto:<a href="mailto:jonathan@jonathanhaack.com" target="_blank">jonathan@jonathanhaack.com</a>>> wrote:<br>
> <br>
> Gbps*<br>
> <br>
> On Sat, Aug 13, 2022 at 1:22 PM Jonathan Haack<br>
> <<a href="mailto:jonathan@jonathanhaack.com" target="_blank">jonathan@jonathanhaack.com</a> <mailto:<a href="mailto:jonathan@jonathanhaack.com" target="_blank">jonathan@jonathanhaack.com</a>>> wrote:<br>
> <br>
> Are you booting off a flash drive instance of TruNAS<br>
> (recommended setup afaik)? If so, is it USB 3 on both ends?<br>
> <br>
> Other than that, just make sure the drives are 7200rpm and<br>
> latest SATA spec should be fine. I don't use TruNAS itself, but<br>
> use zfs pools on two physical hosts, which is what TruNAS is<br>
> using "under the hood"<br>
> <br>
> So, I would check your boot media to begin with, then check<br>
> which SATA implementation you have 1.5, 3, or 6 ... Mbps, and<br>
> rpms of hard drive.<br>
> <br>
> Good luck.<br>
> <br>
> JMH<br>
> <br>
> On 8/10/22 3:39 PM, Wesley Robbins wrote:<br>
>> Does anyone know the best hardware or software setup for<br>
>> TruNAS? I setup trunas a few months ago, and really like it.<br>
>> minus really poor performance. Which might be my hardware.<br>
>> The internet has just confused me more. Searching and<br>
>> reading speeds of Sata, SSD, and pcie is not straight. . . I<br>
>> am not sure where to even look to make changes for the better.<br>
>><br>
>> Right now I have a AMD phenom II 6x with 16gig and 1 gig<br>
>> Ethernet. With seven Sata drives 2 of which are hot spares.<br>
>><br>
>> My thoughts now. Are as follows.<br>
>> Pcie Sata card? Better nic? More ram? Bad settings?<br>
>><br>
>> Any help would be wonderful.<br>
>><br>
>> _______________________________________________<br>
>> nmglug mailing list<br>
>> <a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a> <mailto:<a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a>><br>
>> <a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a> <<a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a>><br>
> -- <br>
> *Jonathan Haack*<br>
> Haack's Networking<br>
> phone: 505-310-6638<br>
> nextcloud: Haack's Networking<br>
> <<a href="https://nextcloud.haacksnetworking.org" rel="noreferrer" target="_blank">https://nextcloud.haacksnetworking.org</a>><br>
> email: <a href="mailto:jonathan@haacksnetworking.org" target="_blank">jonathan@haacksnetworking.org</a><br>
> <mailto:<a href="mailto:jonathan@haacksnetworking.org" target="_blank">jonathan@haacksnetworking.org</a>><br>
> Haack's Networking <<a href="https://haacksnetworking.org/" rel="noreferrer" target="_blank">https://haacksnetworking.org/</a>><br>
> <br>
> _______________________________________________<br>
> nmglug mailing list<br>
> <a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a> <mailto:<a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a>><br>
> <a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a><br>
> <<a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a>><br>
> <br>
> <br>
> _______________________________________________<br>
> nmglug mailing list<br>
> <a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a><br>
> <a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a><br>
_______________________________________________<br>
nmglug mailing list<br>
<a href="mailto:nmglug@lists.nmglug.org" target="_blank">nmglug@lists.nmglug.org</a><br>
<a href="http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org" rel="noreferrer" target="_blank">http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org</a><br>
</blockquote></div></div>