[nmglug] Trunas scale exp?

Wesley Robbins wezzels at gmail.com
Fri Aug 19 09:53:09 PDT 2022


Thanks for all the info.  Will be really looking into the CMR / SMR disks.
  For my disks I am running 9 small SSD drives.   Might be worth buying 32g
memory.

As a side note I erased my first build and went with default install on new
hardware with pcie 3.0.  Seems to have made a big difference.

On Fri, Aug 19, 2022 at 5:35 AM ABQLUG Events <community at abqlug.com> wrote:

> I use a LSI 9211-8i (in IT mode) in my home media server. However, if I
> were to build another home media server today, this is what I would use.
>
> https://www.ebay.com/itm/144349058469
>
> Any LSI HBA flashed to IT mode for direct disk passthru would work.
> Since you are wanting to use TrueNAS Scale, the options for HBA are a
> little more lax. But for FreeBSD based TrueNAS Core, you will want to
> stick with LSI. Just don't make sure you don't do hardware RAID, ZFS
> wants/needs to directly "talk" to each disk...
>
> I know people that use the onboard SATA ports on their motherboard as
> well, but for that many disks, you will typically need a PCIe card.
>
> As for performance, what model of drives are you using? In general, you
> will want to stick to using the same model of drive. Also, avoid SMR
> disks LIKE THE PLAGUE. You will basically need to stick to CMR disks
> (also known as PMR). Also, you will notice performance degradation when
> you use more than 80% capacity...
>
> https://www.wundertech.net/cmr-vs-smr-what-is-the-best-hard-drive/
>
> Now, there are some issues with random 4K writes on TrueNAS Scale.
>
> https://www.youtube.com/watch?v=BoiHHnBDg0E&t=220s
>
> But they are working on it...
>
>
> https://www.truenas.com/community/threads/performance-testing-core-12-vs-13-vs-scale.101326/
>
> So basically, if you need ZFS but don't need to use docker. Then I
> recommend sticking with TrueNAS Core. If you need docker, then I would
> use TrueNAS Scale.
>
> For RAM, throw as much RAM as you can possible throw at it. ZFS caches
> it's data and metadata in RAM, though you can always tune this if you
> need some to save some RAM for containers or VMs. ECC is generally
> better, but it's not 100% necessary. What IS 100% necessary is to have
> multiple backups of your data!
>
> I would also recommend sticking with newer hardware, mostly for the
> power efficiency and higher performance with containers. Especially if
> TrueNAS is left powered on 24/7...
>
> https://www.youtube.com/watch?v=RWmfZHn2wLs
>
> As for the boot drive and USB support. The old recommendation is to use
> fast USB drives. However, that isn't true anymore. Especially for
> TrueNAS Scale since you most likely are going to use containers.
>
>
> https://www.truenas.com/docs/scale/gettingstarted/scalehardwareguide/#minimum-hardware-requirements
>
> Hope this helps!
>
> ~ Jared
>
>
> On 8/14/22 21:11, Wesley Robbins wrote:
> > Thanks.  Ended up getting new hardware and did a total rebuild.  But
> > this time built the root disk on two usb disks.   Now I have a 9+2 zfs
> > raid.  :).
> >
> > If you are interested, bought two asm1166 Sata  cards that are 4xpcie
> > 3.0.  The 1x pcie Sata card seemed to be the biggest issue.  It was
> > really old.
> >
> >
> >
> > On Sat, Aug 13, 2022 at 1:43 PM Jonathan Haack
> > <jonathan at jonathanhaack.com <mailto:jonathan at jonathanhaack.com>> wrote:
> >
> >     Gbps*
> >
> >     On Sat, Aug 13, 2022 at 1:22 PM Jonathan Haack
> >     <jonathan at jonathanhaack.com <mailto:jonathan at jonathanhaack.com>>
> wrote:
> >
> >         Are you booting off a flash drive instance of TruNAS
> >         (recommended setup afaik)? If so, is it USB 3 on both ends?
> >
> >         Other than that, just make sure the drives are 7200rpm and
> >         latest SATA spec should be fine. I don't use TruNAS itself, but
> >         use zfs pools on two physical hosts, which is what TruNAS is
> >         using "under the hood"
> >
> >         So, I would check your boot media to begin with, then check
> >         which SATA implementation you have 1.5, 3, or 6 ... Mbps, and
> >         rpms of hard drive.
> >
> >         Good luck.
> >
> >         JMH
> >
> >         On 8/10/22 3:39 PM, Wesley Robbins wrote:
> >>         Does anyone know the best hardware or software setup for
> >>         TruNAS? I setup trunas a few months ago, and really like it.
> >>          minus really poor performance. Which might be my hardware.
> >>         The internet has just confused me more.    Searching and
> >>         reading speeds of Sata, SSD, and pcie is not straight. . .  I
> >>         am not sure where to even look to make changes for the better.
> >>
> >>         Right now I have a AMD phenom II 6x with 16gig and 1 gig
> >>         Ethernet.  With seven Sata drives 2 of which are hot spares.
> >>
> >>         My thoughts now. Are as follows.
> >>         Pcie Sata card? Better nic?  More ram?  Bad settings?
> >>
> >>         Any help would be wonderful.
> >>
> >>         _______________________________________________
> >>         nmglug mailing list
> >>         nmglug at lists.nmglug.org  <mailto:nmglug at lists.nmglug.org>
> >>         http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org  <
> http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org>
> >         --
> >         *Jonathan Haack*
> >         Haack's Networking
> >         phone: 505-310-6638
> >         nextcloud: Haack's Networking
> >         <https://nextcloud.haacksnetworking.org>
> >         email: jonathan at haacksnetworking.org
> >         <mailto:jonathan at haacksnetworking.org>
> >         Haack's Networking <https://haacksnetworking.org/>
> >
> >     _______________________________________________
> >     nmglug mailing list
> >     nmglug at lists.nmglug.org <mailto:nmglug at lists.nmglug.org>
> >     http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org
> >     <http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org>
> >
> >
> > _______________________________________________
> > nmglug mailing list
> > nmglug at lists.nmglug.org
> > http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org
> _______________________________________________
> nmglug mailing list
> nmglug at lists.nmglug.org
> http://lists.nmglug.org/listinfo.cgi/nmglug-nmglug.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nmglug.org/pipermail/nmglug-nmglug.org/attachments/20220819/7eb494f3/attachment.htm>


More information about the nmglug mailing list