andyattebery

andyattebery

Member Since 11 years ago

Chicago, IL

Experience Points
5
follower
Lessons Completed
1
follow
Best Reply Awards
33
repos

141 contributions in the last year

Pinned
⚡ Library with common category classes, view controllers and other resources useful for the creation of iOS applications.
⚡ torrg is a configurable program to organize torrents that are completed using a torrent client such as rtorrent
⚡ Cross-Platform Mvvm Platform for MonoTouch, MonoDroid, WP7 and WinRT. Includes databinding support for Android XML, for MonoTouch XIBs and for MonoTouch.Dialog. The vNext branch is now live!
Activity
Nov
13
3 weeks ago
Activity icon
issue

andyattebery issue comment geerlingguy/raspberry-pi-pcie-devices

andyattebery
andyattebery

Test Radxa Taco 5x SATA NAS with 2.5G and 1G Ethernet

See original issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/202

DSC03256 (1)

I have a Taco (well, the Penta main board that goes inside) and would like to do some testing on it; run some benchmarks, test compiling ZFS, etc.

Things to test:

  • Power consumption (at wall, using Kill-A-Watt) at idle with 5 SATA drives + NVMe, and running benches over network
  • Network performance (single port, 2.5G)
  • NVMe performance (single drive)
  • SATA performance (single drive)
  • SATA performance (5-drive RAID0)
  • SATA performance (5-drive RAID5)
  • SATA performance (5-drive ZFS RAIDZ1)
andyattebery
andyattebery

I set up a 4 drive, striped + mirrored zpool with recordsize=1M on my hacked together build with a 8GB CM4 pictured below.

I'm seeing some wild numbers using your iozone tests: 900+ MB/s 1M reads/writes even with the file size set to 20 GB and 4-5 MB/s 4K reads/writes, so I don't know what's going on there.

I also ran your rsync test using a 16GB file from my Mac mini (with 10GbE) to the 2.5 GbE port on the Taco with more reasonable results:

  • Mac to Taco: 140.28M bytes/sec
  • Taco to Mac: 130.68M bytes/sec

I'd be happy to run some more tests if you'd like; I have another 8TB hard drive I can add to the array. However, its looking like PCIe 2.0 lane is going to be the real bottleneck even for spinny drives.

About the build... I know the PSU is probably unnecessary, but I didn't want to buy $35 in cables only to find out the Taco couldn't drive 4-5 spinny hard drives.

IMG_0254

IMG_0255

Oct
7
2 months ago
Activity icon
issue

andyattebery issue comment geerlingguy/raspberry-pi-pcie-devices

andyattebery
andyattebery

Test Radxa Taco 5x SATA NAS with 2.5G and 1G Ethernet

See original issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/202

DSC03256 (1)

I have a Taco (well, the Penta main board that goes inside) and would like to do some testing on it; run some benchmarks, test compiling ZFS, etc.

andyattebery
andyattebery

Both 32-bit and 64-bit work. On one 32-bit installation lspci wasn't returning anything and the SATA drives weren't showing up. However, I just did a fresh install, updated the packages, installed the driver, and everything is working fine.

Activity icon
issue

andyattebery issue comment geerlingguy/raspberry-pi-pcie-devices

andyattebery
andyattebery

Test Radxa Taco 5x SATA NAS with 2.5G and 1G Ethernet

See original issue: https://github.com/geerlingguy/raspberry-pi-pcie-devices/issues/202

DSC03256 (1)

I have a Taco (well, the Penta main board that goes inside) and would like to do some testing on it; run some benchmarks, test compiling ZFS, etc.

andyattebery
andyattebery

I was able to get the Realtek driver working without having to recompile the kernel with the module on the newest version of Raspberry Pi OS. Jeff mentions in his post about 2.5GbE, he had trouble compiling it, so maybe something has changed.

  1. Install raspberrypi-kernel-headers (sudo apt install raspberrypi-kernel-headers)
  2. Download 2.5G Ethernet LINUX driver r8125 for kernel up to 5.6
  3. Unarchive driver (untar -xf r8125-9.006.04.tar.bz2)
  4. Build and install driver (cd r8125-9.006.04; sudo ./autorun.sh)
Screen Shot 2021-10-07 at 3 20 54 PM Screen Shot 2021-10-07 at 3 20 37 PM Screen Shot 2021-10-07 at 3 20 10 PM
Sep
21
2 months ago
Activity icon
issue

andyattebery issue comment geerlingguy/raspberry-pi-pcie-devices

andyattebery
andyattebery

Add Radxa Taco - the successor of the ROCK Pi SATA HAT(Penta SATA CM4 carrier board)

I've been following this repository for quite long time. As a Raspberry Pi fan, we've been working on the Radxa Taco for a while, which is an ultimate CM4 carrier board designed for nas/server/router applications. The ideas is based on the Quad SATA HAT for the Raspberry Pi 4 and go further beyond it. The Radxa Taco has the following features:

  • Use asm1806 pcie switch
  • Dual ethernet, one 1000M from CM4, one 2.5G rtk8125b to pcie switch
  • 5x SATA via JMB585 to pcie switch
  • 1x M.2 M key NVMe to pcie switch
  • 1x PCIe M.2 WiFi module, support Intel AX200
  • 10P header for Top Board with OLED and button
  • RTC/USB 2/uSD card

The case is working on...

radxa_taco_top radxa_taco_angle radxa_taco_bottom

andyattebery
andyattebery

I spent some time testing the board over the weekend. Here are my initial thoughts and notes:

  • The SATA connectors are female 22 pin (7+15) which are great if you are using 2.5" drives, but not so much for 3.5" drives. I bought some male to male adapters, so I could plug in standard female 7 pin SATA cables.
  • I only had a 3.5A power supply readily available instead of the 5A that was suggested, so I powered the 4 3.5" drives I'm using from a spare computer PSU. Once I get a 5.5mm x 2.5mm barrel adapter for my 8A power supply, I'll test powering the drives directly. However, I didn't see any female to female 15 pin SATA power cables on Amazon, so this might involve hacking together some from spare module PSU cables. (Please tell me if there is a better way.)

Testing "Setup"

  • Compute Modules with eMMC have the micro SD card slot disabled since the SD connectivity goes to the eMMC. Because the board doesn't have a "periphrial" USB port to flash the eMMC, there isn't a great way to directly install an OS to the eMMC without also having an IO Board or similar. I used a USB drive as a boot drive plugged into the USB 2.0 port; surprisingly this wasn't as slow as I was expecting. I suppose once booted from the USB drive, the OS installation could be copied to the eMMC.
  • I updated the bootloader to the newest version to support NVMe drive booting as outlined here and by Jeff. To avoid needing to boot the full version of Raspberry Pi OS to use the SD Card Copier utility, I used a NVMe to USB adapter to directly install the OS to the drive and initially booted it from USB to install the updates. I discovered that even the newest bootloader won't boot a NVMe drive that is connected via a PCIe switch. This led me to copying the boot partition to a USB drive and leaving the root partition on the NVMe drive; the same kind of setup would work with a boot partition on the eMMC or SD card too. I was able to get this setup to work with Raspberry Pi OS (I only tested the newest 64-bit version)and Ubuntu 21.04.
  • Even though the 'proposed' Ubuntu 21.04 kernel says it enabled SATA drive support, the kernel module didn't load for me. It also looks like the kernel module for the RTL8125 2.5GbE controller wasn't loaded either.
  • I haven't tested the 2.5GbE controller on Raspberry Pi OS, but it looks like the kernel driver/module isn't loaded, and I don't see the network interface.

Raspberry Pi OS 2.5GbE controller

  • I really wanted to test ZFS which is why I was wanting to use Ubuntu since it has the kernel module built-in; however, now I realize I didn't verify the ARM/Raspberry Pi port has it, so maybe that was all for naught. I think my next steps will be compiling the Raspberry Pi OS kernel with ZFS support using the 45 Drives repo they used for the "Mini Storinator".
  • Before I attempt to get ZFS working, I'll try to get some benchmarks for various mdadm RAID configurations.