Running LLMs on the NPU of the Rockchip RK3588

Hi, sorry it's not really related to your video but did you compile uboot for this device? I'm at my wit's end trying to follow the Rockchip Wiki for uboot.

Was the power consumption 8 watts when running two of the three NPU cores? I wonder how the power consumption changes as a function of the number of NPU cores in use.

It is so slow. It might as well be useless.

Is the NPU failing to complete with the 7billion model due to running out of memory? Is there a log file somewhere?