rknn-toolkit2/rknpu2/examples/rknn_matmul_api_demo/README.md

rknn_matmul_api_demo is a example which performs matrix multiplication using the RKNPU matmul C API.

Usage:

Usage:
./rknn_matmul_api_demo <matmul_type> <M> <K> <N> <B_layout> <AC_layout> <loop_count>
        matmul_type = 1: RKNN_FLOAT16_MM_FLOAT16_TO_FLOAT32
        matmul_type = 2: RKNN_INT8_MM_INT8_TO_INT32
        matmul_type = 10: RKNN_INT4_MM_INT4_TO_INT16
Example: A = [4,64], B = [64,32], int8 matmul test command as followed:
./rknn_matmul_api_demo 2 4 64 32

The following <TARGET_PLATFORM> represents RK3566_RK3568, RK3562 or RK3588

Aarch64 Linux Demo

Build

modify GCC_COMPILER on build-linux_<TARGET_PLATFORM>.sh for target platform,

then execute

./build-linux_<TARGET_PLATFORM>.sh

Install

Copy install/rknn_matmul_api_demo_Linux to the devices under /userdata/.

• If you use rockchip's evb board, you can use the following way:

Connect device and push the program to /userdata

adb push install/rknn_matmul_api_demo_Linux /userdata/

• If your board has sshd service, you can use scp or other methods to copy the program to the board.

Run

adb shell
cd /userdata/rknn_matmul_api_demo_Linux/

export LD_LIBRARY_PATH=./lib
./rknn_matmul_api_demo 2 4 64 32

Android Demo

Build

modify ANDROID_NDK_PATH on build-android_<TARGET_PLATFORM>.sh for target platform, then execute

./build-android_<TARGET_PLATFORM>.sh

Install

connect device and push build output into /data

adb push install/rknn_matmul_api_demo_Android /data/

Run

adb shell
cd /data/rknn_matmul_api_demo_Android/

export LD_LIBRARY_PATH=./lib
./rknn_matmul_api_demo 2 4 64 32