SimpleInfer is a neural network inference framework based on KuiperInfer.
SimpleInfer uses xmake to build library and tests.
git clone --recursive https://github.com/zpye/SimpleInfer.git
cd SimpleInfer
xmake config -a x64 -m release
xmake -w --all
After building successfully, run test-yolo to check.
xmake run test-yolo
Here are visualized results of YOLO detection.
-
Set environment
PYTHON_ROOT
wherepython
binary exists, pybind11 needs${PYTHON_ROOT}/include
and${PYTHON_ROOT}/libs
for compiling and linking. -
Set
--build_python=true
afterxmake config
and build:
xmake config -a x64 -m release --build_python=true
xmake -w --all
- install package by pip:
pip install build/python/
- run python test:
python test/test_python/test_model.py
Note: Only upsample nearest layer has an implementation of Halide.
-
Set environment
HALIDE_ROOT
for Halide installation path, using release packages from https://github.com/halide/Halide/releases is a good choice. -
Set
--halide=true
afterxmake config
and build:
xmake config -a x64 -m release --halide=true
xmake build halide_layers
xmake -w --all
KuiperInfer -> basic framework
ncnn, simpleocv -> pnnx ir, simpleocv and mat-pixel operations
Eigen, tensorflow -> Eigen tensor
abseil -> logging, string format operations
CGraph -> graph based pipeline
highway, Simd -> SIMD, GEMM, Winograd, parallel
benchmark, Catch2 -> benchmark and unit tests
pybind11 -> python bindings of c++
stb -> image loader and image writer
Halide -> Halide programming
tmp -> pnnx models