DNNLibrary | Daquexian's NNAPI Library ONNX + Android NNAPI | Game Engine library

I need to run a custom GluonCV object detection module on Android.

I already fine-tuned the model (ssd_512_mobilenet1.0_custom) on a custom dataset, I tried running inference with it (loading the .params file produced during the training) and everything works perfectly on my computer. Now, I need to export this to Android.

I was referring to this answer to figure out the procedure, there are 3 suggested options:

1. You can use ONNX to convert models to other runtimes, for example [...] NNAPI for Android
2. You can use TVM
3. You can use SageMaker Neo + DLR runtime [...]

Regarding the first one, I converted my model to ONNX. However, in order to use it with NNAPI, it is necessary to convert it to daq. In the repository, they provide a precomplied AppImage of onnx2daq to make the conversion, but the script returns an error. I checked the issues section, and they report that "It actually fails for all onnx object detection models".

Then, I gave a try to DLR, since it's suggested to be the easiest way. As I understand, in order to use my custom model with DLR, I would first need to compile it with TVM (which also covers the second point mentioned in the linked post). In the repo, they provide a Docker image with some conversion scripts for different frameworks. I modified the 'compile_gluoncv.py' script, and now I have: