DeveloperWorld

@nicibume Could you please share this model (sony_nabla.nnb) with me?

My e-mail address: kamil.tomaszewski@sony.com

Best Regards,
Kamil Tomaszewski

Hi @mezmerizer

On Spresense you can use sampling frequency up to 512kHz.

To achieve this please see the recommended configuration in https://developer.sony.com/develop/spresense/docs/sdk_tutorials_en.html#_adc_sampling_frequency

It is also possible to use the new configuration in the Arduino IDE. To do this you will need to create a new exported SDK. In this repository you will find instructions on how to prepare a custom Arduino package for Spresense: https://github.com/sonydevworld/spresense-arduino-compatible

Thanks to this you will be able to use your own Spresense SDK with your own ADC configuration.

Best Regards,
Kamil Tomaszewski

@nicibume Could you please modify the spresense/externals/nnablart/nnabla-c-runtime/src/runtime/runtime.c file as shown below?

diff --git a/src/runtime/runtime.c b/src/runtime/runtime.c
index 6236510..2b45247 100644
--- a/src/runtime/runtime.c
+++ b/src/runtime/runtime.c
@@ -375,6 +375,9 @@ rt_return_value_t rt_forward(rt_context_pointer context) {
   rt_context_t *c = context;
 
   for (i = 0; i < c->num_of_functions; i++) {
+    printf("c->functions[i].func.exec_func %p\n", c->functions[i].func.exec_func);
+    printf("c->functions[i].info->type %d\n", c->functions[i].info->type);
+    usleep(1000);
     ret = c->functions[i].func.exec_func(&(c->functions[i].func));
     if (ret != RT_FUNCTION_ERROR_NOERROR) {
       switch (ret) {

This adds 2 extra logs. Please send me an output from your serial console after making the change.

Best Regards,
Kamil Tomaszewski

@niciBume You get these errors because you didn't make the changes I showed in step 2 to the spresense/externals/nnablart/Makefile.

This adds missing files to the Makefile that were added in the new version of the NNabla C Runtime library.

You can use the code from step 2 as .patch and apply it to your Spresense SDK repository.

Best Regards,
Kamil Tomaszewski

@nicibume I have another idea. Please use the latest version of NNabla, but update the NNabla C Runtime Library used by Spresense.

To do this:

1. Update NNabla C Runtime Library:

$ cd externals/nnablart/nnabla-c-runtime
$ git fetch
$ git rebase origin/master

2. Update nnablart Makefile:

diff --git a/externals/nnablart/Makefile b/externals/nnablart/Makefile
index cb136a93..1182ad5b 100644
--- a/externals/nnablart/Makefile
+++ b/externals/nnablart/Makefile
@@ -56,7 +56,7 @@ CFLAGS += -std=c99
 
 CFLAGS := $(patsubst -O%,-O3,$(CFLAGS))
 
-CSRCS    =   accessor.c list.c shape.c
+CSRCS    =   accessor.c fixedpoint.c list.c shape.c
 ROOTDEPPATH  = --dep-path $(SRCDIR)/functions/utilities
 VPATH    = $(SRCDIR)/functions/utilities
 
@@ -73,7 +73,7 @@ CSRCS   += binary_tanh.c binary_sigmoid.c binary_connect_affine.c binary_weight_
 ROOTDEPPATH += --dep-path $(SRCDIR)/functions/implements/quantization
 VPATH   += $(SRCDIR)/functions/implements/quantization
 
-CSRCS   += add_scalar.c arithmetic.c arithmetic_generic.c div2.c mul2.c mul_scalar.c
+CSRCS   += add_scalar.c arithmetic.c arithmetic_fixed.c arithmetic_generic.c div2.c mul2.c mul_scalar.c
 CSRCS   += pow2.c pow_scalar.c r_div_scalar.c r_pow_scalar.c r_sub_scalar.c
 CSRCS   += sub2.c add2.c
 ROOTDEPPATH += --dep-path $(SRCDIR)/functions/implements/arithmetic
@@ -92,11 +92,11 @@ CSRCS   += pooling.c max_pooling.c sum_pooling.c average_pooling.c unpooling.c d
 ROOTDEPPATH += --dep-path $(SRCDIR)/functions/implements/neural_network
 VPATH   += $(SRCDIR)/functions/implements/neural_network
 
-CSRCS   += affine.c affine_generic.c
+CSRCS   += affine.c affine_fixed8.c affine_fixed16.c affine_generic.c
 ROOTDEPPATH += --dep-path $(SRCDIR)/functions/implements/neural_network/affine
 VPATH   += $(SRCDIR)/functions/implements/neural_network/affine
 
-CSRCS   += convolution.c convolution_generic.c convolution_float.c convolution_common.c
+CSRCS   += convolution.c convolution_generic.c convolution_float.c convolution_int8.c convolution_int16.c convolution_common.c
 CSRCS   += binary_connect_convolution.c binary_weight_convolution.c depthwise_convolution.c
 ROOTDEPPATH += --dep-path $(SRCDIR)/functions/implements/neural_network/convolution
 VPATH   += $(SRCDIR)/functions/implements/neural_network/convolution
diff --git a/externals/nnablart/nnabla-c-runtime b/externals/nnablart/nnabla-c-runtime
index c58c11dd..a5fb10ea 160000
--- a/externals/nnablart/nnabla-c-runtime
+++ b/externals/nnablart/nnabla-c-runtime
@@ -1 +1 @@
-Subproject commit c58c11ddd182e8ed04eb931bbf2a82f190874c9d
+Subproject commit a5fb10ea5f2e4915fc68823500d4308ab98eb473

Please let me know if it worked for you.

Best Regards,
Kamil Tomaszewski

@nicibume

Could you please try the converter from Nnabla version 1.12.0?

Best Regards,
Kamil Tomaszewski

Hi @niciBume

Could you please try to find out where exactly dnn_runtime_initialize returns error?
https://github.com/sonydevworld/spresense/blob/87f81d9c35c7d05d6a75e9177b45d6cbe8d8c063/sdk/modules/dnnrt/src/runtime/runtime_nnabla.c#L66

Without it, it's hard to say what exactly doesn't work because this error only says that something didn't work in the NNabla C-runtime library.

As for the conversion, I think you should use these commands. This is how it is described in the documentation:

$ nnabla_cli convert sony.onnx sony_nabla.nnp
$ nnabla_cli convert -b 1 sony_nabla.nnp sony_nabla.nnb

Best Regards,
Kamil Tomaszewski

The current implementation of the Camera library does not support Camera.takePicture () function within the interrupt service routine (ISR). Kernel panic is expected. Unfortunately, but the same will be with the Spresense SDK.

Hi @MezmerizeR

Have you tried to use an operating voltage of 3.3V on the GPIO pins?
https://developer.sony.com/develop/spresense/docs/hw_docs_en.html#_setting_operating_voltage

If you change it then you also need to connect VCC to 3.3V and not to Vout.

Best Regards,
Kamil Tomaszewski

Hi @MezmerizeR

I don't know what library you use but I guess this one: https://github.com/bogde/HX711

They support fast CPU boards here: https://github.com/bogde/HX711/blob/bc5a7e5a0d518a0f384bd30105cdce0773e20028/src/HX711.cpp#L24, but unfortunately Spresense is not added there.

Could you please try adding || defined(ARDUINO_ARCH_SPRESENSE) here in your local library?

Best Regards,
Kamil Tomaszewski