Spresense

• 

  Where do I get started with Spresense development?
  • DanielSand  

  2
  0
  Votes
  2
  Posts
  1691
  Views

  

  Getting started with Spresense using Arduino:
  https://developer.sony.com/develop/spresense/developer-tools/get-started-using-arduino-ide/set-up-the-arduino-ide

• J

  Other image sensors?
  imx sensors datasheets • • JanKok  

  5
  0
  Votes
  5
  Posts
  312
  Views

  J

  @TE-KarlKomierowski I joyfully bought the Spresence kit partly because it is open source, open hardware. But I'm disappointed that it is so difficult to get detailed datasheets for Sony image sensors without signing an NDA. I don't want to worry about violating an NDA if I release hardware designs (e.g. an image sensor board) or code (e.g. driver for the image sensor) as open source. And I really don't see what is accomplished by keeping datasheets for released products confidential. Once a product is released, anyone can reverse engineer the pinouts, voltage levels, measure sensitivity, compare with competing products, etc.

  Whoever came up with the idea of the open source open hardware Spresence kit - I applaud them. And I wonder if we can prevail upon them to encourage the image sensor division to make their detailed datasheets for released products easily accessible from the company website? For example, at https://www.sony-semicon.co.jp/e/products/IS/industry/product.html

  I did manage to find ONE detailed, preliminary, non-confidential datasheet, for the IMX290LQR-C, at https://static6.arrow.com/aropdfconversion/c0c7efde6571c768020a72f59b226308b9669e45/sony_imx290lqr-c_datasheet.pdf . That's incredibly helpful, and if I can find someone to sell me a few of those sensors, I'll try to produce a camera board with that sensor that is compatible with the Spresence kit. And make it open hardware so anyone can make them, and maybe sell a few for a reasonable price if anyone wants them. Having an IMX290 camera board available would make it easier for other developers to use that sensor - which would benefit Sony. So there is a reason why datasheets should be made freely available!

  Really, I'd prefer to use the monochrome IMX290LLR, and I'd also like to compare and consider the IMX430LLJ and IMX433LLJ sensors as well. Could I get detailed datasheets for those 3 sensors?

• 

  How to bring up the network in Spresense?
  • vivekbhadra  

  11
  0
  Votes
  11
  Posts
  147
  Views

  

  @TE-KarlKomierowski I have now integrated it into the SPRESENSE SDK. I have attached the patch for the changes I had to make for integrating it into the sdk. Also, I have taken out the source code from the patch file.

  From 3918a7c826016c307fc5b3af0012aff766c372bd Mon Sep 17 00:00:00 2001 From: Vivek Bhadra <vivek.bhadra@sony.com> Date: Wed, 23 Oct 2019 14:02:16 +0100 Subject: [PATCH] Integrating the esp8266 wifi module in SPRESENSE sdk. --- sdk/drivers/Kconfig | 1 + sdk/drivers/Makefile | 1 + sdk/drivers/esp8266/Kconfig | 18 + sdk/drivers/esp8266/Make.defs | 48 ++ sdk/drivers/esp8266/esp8266.c | 799 +++++++++++++++++++++++++++++ sdk/drivers/esp8266/esp8266.h | 88 ++++ sdk/drivers/esp8266/esp8266_main.c | 121 +++++ sdk/drivers/esp8266/esp8266_main.h | 26 + sdk/drivers/esp8266/license.txt | 12 + sdk/drivers/esp8266/wifi.h | 7 + 10 files changed, 1121 insertions(+) create mode 100644 sdk/drivers/esp8266/Kconfig create mode 100644 sdk/drivers/esp8266/Make.defs create mode 100644 sdk/drivers/esp8266/esp8266.c create mode 100644 sdk/drivers/esp8266/esp8266.h create mode 100644 sdk/drivers/esp8266/esp8266_main.c create mode 100644 sdk/drivers/esp8266/esp8266_main.h create mode 100644 sdk/drivers/esp8266/license.txt create mode 100644 sdk/drivers/esp8266/wifi.h diff --git a/sdk/drivers/Kconfig b/sdk/drivers/Kconfig index b4b87157..ca4247a7 100644 --- a/sdk/drivers/Kconfig +++ b/sdk/drivers/Kconfig @@ -5,5 +5,6 @@ source "$SDKDIR/drivers/sensors/Kconfig" source "$SDKDIR/drivers/lcd/Kconfig" source "$SDKDIR/drivers/video/Kconfig" source "$SDKDIR/drivers/modem/Kconfig" +source "$SDKDIR/drivers/esp8266/Kconfig" endmenu diff --git a/sdk/drivers/Makefile b/sdk/drivers/Makefile index f5256112..4f843a3d 100644 --- a/sdk/drivers/Makefile +++ b/sdk/drivers/Makefile @@ -44,6 +44,7 @@ include sensors$(DELIM)Make.defs include lcd$(DELIM)Make.defs include video$(DELIM)Make.defs include modem$(DELIM)Make.defs +include esp8266$(DELIM)Make.defs AOBJS = $(ASRCS:.S=$(OBJEXT)) COBJS = $(CSRCS:.c=$(OBJEXT)) diff --git a/sdk/drivers/esp8266/Kconfig b/sdk/drivers/esp8266/Kconfig new file mode 100644 index 00000000..b5e97470 --- /dev/null +++ b/sdk/drivers/esp8266/Kconfig @@ -0,0 +1,18 @@ +# +# For a description of the syntax of this configuration file, +# see the file kconfig-language.txt in the NuttX tools repository. +# + +menuconfig WIFI + bool "WIFI drivers" + ---help--- + WIFI device drivers. + +if WIFI + +config CONFIG_WIFI_ESP8266 + bool "ESP8266 Wifi support" + default y + ---help--- + Enable driver for the ESP8266 Wifi +endif diff --git a/sdk/drivers/esp8266/Make.defs b/sdk/drivers/esp8266/Make.defs new file mode 100644 index 00000000..abe37fbd --- /dev/null +++ b/sdk/drivers/esp8266/Make.defs @@ -0,0 +1,48 @@ +############################################################################ +# lte/drivers/Make.defs +# +# Copyright 2018 Sony Semiconductor Solutions Corporation +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in +# the documentation and/or other materials provided with the +# distribution. +# 3. Neither the name of Sony Semiconductor Solutions Corporation nor +# the names of its contributors may be used to endorse or promote +# products derived from this software without specific prior written +# permission. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS +# FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE +# COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, +# INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, +# BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS +# OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED +# AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT +# LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN +# ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE +# POSSIBILITY OF SUCH DAMAGE. +# +############################################################################ + +ifeq ($(CONFIG_WIFI),y) + +#ifeq ($(CONFIG_WIFI_ESP8266),y) +CSRCS += esp8266.c +CSRCS += esp8266_main.c +#endif + +DEPPATH += --dep-path esp8266 +VPATH += :esp8266 +CFLAGS += $(shell $(INCDIR) $(INCDIROPT) "$(CC)" $(SDKDIR)$(DELIM)drivers$(DELIM)esp8266) + +endif diff --git a/sdk/drivers/esp8266/wifi.h b/sdk/drivers/esp8266/wifi.h new file mode 100644 index 00000000..bb087e06 --- /dev/null +++ b/sdk/drivers/esp8266/wifi.h @@ -0,0 +1,7 @@ +#ifndef __WIFI__ +#define __WIFI__ +#define SSID "1234" +#define PASSWORD "1234" +#define HOST_NAME "SPRESENSE" +#define HOST_PORT 1234 +#endif -- 2.17.1
• U

  Recorder_WAV -- Multiple Recordings
  • user1388  

  6
  0
  Votes
  6
  Posts
  1877
  Views

  K

  @user1388

  Hi,

  This is a known issue. I have found a temporary solution for now. Unfortunately, this requires that you build the Spresense Arduino package again. You can use this: https://github.com/sonydevworld/spresense-arduino-compatible

  Currently, when an error is detected, the Audio module stops working. However, this can be changed and when FIFO OVERFLOW is detected, samples can be dropped instead.

  As a result, the application does not finish recording, but on the other hand does not guarantee that all samples will be saved.

  Solution:

  Find function bool AudioRecorderSink::write(const AudioRecSinkData_s &param) in the file sdk/modules/audio/objects/media_recorder/audio_recorder_sink.cpp

  Comment line number 84.

  Return true instead of false on line number 85.

  After the changes, the function should look like this:

  bool AudioRecorderSink::write(const AudioRecSinkData_s &param) { if (param.byte_size > 0) { if (CMN_SimpleFifoGetVacantSize(static_cast<CMN_SimpleFifoHandle *> (m_output_device_hdlr.simple_fifo_handler)) < param.byte_size) { // MEDIA_RECORDER_WARN(AS_ATTENTION_SUB_CODE_SIMPLE_FIFO_OVERFLOW); return true; } if (CMN_SimpleFifoOffer(static_cast<CMN_SimpleFifoHandle *> (m_output_device_hdlr.simple_fifo_handler), static_cast<const void*>(param.mh.getVa()), param.byte_size) == 0) { MEDIA_RECORDER_WARN(AS_ATTENTION_SUB_CODE_SIMPLE_FIFO_OVERFLOW); return false; } m_output_device_hdlr.callback_function(param.byte_size); } return true; }

  This is only a temporary solution. If I find other, I will let you know.

• 

  Camera app cannot detect SD card
  • vivekbhadra  

  8
  0
  Votes
  8
  Posts
  2357
  Views

  

  Hi @TE-KarlKomierowski as you said I pressed the SPRESENSE a bit on the extension board and seems the SD card is now working. So the issue was the SPRESENSE was not connected properly on the extension board.

  Thanks you very much for the help.

  Regards,
  Vivek

• R

  ESP8266 wi-fi access with Spresense
  • Robert McCain  

  3
  0
  Votes
  3
  Posts
  1119
  Views

  R

  Hi @david,

  Thanks for the response!!

  Actually it looks like this developer is saying that the ESP8266-01 won't work with Spresense so he had to use the AdaFruit Feather. I can confirm that I have been able to get my ESP8266-01 module working at one point with Spresense, but for some reason it has completely stopped working. I wonder if my module is damaged somehow even though I am able to connect my module using an adapter board and run simple commands like blinking the lights.

• A

  Digital Microphones and Arduino
  • atw72  

  8
  0
  Votes
  8
  Posts
  2133
  Views

  

  Hi @atw72

  Could you try the following and see what the outcome is?

  #include <SDHCI.h> #include <Audio.h> SDClass theSD; AudioClass *theAudio; File myFile; bool ErrEnd = false; /** @brief Audio attention callback When audio internal error occurc, this function will be called back. */ static void audio_attention_cb(const ErrorAttentionParam *atprm) { puts("Attention!"); switch (atprm->error_code) { case AS_ATTENTION_CODE_INFORMATION: case AS_ATTENTION_CODE_WARNING : ErrEnd = false; break; case AS_ATTENTION_CODE_ERROR : case AS_ATTENTION_CODE_FATAL : default: ErrEnd = true; } } /** @brief Setup recording of mp3 stream to file Select input device as microphone <br> Initialize filetype to stereo mp3 with 48 Kb/s sampling rate <br> Open "Sound.mp3" file in write mode */ static const int32_t recoding_frames = 400; static const int32_t recoding_size = recoding_frames * 288; /* 96kbps, 1152sample */ void setup() { theAudio = AudioClass::getInstance(); theAudio->begin(audio_attention_cb); puts("initialization Audio Library"); /* Select input device as microphone */ theAudio->setRecorderMode(AS_SETRECDR_STS_INPUTDEVICE_MIC, AS_MICGAIN_HOLD, 68, true); /* Initialize filetype to stereo mp3 with 48 Kb/s sampling rate Search for MP3 codec in "/mnt/sd0/BIN" directory */ theAudio->initRecorder(AS_CODECTYPE_MP3, "/mnt/sd0/BIN", AS_SAMPLINGRATE_48000, AS_CHANNEL_STEREO); puts("Init Recorder!"); /* Open file for data write on SD card */ myFile = theSD.open("sound.mp3", FILE_WRITE); /* Verify file open */ if (!myFile) { printf("File open error\n"); exit(1); } theAudio->startRecorder(); puts("Recording Start!"); } /** @brief Record given frame number */ void loop() { err_t err; /* recording end condition */ if (theAudio->getRecordingSize() > recoding_size) { theAudio->stopRecorder(); sleep(1); err = theAudio->readFrames(myFile); goto exitRecording; } /* Read frames to record in file */ err = theAudio->readFrames(myFile); if (err != AUDIOLIB_ECODE_OK) { printf("File End! =%d\n", err); theAudio->stopRecorder(); goto exitRecording; } if (ErrEnd) { printf("Error End\n"); theAudio->stopRecorder(); goto exitRecording; } /* This sleep is adjusted by the time to write the audio stream file. Please adjust in according with the processing contents being processed at the same time by Application. */ // usleep(10000); return; exitRecording: theAudio->closeOutputFile(myFile); myFile.close(); theAudio->setReadyMode(); theAudio->end(); puts("End Recording"); exit(1); }
• J

  audio scope
  • JCPStevens  

  2
  0
  Votes
  2
  Posts
  1163
  Views

  

  Hi @JCPStevens ,

  Ok, let's sort this out once for all.

  I did the following on a Ubuntu machine to get this to work:

  git clone --recursive git@github.com:TE-KarlKomierowski/hackster_projects.git

  After that I opened Arduino IDE and from the Sketch menu I took Include library->Add .ZIP library
  In the file browser I selected the folder in the git repo as follows:

  ~/hackster_projects/spresense-audio-scope/arduino-lib
  I selected TFT folder and clicked OK

  I then opened arduino-scope-ino in the Arduino IDE and pressed the button Verify to build the sketch.

  This failed. It turns out that the TFT library defines a macro that is named swap and this is later being used in other libraries which confuses the build system.

  The quickes way to get around this for me was to simply add the following on line 7 to the arduino-scope.ino sketch:

  #undef swap

  The undef part must be between the include <TFT> and include <Audio.h>

  #include <TFT.h> /* Include TFT.h first, then Audio.h to avoid __SD_H__ being defined in the Audio.h. */ #undef swap #include <Audio.h>

  After doing this I can build the sketch.
  I have been using a Ubuntu PC with Arduino IDE version 1.8.9.

  I have built for target Spresense.

  Hope that this will work for you too.
  If you run into problems, please past your errorlog into your post and I will try to help out.

• 

  Batteries / Consumption and Safety
  • CGM11  

  3
  0
  Votes
  3
  Posts
  1220
  Views

  

  Thanks for the link and advice @TE-KarlKomierowski . I just need to do a quick and dirty demo without burning the Spresense in the process. I won't use those batteries on real deployments because they can easily leak toxic fluids.

  BR.
  Carlos.

• 

  NNC
  • CGM11  

  4
  0
  Votes
  4
  Posts
  1397
  Views

  

  @CGM11 said in NNC:

  @TE-KarlKomierowski Sorry Karl, I didn't see your answer. But as I told you, it is good for other people to know it as well, the NNC works pretty fine in a MacBook Pro using Parallels.

  Regards and thank you.

  Hi @CGM11

  Ok, thank you for the information!

  Br
  /Karl

• J

  How to insall software correct for Spresense Audio-Scope
  • JCPStevens  

  3
  0
  Votes
  3
  Posts
  1065
  Views

  J

  Probably I get an error message when I try the git command because the ZIP download already exists. I thougt that the library file wasn't installed.
  But the next problem is that the example Sketch audio_scope already gives an error message by compiling it, and I don't have the knowledge to understand the code completely.
  Until now I thougt that the Sketch wouldn't work because the required library wasn't available.
  I have taken over the Sketch litterally from the Sony Spresense Sample Projects tutorials.
  What is here going wrong?

  Already thanks for the effort,
  greets Marc.

• 

  Writing directly to image Framebuffer - Spresense SDK
  • Cameron R MANN  

  5
  0
  Votes
  5
  Posts
  1495
  Views

  

  @TE-KarlKomierowski
  I enabled the DMA option as you suggested, but I did not notice any change to the severity of the flickering. I also checked ILI9340_SPI_MAXFREQUENCY and it was set to 40000000 just as your example.

  I agree regarding the NX graphics + framebuffer usage. No sense in re-inventing the wheel. Now that I have discovered a "hook" into the framebuffer, the NX documentation might make a little more sense. I will revisit and research a bit more.

  I will definitely keep this thread updated...I also think it is an important dev topic and worth digging into. Stay tuned!

• J

  DigitalRead()
  • JCPStevens  

  3
  0
  Votes
  3
  Posts
  1183
  Views

  K

  Hi @JCPStevens

  By default, when the mode is set to INPUT, the pin state is HIGH. If you want to change it to LOW, change the pin state to LOW.

  You can use my example below:

  int left=0; int right=0; void setup() { pinMode(4,INPUT); pinMode(6,INPUT); digitalWrite(4, LOW); digitalWrite(6, LOW); Serial.begin(115200); } void loop() { left=digitalRead(4); right=digitalRead(6); if (left==(HIGH)){ Serial.println("Left=High");} if (left==(LOW)){ Serial.println("Left=low");} if (right==(HIGH)){ Serial.println("Right=high");} if (right==(LOW)){ Serial.println("Right=low");} }
• 

  NuttX Camera Example Configuration Options Missing
  • Cameron R MANN  

  5
  0
  Votes
  5
  Posts
  1870
  Views

  

  Thanks Karl! I will give it a try....

• M

  RAW output format
  • Meezy  

  3
  0
  Votes
  3
  Posts
  989
  Views

  M

  Thank you I managed to get the RAW format

• B

  Recording at 192khz freezes
  • Ben eaton  

  6
  0
  Votes
  6
  Posts
  2072
  Views

  

  Hi @Ben-eaton

  In the last code the ErrEnd will be set true when you get an error, if you instead of executing goto exitSketch just stop and restart the recording things shouldn't freeze. I have not verified this to 100% but I got this information from a college.

  @Ben-eaton said in Recording at 192khz freezes:

  if (ErrEnd)
  {
  printf("Error End\n");
  theAudio->stopRecorder();
  goto exitSketch;
  }

  I know that this issue have been discussed via email and our ambition is to post a conclusion in this thread once we have a final answer for you and the rest of the forum readers.

• D

  Question about audio dsp on the spresense...
  • Derek  

  5
  0
  Votes
  5
  Posts
  867
  Views

  

  Hi Derek,

  You can get the sampled raw audio data.
  In the official SDK repo you can find a example called audio recorder. This recorder will record audio and store it into a file on the SD card.

  I have used this example to get the raw audio stream.

  The bytes in the stream are arranged in the same way as the wave file format.
  http://soundfile.sapp.org/doc/WaveFormat/

  If you look in the function app_write_output_file you will see how the fifo is being read.
  https://github.com/sonydevworld/spresense/blob/master/examples/audio_recorder/audio_recorder_main.cxx

  @Derek said in Question about audio dsp on the spresense...:

  I'm intrigued about the possibility of moving my Teensy 3.6 based quadrature dsp work to the Spresense. Currently I use I2S input to and from an external 16-bit codec as the real-time IO and process in length 128 blocks. I haven't yet purchased an Spresense, because it seems that the audio libraries are limited to recording and playback of speech/music. Is there a way to do block processing of a continuous raw data stream in the SDK? I can't seem to find any reference to line-in/out levels in the reference stuff...
  Thanks.

• 

  GPS - Compass - Heading
  • CGM11  

  5
  0
  Votes
  5
  Posts
  1148
  Views

  

  Hi @TE-KarlKomierowski Thx, I don't need a superb accuracy, I use it to know where the camera is looking to in order to tell other devices that a "subject of interest" be it a Jaguar or a Human is going in that direction once the subject runs out of the visual scope of one the camera (a multi camera tracking scenario)

  I integrated one already (I don't wan't to keep it, for power consumption and simplicity reasons) but I wanted to know if I have to design the case including that part or not. I will keep it for a while then.

  Have a great day. You guys Rock!

• 

  PIN settings to save energy
  • CGM11  

  3
  0
  Votes
  3
  Posts
  875
  Views

  

  Hi @TE-KarlKomierowski , I was talking about unused pins (I wasn't explicit about the unused word sorry, avoiding floating pins), setting unused pines as OUTPUT or INPUT helped a lot on other hardware I use. So, OUTPUT-HIGH, thx.

  Thanks also for the suggestion, that thing looks really cool and useful.

  Keep it up.

• V

  Multithreading using SPresence with Arduino SDK
  • Vraj Patel  

  2
  0
  Votes
  2
  Posts
  1068
  Views

  

  Hi @Vraj-Patel

  You could take a look at the Nuttx tasks info pages and see if you can manage to create something from that:

  http://www.nuttx.org/doku.php?id=wiki:nxinternal:nxtasking#nuttx_tasks

  This should be possible to use in the Arduino SDK

  @Vraj-Patel said in Multithreading using SPresence with Arduino SDK:

  I am trying to run a multi-threaded program on the SPresence microcontroller using the Arduino SDK however, I am not sure how to create threads using the SDK. Would anyone be able to do a simple demonstrate how to create & end threads, wait for a thread, and send information to a thread with some code?