Bad audio quality

Comments

• sebastiaan

  December 2016

  Hi Sophia,

  You're probably hearing a kind of crackling noise, right? That happens when the buffer is too small. If you increase the sound buffer size (under back-end settings), the problem should go away.

  As it is the default, I think PyGame is used for the sampler although I don't know where it is specified. Is there any chance that audio quality improves under PyAudio? Or anything else I can do about it?

  Yes, PyGaze is used by the sampler. PyAudio should be fine as well, but I don't think it's necessary: I would first check if increasing the buffer size resolves the issue.

  Cheers,
  Sebastiaan

  
  
  Check out SigmundAI.eu for our OpenSesame AI assistant!
  
• linguist_noob

  December 2016

  Hi Sebastiaan,

  Thank you very much for your answer!
  Yeah, I think you could describe it as a crackling noise. It sounds like a kind of vibration at the end of almost every sound file/word. I already tried increasing the buffer size, but it didn't help. Just to test it I now set the buffer at 20000. Still nothing changed. (The values for sampling frequency etc. correspond to the audio files.)
• linguist_noob

  December 2016

  The problem got even worse now: About 3/4 through the experiment, the audio quality started to deteriorate progressively until in the end it wasn't even perceivable anymore that my audio stimuli were human speech. They sounded like really bad radio crackling and were shorter in duration than the original audio files.

  I use a MacBook Pro (from 2015 with Mac OS 10.11.6) and connect a condenser-microphone-headset via iTrack Solo (an audio interface with USB connection). The problem only occurred when I ran OpenSesame with this specific hardware, i.e. everything is fine when
  1) running OpenSesame, using the Mac's internal loudspeakers (beside the less-than-optimal sound quality described in the original post)
  2) playing the exact same audio files (for hours) over the headset and iTrack Solo without OpenSesame.

  Disconnecting the USB device when sound quality started to get ugly and then reconneting it again right after also helped. But that's not something I would want to do during the actual experiment...

  So is there anything I can do about it?
  I was considering again to try PyAudio. I installed it but I don't know where in the code to specify that it should be used in this experiment.
  Also, how and where in the script can I tell OpenSesame to use another audio player?

  Any advice is greatly appreciated! I really hope that I can test the first subjects the next two days...
• sebastiaan

  December 2016

  That sounds like one of these device-specific problems. Annoying, and difficult to pin down and solve.

  I was considering again to try PyAudio. I installed it but I don't know where in the code to specify that it should be used in this experiment. Also, how and where in the script can I tell OpenSesame to use another audio player?

  The sampler cannot use PyAudio. You have to write a script to do so. But that's not very difficult, and you can almost copy-paste the examples from the PyAudio docs.

  Below you see how to play back a wave file. The script assumes that the wave file is in the file pool, and that its name is specified by the variable my_sound.

  Let's see whether this resolves the distorted sound—difficult to predict.

  """PyAudio Example: Play a WAVE file."""
  
  import pyaudio
  import wave
  import sys
  
  CHUNK = 1024
  # We assume that the sound file is specified by the variable my_sound
  path = pool[var.my_sound]
  
  wf = wave.open(path, 'rb')
  
  p = pyaudio.PyAudio()
  
  stream = p.open(format=p.get_format_from_width(wf.getsampwidth()),
                  channels=wf.getnchannels(),
                  rate=wf.getframerate(),
                  output=True)
  
  data = wf.readframes(CHUNK)
  
  while data != '':
      stream.write(data)
      data = wf.readframes(CHUNK)
  
  stream.stop_stream()
  stream.close()
  
  p.terminate()
  

  
  
  Check out SigmundAI.eu for our OpenSesame AI assistant!
  
• linguist_noob

  December 2016

  Hi Sebastiaan,
  First of all, thank you very much for your really quick answer! That's very kind of you!
  I've been trying to execute the piece of code you gave me (just this piece, not integrated in my experiment) for many hours now but cannot get it running.

  Where and how do I specify the variable that [var.my_sound] refers to?
• linguist_noob

  December 2016

  And one more question:
  Where would I integrate the script into my experiment? Can I just exchange the sampler item for the inline script (and change the item in the experiment sequence)?

  Here are the parts of the experiment that I guess are most important:

  define sequence experiment
      set flush_keyboard no
      set description "Runs a number of items in sequence"
      run welcome always
      run digit_recall_loop always
      run instructions1 always
      run instructions2 always
      run practice_loop always
      run end_of_practice always
      run block1 always
      run end_of_block1 always
      run block2 always
      run goodbye always
  
  define sequence trial_sequence
      set flush_keyboard yes
      set description "Runs a number of items in sequence"
      run blank_screen always
      run audio_stimulus_loop always
      run fixation_dot always
      run blank_screen always
      run clicks_slow always
      run fixation_dot always
      run blank_screen always
      run clicks144 always
      run mouse_response always
      run logger always
  
  define loop audio_stimulus_loop
      set source_file ""
      set source table
      set repeat 2
      set order sequential
      set description "Repeatedly runs another item"
      set cycles 1
      set continuous no
      set break_if_on_first yes
      set break_if never
      setcycle 0 empty_column ""
      run audio_stimulus
  
• sebastiaan

  December 2016

  I've been trying to execute the piece of code you gave me (just this piece, not integrated in my experiment) for many hours now but cannot get it running.

  The code refers to the OpenSesame variable store (var), so it will never work as a standalone script. The examples on the PyAudio site are standalone.

  Where and how do I specify the variable that [var.my_sound] refers to?

  You presumably specified the name of the sound file in a loop, right? This script simply assumes that you used the variable name my_sound. var.my_sound is the Python way of referring to this variable, just as [my_sound] is the OpenSesame way. So var. is not part of the variable name. See also:

  • http://osdoc.cogsci.nl/3.1/manual/variables/#using-variables-in-python

  Where would I integrate the script into my experiment? Can I just exchange the sampler item for the inline script (and change the item in the experiment sequence)?

  Exactly. You would replace the sampler by an inline_script with this code in the run phase.

  
  
  Check out SigmundAI.eu for our OpenSesame AI assistant!
  
• linguist_noob

  December 2016

  Hi Sebastiaan,

  Thank you very much for your helpful explanations! Sorry for asking all these basic questions; I'm totally new to scripting and the mixture of OpenSesame script and Python script can be quite confusing for beginners.

  You presumably specified the name of the sound file in a loop, right?

  Yes, I did. I now integrated the script into my experiment and the variable was interpreted correctly. The experiment still crashed because the first sound file wasn't found in the file pool but at least its name was correct in the error message. (So that's a point I can continue working from.)

  The exception message was 
  exception message: [Errno 2] No such file or directory: u'be_go'
  'be_go' is the name of the first audio file to be played. Do you know what the letter u means?
• sebastiaan

  December 2016

  'be_go' is the name of the first audio file to be played.

  It's probably not though—I imagine there's an extension that indicates the file format. And this extension is part of the name. So it would be be_go.wav. (This snippet assumes that it's a wave file.) So you can either add extensions to the names in your loop table, or append it in the script like so:

  path = pool[var.my_sound + u'.wav']
  

  Do you know what the letter u means?

  It's a technicality: The u prefix means it's a unicode string, which is a special string type that is good for working with non-ascii characters.

  • https://www.cogsci.nl/blog/a-simple-explanation-of-character-encoding-in-python

  
  
  Check out SigmundAI.eu for our OpenSesame AI assistant!
  
• linguist_noob

  December 2016 edited December 2016

  Thank you so much!!! It works now and my first impression is that the audio quality is better than in the sampler. A longer test will show if the problem of the gradual deterioration of the sound quality is also solved.

  It's probably not though—I imagine there's an extension that indicates the file format. And this extension is part of the name.

  Ah, ok, I see the error in my reasoning here. I assumed that the file extension was taken for granted because it was specified in the code that the file to be opened is a wave file: wf = wave.open(path, 'rb')

  And thanks for your blog and manual links! I had searched the web for information on variables in python but forgotten the most obvious source...