simultaneous-image-video-and-sound-presentation

Comments

• Carsten

  March 2018 edited March 2018

  Hi there...

  I found out the last days how to fix this issure:

  First I had to do was to install OpenCV. You can get it from here:

  https://opencv.org/opencv-3-4-1.html

  I used the Windows self-extracting archive. How it is installed is described here:

  http://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_setup/py_setup_in_windows/py_setup_in_windows.html

  Some remarks about the installation:

  Please don't install a separate Python27. Copy the "cv2.pyd" to the openseame Python Path, in my case:

  d:\Schliewe\openseame\OpenSesame\Lib\site-packages\

  You find the "cv2.pyd" when you had extracted the archive you got from the first link

  You can find "Idle" in my installation here:

  d:\Schliewe\openseame\OpenSesame\Scripts\

  Then choose in Openseame under "New experiment"as Backend "legacy".

  Insert a new "Inline_script" and paste the following code in the Run-Section:

      import cv2
      import numpy
      import pygame
      # Video filename in file pool
      path_video = pool['VO1LHi12.mp4']
      # Eyetracking Marker oben links
      path_Marker_OL=pool['R1S1.png']``
      # Open the video
      video = cv2.VideoCapture(path_video)
      # Set returnvalue to True to get into the while loop
      retval=True
      # Set background to white
      white = [255, 255, 255]
      exp.surface.fill(white)
      # Do the while loop until the video is played
      while retval:
          # Get a frame
          retval, frame = video.read()
          ### if no frame is availble exit while loop,
          ### video is played
          if retval != True:
              break
          ###
          # rezize the video
          frame = cv2.resize(frame, (1280, 800)) 
          # Rotate it, because for some reason it otherwise appears flipped.
          frame = numpy.rot90(frame)
          # The video uses BGR colors and PyGame needs RGB
          frame = cv2.cvtColor(frame, cv2.COLOR_BGR2RGB)
          # Create a PyGame surface
          video_surface = pygame.surfarray.make_surface(frame)
          # video is mirrored (x-axis) correcting this..
          video_surface = pygame.transform.flip(video_surface, True, False)
          # load the image with the Marker oben links
          image = pygame.image.load(path_Marker_OL)
          image_surface = image.copy()
          image_surface = pygame.transform.scale(image_surface , (150, 150))
          # calculations: x_pos=(BS_x_Exp - Videosize_x) / 2=(1680-1280) / 2 = 200
          #                       y_pos=(BS_y_Exp - Videosize_y) / 2=(1050-800) / 2 = 125
          surf1=exp.surface.blit(video_surface, (200, 125))
          surf1=exp.surface.blit(image_surface, (0, 0))
          pygame.display.flip()
  

  Be sure that the video and the image are in the filepool.

  Thats it...

  Best,
  Carsten