prensting a video + image + text

AngeloPisanii

Hi all, 

I created an experiment using UI and back-end: xpyriment [uses Expyriment]. 

I would like to show a video as the background and above an image in the middle of the screen and a sentence at the top of the screen. There are several versions of video, image and sentence to pseudorandomize. In total there are 1512 stimuli. Creating them manually is very difficult. I tried several possibilities, such as corutines and an inline script. But I didn't succeed. I don't know if with OpenCV you can do this (prensting a video + image + text). Having used UI and back-end: xpyriment [use Expyriment] I am not sure where to write to call OpensCV and the video. In my sequence or maybe in the script section of the sketchpad?

Thanks a lot!

eduard

Hi @AngeloPisanii,

Looks like this is possible with OpenCV:

https://stackoverflow.com/questions/75267154/how-do-i-add-an-image-overlay-to-my-live-video-using-cv2

So, load your image, video and text (potentially as image), and then draw them in the correct order (first video, then image than text).

The code should be presented within an inline_script of a trial I suppose.

Hope this helps,

Eduard

AngeloPisanii

Hello everyone and thank you very much Eduard.

I finally decided to use a script on psychopy to automate the creation of my stimuli. 

I attach the script that automatically takes all the images in my folder and overlays them with the rest of the stimulus (bars moving and text).

Psychopy saves me as many videos as my images. I will use the videos as stimuli on opensesame. 

video+image-text.txt

Hope it's helpful to someone

Angelo

AngeloPisanii

Hi Eduard, now the problem is how to present each video randomly. 

Can I do this by simply adding the meida player and call the list of videos from the loop?

Thanks a lot,

Angelo

AngeloPisanii

Solved. I just needed to add the video format in the loop column (e.g., “.mp4”)

AngeloPisanii

HI @eduard, I was able to create and present my videos in random order. Now the problem is that when I press a button the video freezes. I would like to present the video and when the participant responds show me whether the response is correct or not and present the next video. 

I was able to do this using pictures as a stimulus. But with videos it doesn't seem to work. Basically, when I press the button the first time the video stops, while when I press the button the second time I get feedback on the response. I have done several tests, such as setting the duration of my media player to “0,” which worked with pictures but not with video as a stimulus.

Would you know how to solve this problem? 

AngeloPisanii

Hi @eduard , I just wanted to tell you that I have tried many possible solutions, even turning everything into an inline script (to create the “correct”, “incorrect” sketchpad, handle the keyboard and return the percentage of correctness of the response) and placing it on top of the video_mediaplayer. Unfortunately, I can't find a solution without having to mash the same key twice. I have also tried writing directly into the video_mediaplayer specifying the allowed response keys and what to do if the keys are correct. 

In the end it is not a big problem.... I will update if I can find even a partial solution.

Thanks!

Angelo

eduard

Hi Angelo,

Have you tried to not call a custom Python script?