SVP + MPV + Wayland

I was wondering if anyone else has had luck configuring SVP with MPV on wayland (AMD). I followed the archwiki https://wiki.archlinux.org/title/Mpv

This is ~/.config/mpv/mpv.conf

autofit-larger=100%x100%
hwdec=auto-copy
profile=svp
vf=format=fmt=yuv420p

[svp]
input-ipc-server=/tmp/mpvsocket     # Receives input from SVP
hr-seek-framedrop=no                # Fixes audio desync
watch-later-options-remove=vf       # Do not remember SVP's video filters
no-resume-playback

When SVP takes control of the video it pauses and never gets playing again

mpv stdout shows (pause) for a single sec, then proceeds normally, but the video stays frozen

[autoconvert] Converting nv12 -> yuv420p
AO: [pipewire] 48000Hz stereo 2ch floatp
VO: [gpu] 3840x2160 yuv420p

SVP has no option to control the video at all; it just says "playing whatever at 60fps"