I ran into the same problem. As workaround I had to kill the ptp4l and phc2sys processes (similar to what’s on a previous comment):
sudo killall ptp4l
sudo killall phc2sys
sudo service ntp stop
sudo timedatectl set-ntp false
sudo ntpdate pool.ntp.org