XYZ calibration fails at random points  

XYZ calibration fails at random points

So this morning I was trying to improve my z-height for better first layer. I had some issues with it not beeing constant, so I searched the forums where I saw the post about the pinda and heat issues, then I saw 3.2.0 came with a fix, so I decided to try it.

Trying to calibrate xyz, it failed at second point. I tried again and failed at first. Tried again and failed at third. Repeated multiple times, where it failed at a random point every time.

I then tried to downgrade to 3.1.3.
When i try to do the xyz calibration, it finishes the first round, but when "improving" it fails.

I've tried factory reset, updating and downgrading.
I've also checked the pinda, and it seems to work fine according to theese numbers
1st
Measured points:
0.08 -0.18 -0.39 -0.53 -0.61 -0.62 -0.57
0.85 0.05 -0.52 -0.89 -1.04 -0.98 -0.70
1.31 0.26 -0.50 -0.99 -1.20 -1.13 -0.78
1.46 0.45 -0.30 -0.81 -1.07 -1.08 -0.83
1.30 0.60 0.04 -0.38 -0.67 -0.82 -0.84
0.84 0.73 0.56 0.32 0.01 -0.37 -0.82
0.06 0.84 1.25 1.29 0.97 0.28 -0.76
2nd
Measured points:
0.08 -0.18 -0.39 -0.53 -0.60 -0.62 -0.57
0.85 0.05 -0.52 -0.89 -1.04 -0.97 -0.70
1.31 0.26 -0.49 -0.98 -1.19 -1.13 -0.78
1.46 0.45 -0.30 -0.81 -1.07 -1.08 -0.84
1.30 0.60 0.04 -0.38 -0.67 -0.83 -0.85
0.84 0.73 0.56 0.31 0.00 -0.37 -0.83
0.07 0.83 1.23 1.28 0.95 0.27 -0.77
3rd
Measured points:
0.09 -0.16 -0.37 -0.51 -0.59 -0.60 -0.55
0.86 0.07 -0.50 -0.87 -1.02 -0.96 -0.68
1.32 0.28 -0.48 -0.97 -1.18 -1.11 -0.77
1.47 0.46 -0.29 -0.80 -1.06 -1.07 -0.82
1.32 0.62 0.05 -0.37 -0.66 -0.82 -0.84
0.86 0.75 0.57 0.32 0.00 -0.37 -0.81
0.09 0.85 1.24 1.28 0.96 0.28 -0.75

Also, the led on the pinda turns off when it hovers over the points, so it clearly see them.

It worked fine just before the weekend, when i was running on 3.1.3.
It's not crashing in the heatbed, and there appear to be no physical damage anywhere.

Anyone got any clues or tips on what I should try to fix it?