Sorting points (by X and Y or natural)

I am going to try a sort with if x=x , sort by y and if y=y sort by x , but when the x or y values are not the same (sometimes its a couple of mm different) then it wont work I think…

Update:
Solved the problem with the above method guys. Thanx for the reaction. The only thing is that either the x’s or y’s have to be the same. For the projects im doing thats oke.