It’s very counter intuitive. As the other commenter suggested I was referring to Gödel and his incompleteness theorem.

Actually if the system you made up doesn’t work it would be possible to prove that it does inside that system as you can prove anything inside a system that doesn’t work.

That is why my comment is not entirely accurate it should actually be: Until you prove that if the system works you can’t prove that the system works.

Can you spot the difference in the logic here?