It is true that a test's statistical significance depends on power and probability.
A test can show real significance when it comes to statistical data only if it fulfills certain requirements. In this case, those requirements would entail the power of such a test, and the probability of the results it may yield eventually.