Question

Is the result statistically significant? Explain your answer.What does a mean difference of zero between the two groups indicate?

Answer 1

The p-value is the probability of obtaining the difference we saw from a sample (or a larger one) if there really isn't a difference for all users

Answer 2

Statistically significant means a result is unlikely due to chance. The p-value is the probability of obtaining the difference we saw from a sample (or a larger one) if there really isn't a difference for all users