If we want to ensure that a statistical test picks up a significant effect, what will we want to increase - confidence or power of test?
Before proceeding to find the answer of above question, we should know about Null Hypothesis, Alternate Hypothesis, confidence and power of test.
Null Hypothesis: This Hypothesis indicates that there is no significant effect.
Alternate Hypothesis: This Hypothesis indicates that there is a significant effect.
Confidence: It is the probability that the test accepts Null Hypothesis when Null Hypothesis is True.
Power: It is the probability that the test rejects the Null Hypothesis when Alternate Hypothesis is True.
The statistical Power ranges from 0 to 1 and as statistical power increases, the probability of making type 2 error decreases. For a type 2 error probability of β, the corresponding statistical power is 1-β. Means we are accepting the Alternate Hypothesis Test when it is true. Type 2 error is not rejecting the Null Hypothesis when in afcr the Alternate Hypothesis is true. SO by decreasing type 2 error, we are decreasing the probability of Null Hypothesis.
Alpha, the Type 1 error that you are willing to accept. Its value is set from 0.1 to 0.5. An alpha of 0.5 means that you are willing to accept that there is a 5% chance that your results are due to chance not by test.Type 1 error is rejecting the Null Hypothesis when it is in fact true. Confidence level is 1- α. If we want to increase confidence level, then there is need to decrease value of α which indicates that we are accepting Null Hypothesis when Null is True, means that a statistical test is not picking of any significant effect when confidence is increasing.
So, from above explanation we can say that, if we want to ensure that a statistical test picks up a significant effect, then we will want to increase power of test.