Questions 4 and 5

Module 6. Ensemble of models Wrap-up quiz
#1

Hi,
for both questions I answered that the balanced_accuracy was better as that’s what i got.
See the following pic

quiz6_snapshot
quiz6_snapshot971×843 91.9 KB

However, the expected answer was exactly the opposite. Repeating the evaluation several times one sees that this is a product of fluctuations, or simply looking to the std would already hint that the gain is not significant.

Anyway it could be good to advise, in the questionnaire to force a random_state so that the results are reproducible or rephrase these questions in terms of significance?

Thanks,
Pedro

#2

I think it would even be better than the question does not depend on the random fluctuation. We plan to have a reworking on a couple of question for which we observe similar behaviour.

Thanks for reporting.

1 Like
#3

This wrap-up has been completely reworked