How do we combine the best of humans and machines in Stall Catchers - the game crowdsourcing Alzheimer's disease? It took lots of exploration of the existing machine learning algorithms, calibration of crowd wisdom algorithms, and combination of the two in the best possible