Print Email Facebook Twitter LearningQ: A Large-scale Dataset for Educational Question Generation Title LearningQ: A Large-scale Dataset for Educational Question Generation Author Chen, G. (TU Delft Web Information Systems) Yang, J. (University of Fribourg) Hauff, C. (TU Delft Web Information Systems) Houben, G.J.P.M. (TU Delft Web Information Systems) Date 2018 Abstract We present LearningQ, a challenging educational question generation dataset containing over 230K document-question pairs. It includes 7K instructor-designed questions assessing knowledge concepts being taught and 223K learner-generated questions seeking in-depth understanding of the taught concepts. We show that, compared to existing datasets that can be used to generate educational questions, LearningQ (i) covers a wide range of educational topics and (ii) contains long and cognitively demanding documents for which question generation requires reasoning over the relationships between sentences and paragraphs. As a result, a significant percentage of LearningQ questions (~30%) require higher-order cognitive skills to solve (such as applying, analyzing), in contrast to existing question-generation datasets that are designed mostly for the lowest cognitive skill level (i.e. remembering). To understand the effectiveness of existing question generation methods in producing educational questions, we evaluate both rule-based and deep neural network based methods on LearningQ. Extensive experiments show that state-of-the-art methods which perform well on existing datasets cannot generate useful educational questions. This implies that LearningQ is a challenging test bed for the generation of high-quality educational questions and worth further investigation. We open-source the dataset and our codes at https://dataverse.mpi-sws.org/dataverse/icwsm18. Subject Automatic Question GenerationDeep Neural NetworkHuman LearningBloom's Revised Taxonomy To reference this document use: http://resolver.tudelft.nl/uuid:ebc550c6-9ac5-4df6-bf08-65591d320e6d Publisher Association for the Advancement of Artificial Intelligence (AAAI) Source Proceedings of the Twelfth International AAAI Conference on Web and Social Media Event Twelfth International AAAI Conference on Web and Social Media, 2018-06-25 → 2018-06-28, Stanford University, Palo Alto, United States Part of collection Institutional Repository Document type conference paper Rights © 2018 G. Chen, J. Yang, C. Hauff, G.J.P.M. Houben Files PDF 17857_77947_1_PB.pdf 593.39 KB Close viewer /islandora/object/uuid:ebc550c6-9ac5-4df6-bf08-65591d320e6d/datastream/OBJ/view