Penzant.net

菅原朔 (ja)
Assistant Professor at National Institute of Informatics, Tokyo, Japan
Ph.D. in Computer Science (University of Tokyo, 2020)

Benchmarking Machine Reading Comprehension: A Psychological Perspective
Saku Sugawara, Pontus Stenetorp, Akiko Aizawa
In the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021).
[paper] [bib] [slide] to appear.

Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, Akiko Aizawa
In the 28th International Conference on Computational Linguistics (COLING 2020), Dec 2020, pp.6609-6625.
[paper] [bib]
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets
Saku Sugawara, Pontus Stenetorp, Kentaro Inui, Akiko Aizawa
In the 34th AAAI Conference on Artificial Intelligence (AAAI-20), Feb 2020, pp.8918-8927.
[paper] [bib] [poster] [spotlight] [data]

What Makes Reading Comprehension Questions Easier?
Saku Sugawara, Kentaro Inui, Satoshi Sekine, Akiko Aizawa
In the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), Nov 2018, pp.4208-4219.
[paper] [bib] [slide] [data]

Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability
Saku Sugawara, Yusuke Kido, Hikaru Yokono, Akiko Aizawa
In the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Aug 2017, pp.806-817.
[paper] [bib] [slide] [data]
Prerequisite Skills for Reading Comprehension: Multi-perspective Analysis of MCTest Datasets and Systems
Saku Sugawara, Hikaru Yokono, Akiko Aizawa
In the 31st AAAI Conference on Artificial Intelligence (AAAI-17), Feb 2017, pp.3089-3096.
[paper] [bib] [slide] [data]

Annotation and Analysis of Discourse Relations, Temporal Relations and Multi-Layered Situational Relations in Japanese Texts
Kimi Kaneko, Saku Sugawara, Koji Mineshima, Daisuke Bekki
In COLING 2016 Workshop on Asian Language Resources 12 (ALR12), Dec 2016, pp.10-19.
[paper] [bib] [web]
An Analysis of Prerequisite Skills for Reading Comprehension
Saku Sugawara, Akiko Aizawa
In EMNLP 2016 Workshop on Uphill Battles in Language Processing (UBLP), Nov 2016, pp.1-5.
[paper] [bib] [poster] [web] [data]
On Dialogue Breakdown: Annotation and Detection - dialogue breakdown detection challenge
Kotaro Funakoshi, Ryuichiro Higashinaka, Michimasa Inaba, Yuka Kobayashi, Saku Sugawara, Katsuya Takanashi, Hiroko Otsuka, Hanae Koiso, Mayumi Bono
In IVA 2016 Workshop on Chatbots and Conversational Agent Technologies (WOCHAT), Sep 2016.
[paper] [web]

Apr 2017 -- Mar 2020, Ph.D. in Computer Science
- Department of Computer Science, Graduate School of Information Science and Technology, University of Tokyo
- Ph.D. thesis: Evaluating Natural Language Understanding in Machine Reading Comprehension
  [paper] [slide]
Apr 2015 -- Mar 2017, M.Sc. in Computer Science
- Department of Computer Science, Graduate School of Information Science and Technology, University of Tokyo
- Master thesis: Prerequisite Skills of Natural Language Understanding for the Analysis and Development of Reading Comprehension
Apr 2013 -- Mar 2015, B.A. in Letters (Philosophy)
- Philosophy Course, Faculty of Letters, University of Tokyo
- Graduation thesis: Language Understanding Based on the Concept of Proper Function (On the biological/teleo- semantics by Ruth G. Millikan)
Apr 2011 -- Mar 2013
- Natural Sciences I, College of Arts and Sciences, University of Tokyo

Apr 2020 -- Present, Assistant Professor (non-PI; five years), National Institute of Informatics, Japan
Jun 2020 -- Present, Visiting Researcher, New York University, US
Apr 2020 -- Present, Visiting Researcher, RIKEN AIP, Japan
May 2017 -- Mar 2020, Research Assistant, RIKEN AIP, Japan
Nov 2018 -- Mar 2019, Visiting Student, University College London, UK
Jun 2018 -- Sep 2018, Research Intern, Microsoft Research Montreal (Maluuba), Canada
Apr 2016 -- Mar 2018, Part-time Engineer, Preferred Networks, Japan
May 2016 -- Apr 2017, Research Assistant, AIST AIRC, Japan
Jun 2015 -- Mar 2016, Part-time Researcher, Honda Research Institute, Japan

2021: NAACL (Language Resources and Evaluation), ACL-IJCNLP (Resource and Evaluation)

Mar 2020, Dean's Award, Graduate School of Information Science and Technology, University of Tokyo
Mar 2019, Excellent Student Award, National Institute of Informatics