Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation

Name: Work Video:
Duration: 3 min 30 s
Description: Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop. 2021.
Kazutoshi Shinoda; Saku Sugawara; Akiko Aizawa
{'id': 'https://openalex.org/W3185818152', 'doi': 'https://doi.org/10.18653/v1/2021.acl-srw.21', 'title': 'Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation', 'display_name': 'Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3185818152', 'doi': 'https://doi.org/10.18653/v1/2021.acl-srw.21', 'mag': '3185818152'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-srw.21', 'pdf_url': 'https://aclanthology.org/2021.acl-srw.21.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.acl-srw.21.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5078963513', 'display_name': 'Kazutoshi Shinoda', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I74801974', 'display_name': 'The University of Tokyo', 'ror': 'https://ror.org/057zh3y96', 'country_code': 'JP', 'type': 'education', 'lineage': ['https://openalex.org/I74801974']}, {'id': 'https://openalex.org/I184597095', 'display_name': 'National Institute of Informatics', 'ror': 'https://ror.org/04ksd4g47', 'country_code': 'JP', 'type': 'facility', 'lineage': ['https://openalex.org/I1319490839', 'https://openalex.org/I184597095', 'https://openalex.org/I4210158934']}], 'countries': ['JP'], 'is_corresponding': False, 'raw_author_name': 'Kazutoshi Shinoda', 'raw_affiliation_strings': ['National Institute of Informatics', 'The University of Tokyo'], 'affiliations': [{'raw_affiliation_string': 'The University of Tokyo', 'institution_ids': ['https://openalex.org/I74801974']}, {'raw_affiliation_string': 'National Institute of Informatics', 'institution_ids': ['https://openalex.org/I184597095']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5038103607', 'display_name': 'Saku Sugawara', 'orcid': 'https://orcid.org/0000-0002-0061-0680'}, 'institutions': [{'id': 'https://openalex.org/I184597095', 'display_name': 'National Institute of Informatics', 'ror': 'https://ror.org/04ksd4g47', 'country_code': 'JP', 'type': 'facility', 'lineage': ['https://openalex.org/I1319490839', 'https://openalex.org/I184597095', 'https://openalex.org/I4210158934']}], 'countries': ['JP'], 'is_corresponding': False, 'raw_author_name': 'Saku Sugawara', 'raw_affiliation_strings': ['National Institute of Informatics'], 'affiliations': [{'raw_affiliation_string': 'National Institute of Informatics', 'institution_ids': ['https://openalex.org/I184597095']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5041062417', 'display_name': 'Akiko Aizawa', 'orcid': 'https://orcid.org/0000-0001-6544-5076'}, 'institutions': [{'id': 'https://openalex.org/I74801974', 'display_name': 'The University of Tokyo', 'ror': 'https://ror.org/057zh3y96', 'country_code': 'JP', 'type': 'education', 'lineage': ['https://openalex.org/I74801974']}, {'id': 'https://openalex.org/I184597095', 'display_name': 'National Institute of Informatics', 'ror': 'https://ror.org/04ksd4g47', 'country_code': 'JP', 'type': 'facility', 'lineage': ['https://openalex.org/I1319490839', 'https://openalex.org/I184597095', 'https://openalex.org/I4210158934']}], 'countries': ['JP'], 'is_corresponding': False, 'raw_author_name': 'Akiko Aizawa', 'raw_affiliation_strings': ['National Institute of Informatics', 'The University of Tokyo'], 'affiliations': [{'raw_affiliation_string': 'The University of Tokyo', 'institution_ids': ['https://openalex.org/I74801974']}, {'raw_affiliation_string': 'National Institute of Informatics', 'institution_ids': ['https://openalex.org/I184597095']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 2, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 0.814, 'has_fulltext': False, 'cited_by_count': 8, 'citation_normalized_percentile': {'value': 0.756396, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 84, 'max': 86}, 'biblio': {'volume': None, 'issue': None, 'first_page': '197', 'last_page': '214'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9725, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/robustness', 'display_name': 'Robustness', 'score': 0.7575373}, {'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.50131154}], 'concepts': [{'id': 'https://openalex.org/C63479239', 'wikidata': 'https://www.wikidata.org/wiki/Q7353546', 'display_name': 'Robustness (evolution)', 'level': 3, 'score': 0.7575373}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.628247}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.50131154}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.3988047}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.3797121}, {'id': 'https://openalex.org/C185592680', 'wikidata': 'https://www.wikidata.org/wiki/Q2329', 'display_name': 'Chemistry', 'level': 0, 'score': 0.09262931}, {'id': 'https://openalex.org/C55493867', 'wikidata': 'https://www.wikidata.org/wiki/Q7094', 'display_name': 'Biochemistry', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C104317684', 'wikidata': 'https://www.wikidata.org/wiki/Q7187', 'display_name': 'Gene', 'level': 2, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-srw.21', 'pdf_url': 'https://aclanthology.org/2021.acl-srw.21.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2004.03238', 'pdf_url': 'https://arxiv.org/pdf/2004.03238', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-srw.21', 'pdf_url': 'https://aclanthology.org/2021.acl-srw.21.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'score': 0.85, 'id': 'https://metadata.un.org/sdg/4', 'display_name': 'Quality education'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 97, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1531374185', 'https://openalex.org/W1533861849', 'https://openalex.org/W1638000437', 'https://openalex.org/W1832693441', 'https://openalex.org/W1940872118', 'https://openalex.org/W1959608418', 'https://openalex.org/W19665345', 'https://openalex.org/W2095705004', 'https://openalex.org/W2108287887', 'https://openalex.org/W2130942839', 'https://openalex.org/W2133564696', 'https://openalex.org/W2250425483', 'https://openalex.org/W2250539671', 'https://openalex.org/W2507756961', 'https://openalex.org/W2516930406', 'https://openalex.org/W2557436004', 'https://openalex.org/W2557764419', 'https://openalex.org/W2586756136', 'https://openalex.org/W2606333299', 'https://openalex.org/W2610891036', 'https://openalex.org/W2622563070', 'https://openalex.org/W2753738274', 'https://openalex.org/W2796704765', 'https://openalex.org/W2804292122', 'https://openalex.org/W2807750936', 'https://openalex.org/W2889453388', 'https://openalex.org/W2889670144', 'https://openalex.org/W2889924956', 'https://openalex.org/W2890166583', 'https://openalex.org/W2890969459', 'https://openalex.org/W2891946694', 'https://openalex.org/W2892153332', 'https://openalex.org/W2896457183', 'https://openalex.org/W2898695436', 'https://openalex.org/W2904146647', 'https://openalex.org/W2911681509', 'https://openalex.org/W2911857455', 'https://openalex.org/W2912924812', 'https://openalex.org/W2913222130', 'https://openalex.org/W2945260553', 'https://openalex.org/W2949849869', 'https://openalex.org/W2950733407', 'https://openalex.org/W2951873305', 'https://openalex.org/W2951883832', 'https://openalex.org/W2953039212', 'https://openalex.org/W2962717047', 'https://openalex.org/W2962717182', 'https://openalex.org/W2962944953', 'https://openalex.org/W2962970841', 'https://openalex.org/W2962977247', 'https://openalex.org/W2963080779', 'https://openalex.org/W2963175042', 'https://openalex.org/W2963206148', 'https://openalex.org/W2963223306', 'https://openalex.org/W2963339397', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963456134', 'https://openalex.org/W2963542836', 'https://openalex.org/W2963600562', 'https://openalex.org/W2963650605', 'https://openalex.org/W2963713328', 'https://openalex.org/W2963746531', 'https://openalex.org/W2963748441', 'https://openalex.org/W2963790827', 'https://openalex.org/W2963938442', 'https://openalex.org/W2963958388', 'https://openalex.org/W2963969878', 'https://openalex.org/W2964121744', 'https://openalex.org/W2964165364', 'https://openalex.org/W2964308564', 'https://openalex.org/W2970168687', 'https://openalex.org/W2970250435', 'https://openalex.org/W2970442950', 'https://openalex.org/W2970460314', 'https://openalex.org/W2970647290', 'https://openalex.org/W2970745243', 'https://openalex.org/W2970796366', 'https://openalex.org/W2971274815', 'https://openalex.org/W2979826702', 'https://openalex.org/W2983655111', 'https://openalex.org/W2988115511', 'https://openalex.org/W3015721781', 'https://openalex.org/W3016970897', 'https://openalex.org/W3022187094', 'https://openalex.org/W3032717904', 'https://openalex.org/W3034469191', 'https://openalex.org/W3035500185', 'https://openalex.org/W3035621030', 'https://openalex.org/W3098824823', 'https://openalex.org/W3101798106', 'https://openalex.org/W3103621845', 'https://openalex.org/W3103934428', 'https://openalex.org/W3153592532', 'https://openalex.org/W4212774754', 'https://openalex.org/W4297671192', 'https://openalex.org/W803028973'], 'related_works': ['https://openalex.org/W4402327032', 'https://openalex.org/W4396701345', 'https://openalex.org/W4396696052', 'https://openalex.org/W4391375266', 'https://openalex.org/W3204019825', 'https://openalex.org/W2748952813', 'https://openalex.org/W2390279801', 'https://openalex.org/W2376932109', 'https://openalex.org/W2358668433', 'https://openalex.org/W2001405890'], 'abstract_inverted_index': {'Kazutoshi': [0], 'Shinoda,': [1], 'Saku': [2], 'Sugawara,': [3], 'Akiko': [4], 'Aizawa.': [5], 'Proceedings': [6], 'of': [7, 12], 'the': [8, 13, 19], '59th': [9], 'Annual': [10], 'Meeting': [11], 'Association': [14], 'for': [15], 'Computational': [16], 'Linguistics': [17], 'and': [18], '11th': [20], 'International': [21], 'Joint': [22], 'Conference': [23], 'on': [24], 'Natural': [25], 'Language': [26], 'Processing:': [27], 'Student': [28], 'Research': [29], 'Workshop.': [30], '2021.': [31]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3185818152', 'counts_by_year': [{'year': 2023, 'cited_by_count': 4}, {'year': 2022, 'cited_by_count': 3}, {'year': 2021, 'cited_by_count': 1}], 'updated_date': '2024-12-13T03:12:07.052825', 'created_date': '2021-08-02'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
