Evaluating Models’ Local Decision Boundaries via Contrast Sets

Name: Work Video:
Duration: 3 min 30 s
Matt Gardner; Yoav Artzi; Victoria Basmov; Jonathan Berant; Ben Bogin; Sihao Chen; Pradeep Dasigi; Dheeru Dua; Yanai Elazar; Ananth Gottumukkala; Nitish Gupta; Hannaneh Hajishirzi; Gabriel Ilharco; Daniel Khashabi; Kevin Lin; Jiangming Liu; Nelson F. Liu; Phoebe Mulcaire; Ning Qiang; Sameer Singh; Noah A. Smith; Sanjay Subramanian; Reut Tsarfaty; Eric Wallace; Ally Zhang; Ben Zhou
{'id': 'https://openalex.org/W3105928338', 'doi': 'https://doi.org/10.18653/v1/2020.findings-emnlp.117', 'title': 'Evaluating Models’ Local Decision Boundaries via Contrast Sets', 'display_name': 'Evaluating Models’ Local Decision Boundaries via Contrast Sets', 'publication_year': 2020, 'publication_date': '2020-01-01', 'ids': {'openalex': 'https://openalex.org/W3105928338', 'doi': 'https://doi.org/10.18653/v1/2020.findings-emnlp.117', 'mag': '3105928338'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.findings-emnlp.117', 'pdf_url': 'https://www.aclweb.org/anthology/2020.findings-emnlp.117.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://www.aclweb.org/anthology/2020.findings-emnlp.117.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5035088083', 'display_name': 'Matt Gardner', 'orcid': 'https://orcid.org/0000-0001-8458-1727'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': True, 'raw_author_name': 'Matt Gardner', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5047026141', 'display_name': 'Yoav Artzi', 'orcid': 'https://orcid.org/0000-0002-4605-6144'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Yoav Artzi', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5015245341', 'display_name': 'Victoria Basmov', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Victoria Basmov', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5045872048', 'display_name': 'Jonathan Berant', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Jonathan Berant', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5051169643', 'display_name': 'Ben Bogin', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Ben Bogin', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101823158', 'display_name': 'Sihao Chen', 'orcid': 'https://orcid.org/0000-0001-8416-4261'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Sihao Chen', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5029074038', 'display_name': 'Pradeep Dasigi', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210137750', 'display_name': 'UC Irvine Health', 'ror': 'https://ror.org/03fgher32', 'country_code': 'US', 'type': 'healthcare', 'lineage': ['https://openalex.org/I4210137750']}, {'id': 'https://openalex.org/I95457486', 'display_name': 'University of California, Berkeley', 'ror': 'https://ror.org/01an7q238', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I95457486']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Pradeep Dasigi', 'raw_affiliation_strings': ['UC Irvine + UC Berkeley'], 'affiliations': [{'raw_affiliation_string': 'UC Irvine + UC Berkeley', 'institution_ids': ['https://openalex.org/I4210137750', 'https://openalex.org/I95457486']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5076846819', 'display_name': 'Dheeru Dua', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210137750', 'display_name': 'UC Irvine Health', 'ror': 'https://ror.org/03fgher32', 'country_code': 'US', 'type': 'healthcare', 'lineage': ['https://openalex.org/I4210137750']}, {'id': 'https://openalex.org/I95457486', 'display_name': 'University of California, Berkeley', 'ror': 'https://ror.org/01an7q238', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I95457486']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Dheeru Dua', 'raw_affiliation_strings': ['UC Irvine + UC Berkeley'], 'affiliations': [{'raw_affiliation_string': 'UC Irvine + UC Berkeley', 'institution_ids': ['https://openalex.org/I4210137750', 'https://openalex.org/I95457486']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5081462507', 'display_name': 'Yanai Elazar', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Yanai Elazar', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5044422816', 'display_name': 'Ananth Gottumukkala', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210137750', 'display_name': 'UC Irvine Health', 'ror': 'https://ror.org/03fgher32', 'country_code': 'US', 'type': 'healthcare', 'lineage': ['https://openalex.org/I4210137750']}, {'id': 'https://openalex.org/I95457486', 'display_name': 'University of California, Berkeley', 'ror': 'https://ror.org/01an7q238', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I95457486']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Ananth Gottumukkala', 'raw_affiliation_strings': ['UC Irvine + UC Berkeley'], 'affiliations': [{'raw_affiliation_string': 'UC Irvine + UC Berkeley', 'institution_ids': ['https://openalex.org/I4210137750', 'https://openalex.org/I95457486']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5102347449', 'display_name': 'Nitish Gupta', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Nitish Gupta', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5082305994', 'display_name': 'Hannaneh Hajishirzi', 'orcid': 'https://orcid.org/0000-0002-1055-6657'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Hannaneh Hajishirzi', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5068360032', 'display_name': 'Gabriel Ilharco', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Gabriel Ilharco', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5043628255', 'display_name': 'Daniel Khashabi', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Daniel Khashabi', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5074764224', 'display_name': 'Kevin Lin', 'orcid': 'https://orcid.org/0000-0002-1236-9847'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Kevin Lin', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5014019150', 'display_name': 'Jiangming Liu', 'orcid': 'https://orcid.org/0000-0002-2178-2385'}, 'institutions': [{'id': 'https://openalex.org/I98677209', 'display_name': 'University of Edinburgh', 'ror': 'https://ror.org/01nrxwf90', 'country_code': 'GB', 'type': 'education', 'lineage': ['https://openalex.org/I98677209']}], 'countries': ['GB'], 'is_corresponding': False, 'raw_author_name': 'Jiangming Liu', 'raw_affiliation_strings': ['University of Edinburgh'], 'affiliations': [{'raw_affiliation_string': 'University of Edinburgh', 'institution_ids': ['https://openalex.org/I98677209']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5031981513', 'display_name': 'Nelson F. Liu', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I97018004', 'display_name': 'Stanford University', 'ror': 'https://ror.org/00f54p054', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I97018004']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Nelson F. Liu', 'raw_affiliation_strings': ['Stanford University'], 'affiliations': [{'raw_affiliation_string': 'Stanford University', 'institution_ids': ['https://openalex.org/I97018004']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5019045595', 'display_name': 'Phoebe Mulcaire', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Phoebe Mulcaire', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5032597148', 'display_name': 'Ning Qiang', 'orcid': 'https://orcid.org/0000-0001-8321-866X'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Qiang Ning', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5005779128', 'display_name': 'Sameer Singh', 'orcid': 'https://orcid.org/0000-0003-0621-6323'}, 'institutions': [{'id': 'https://openalex.org/I4210137750', 'display_name': 'UC Irvine Health', 'ror': 'https://ror.org/03fgher32', 'country_code': 'US', 'type': 'healthcare', 'lineage': ['https://openalex.org/I4210137750']}, {'id': 'https://openalex.org/I95457486', 'display_name': 'University of California, Berkeley', 'ror': 'https://ror.org/01an7q238', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I95457486']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Sameer Singh', 'raw_affiliation_strings': ['UC Irvine + UC Berkeley'], 'affiliations': [{'raw_affiliation_string': 'UC Irvine + UC Berkeley', 'institution_ids': ['https://openalex.org/I4210137750', 'https://openalex.org/I95457486']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5088517824', 'display_name': 'Noah A. Smith', 'orcid': 'https://orcid.org/0000-0002-2310-6380'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Noah A. Smith', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5020117260', 'display_name': 'Sanjay Subramanian', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Sanjay Subramanian', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5063283689', 'display_name': 'Reut Tsarfaty', 'orcid': 'https://orcid.org/0000-0001-6406-6568'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Reut Tsarfaty', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5110564361', 'display_name': 'Eric Wallace', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Eric Wallace', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5019162204', 'display_name': 'Ally Zhang', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Ally Zhang', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5020349386', 'display_name': 'Ben Zhou', 'orcid': 'https://orcid.org/0009-0009-1684-3719'}, 'institutions': [{'id': 'https://openalex.org/I4210153002', 'display_name': 'American Friends of Tel Aviv University', 'ror': 'https://ror.org/04dq3vj35', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I4210153002']}, {'id': 'https://openalex.org/I79576946', 'display_name': 'University of Pennsylvania', 'ror': 'https://ror.org/00b30xv10', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I79576946']}, {'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}, {'id': 'https://openalex.org/I205783295', 'display_name': 'Cornell University', 'ror': 'https://ror.org/05bnh6r87', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I205783295']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Ben Zhou', 'raw_affiliation_strings': ['Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington'], 'affiliations': [{'raw_affiliation_string': 'Institute for AI Γ Cornell University ♣ Bar-Ilan University ♠ Tel-Aviv University ♥ University of Pennsylvania University of Washington', 'institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295']}]}], 'institution_assertions': [], 'countries_distinct_count': 2, 'institutions_distinct_count': 8, 'corresponding_author_ids': ['https://openalex.org/A5035088083'], 'corresponding_institution_ids': ['https://openalex.org/I4210153002', 'https://openalex.org/I79576946', 'https://openalex.org/I201448701', 'https://openalex.org/I205783295'], 'apc_list': None, 'apc_paid': None, 'fwci': 20.354, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 272, 'citation_normalized_percentile': {'value': 0.999907, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 99, 'max': 100}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9997, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9997, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9997, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9854, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/zhàng', 'display_name': 'Zhàng', 'score': 0.710773}, {'id': 'https://openalex.org/keywords/chen', 'display_name': 'Chen', 'score': 0.58995235}], 'concepts': [{'id': 'https://openalex.org/C2777045944', 'wikidata': 'https://www.wikidata.org/wiki/Q12170198', 'display_name': 'Zhàng', 'level': 3, 'score': 0.710773}, {'id': 'https://openalex.org/C2776085556', 'wikidata': 'https://www.wikidata.org/wiki/Q183361', 'display_name': 'Chen', 'level': 2, 'score': 0.58995235}, {'id': 'https://openalex.org/C2776502983', 'wikidata': 'https://www.wikidata.org/wiki/Q690182', 'display_name': 'Contrast (vision)', 'level': 2, 'score': 0.50549555}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.30446604}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.25573844}, {'id': 'https://openalex.org/C95457728', 'wikidata': 'https://www.wikidata.org/wiki/Q309', 'display_name': 'History', 'level': 0, 'score': 0.2367957}, {'id': 'https://openalex.org/C166957645', 'wikidata': 'https://www.wikidata.org/wiki/Q23498', 'display_name': 'Archaeology', 'level': 1, 'score': 0.09113258}, {'id': 'https://openalex.org/C127313418', 'wikidata': 'https://www.wikidata.org/wiki/Q1069', 'display_name': 'Geology', 'level': 0, 'score': 0.08817369}, {'id': 'https://openalex.org/C191935318', 'wikidata': 'https://www.wikidata.org/wiki/Q148', 'display_name': 'China', 'level': 2, 'score': 0.086790055}, {'id': 'https://openalex.org/C151730666', 'wikidata': 'https://www.wikidata.org/wiki/Q7205', 'display_name': 'Paleontology', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.findings-emnlp.117', 'pdf_url': 'https://www.aclweb.org/anthology/2020.findings-emnlp.117.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'http://arxiv.org/abs/2004.02709', 'pdf_url': 'http://arxiv.org/pdf/2004.02709', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.findings-emnlp.117', 'pdf_url': 'https://www.aclweb.org/anthology/2020.findings-emnlp.117.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'display_name': 'Peace, justice, and strong institutions', 'id': 'https://metadata.un.org/sdg/16', 'score': 0.56}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 90, 'referenced_works': ['https://openalex.org/W131522978', 'https://openalex.org/W1599016936', 'https://openalex.org/W1601728146', 'https://openalex.org/W1632114991', 'https://openalex.org/W1673923490', 'https://openalex.org/W1840435438', 'https://openalex.org/W1982926857', 'https://openalex.org/W2034368206', 'https://openalex.org/W2104094955', 'https://openalex.org/W2113459411', 'https://openalex.org/W2150087485', 'https://openalex.org/W2157275230', 'https://openalex.org/W2250263931', 'https://openalex.org/W2299976354', 'https://openalex.org/W2552110825', 'https://openalex.org/W2579343286', 'https://openalex.org/W2606964149', 'https://openalex.org/W2756888147', 'https://openalex.org/W2786776430', 'https://openalex.org/W2791170418', 'https://openalex.org/W2798602728', 'https://openalex.org/W2798665661', 'https://openalex.org/W2799007037', 'https://openalex.org/W2885588803', 'https://openalex.org/W2887768933', 'https://openalex.org/W2888922637', 'https://openalex.org/W2896457183', 'https://openalex.org/W2898962441', 'https://openalex.org/W2919420119', 'https://openalex.org/W2922293812', 'https://openalex.org/W2946086434', 'https://openalex.org/W2946364534', 'https://openalex.org/W2946659172', 'https://openalex.org/W2949154782', 'https://openalex.org/W2949858875', 'https://openalex.org/W2950470622', 'https://openalex.org/W2950700477', 'https://openalex.org/W2952984539', 'https://openalex.org/W2953039212', 'https://openalex.org/W2953163841', 'https://openalex.org/W2953271402', 'https://openalex.org/W2953937638', 'https://openalex.org/W2962736243', 'https://openalex.org/W2962739339', 'https://openalex.org/W2962739340', 'https://openalex.org/W2962809918', 'https://openalex.org/W2962816513', 'https://openalex.org/W2962843521', 'https://openalex.org/W2963117013', 'https://openalex.org/W2963159690', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963394326', 'https://openalex.org/W2963457723', 'https://openalex.org/W2963526187', 'https://openalex.org/W2963530300', 'https://openalex.org/W2963571341', 'https://openalex.org/W2963612171', 'https://openalex.org/W2963797084', 'https://openalex.org/W2963969878', 'https://openalex.org/W2964130895', 'https://openalex.org/W2964153729', 'https://openalex.org/W2965373594', 'https://openalex.org/W2966491090', 'https://openalex.org/W2970078867', 'https://openalex.org/W2970231061', 'https://openalex.org/W2970442950', 'https://openalex.org/W2970597249', 'https://openalex.org/W2970742161', 'https://openalex.org/W2970745243', 'https://openalex.org/W2970942496', 'https://openalex.org/W2971068072', 'https://openalex.org/W2971225054', 'https://openalex.org/W2971236147', 'https://openalex.org/W2974009432', 'https://openalex.org/W2977235550', 'https://openalex.org/W2982756474', 'https://openalex.org/W2987553933', 'https://openalex.org/W2994934025', 'https://openalex.org/W2996728628', 'https://openalex.org/W3034850762', 'https://openalex.org/W3035331128', 'https://openalex.org/W3098189689', 'https://openalex.org/W3101004475', 'https://openalex.org/W3103873238', 'https://openalex.org/W3104379732', 'https://openalex.org/W3128232076', 'https://openalex.org/W3129289122', 'https://openalex.org/W4214784700', 'https://openalex.org/W4288548690', 'https://openalex.org/W4294611718'], 'related_works': ['https://openalex.org/W3210957918', 'https://openalex.org/W2792944589', 'https://openalex.org/W2748952813', 'https://openalex.org/W2389678104', 'https://openalex.org/W2384986722', 'https://openalex.org/W2375840727', 'https://openalex.org/W2375137083', 'https://openalex.org/W2364559953', 'https://openalex.org/W2352935415', 'https://openalex.org/W2123129454'], 'abstract_inverted_index': {'Matt': [0], 'Gardner,': [1], 'Yoav': [2], 'Artzi,': [3], 'Victoria': [4], 'Basmov,': [5], 'Jonathan': [6], 'Berant,': [7], 'Ben': [8, 52], 'Bogin,': [9], 'Sihao': [10], 'Chen,': [11], 'Pradeep': [12], 'Dasigi,': [13], 'Dheeru': [14], 'Dua,': [15], 'Yanai': [16], 'Elazar,': [17], 'Ananth': [18], 'Gottumukkala,': [19], 'Nitish': [20], 'Gupta,': [21], 'Hannaneh': [22], 'Hajishirzi,': [23], 'Gabriel': [24], 'Ilharco,': [25], 'Daniel': [26], 'Khashabi,': [27], 'Kevin': [28], 'Lin,': [29], 'Jiangming': [30], 'Liu,': [31, 34], 'Nelson': [32], 'F.': [33], 'Phoebe': [35], 'Mulcaire,': [36], 'Qiang': [37], 'Ning,': [38], 'Sameer': [39], 'Singh,': [40], 'Noah': [41], 'A.': [42], 'Smith,': [43], 'Sanjay': [44], 'Subramanian,': [45], 'Reut': [46], 'Tsarfaty,': [47], 'Eric': [48], 'Wallace,': [49], 'Ally': [50], 'Zhang,': [51], 'Zhou.': [53], 'Findings': [54], 'of': [55], 'the': [56], 'Association': [57], 'for': [58], 'Computational': [59], 'Linguistics:': [60], 'EMNLP': [61], '2020.': [62, 63]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3105928338', 'counts_by_year': [{'year': 2024, 'cited_by_count': 12}, {'year': 2023, 'cited_by_count': 59}, {'year': 2022, 'cited_by_count': 70}, {'year': 2021, 'cited_by_count': 115}, {'year': 2020, 'cited_by_count': 13}], 'updated_date': '2024-12-27T04:33:36.672350', 'created_date': '2020-11-23'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
