ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

Name: Work Video:
Duration: 3 min 30 s
Description: Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Yujia Qin; Yankai Lin; Ryuichi Takanobu; Zhiyuan Liu; Peng Li; Heng Ji; Minlie Huang; Maosong Sun; Jie Zhou
{'id': 'https://openalex.org/W3173169192', 'doi': 'https://doi.org/10.18653/v1/2021.acl-long.260', 'title': 'ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning', 'display_name': 'ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3173169192', 'doi': 'https://doi.org/10.18653/v1/2021.acl-long.260', 'mag': '3173169192'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.260', 'pdf_url': 'https://aclanthology.org/2021.acl-long.260.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.acl-long.260.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5102894085', 'display_name': 'Yujia Qin', 'orcid': 'https://orcid.org/0000-0003-3608-5061'}, 'institutions': [{'id': 'https://openalex.org/I157725225', 'display_name': 'University of Illinois Urbana-Champaign', 'ror': 'https://ror.org/047426m28', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I157725225']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Yujia Qin', 'raw_affiliation_strings': ['University of Illinois at Urbana-Champaign ♦ Pattern Recognition Center, WeChat AI,'], 'affiliations': [{'raw_affiliation_string': 'University of Illinois at Urbana-Champaign ♦ Pattern Recognition Center, WeChat AI,', 'institution_ids': ['https://openalex.org/I157725225']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5043098453', 'display_name': 'Yankai Lin', 'orcid': 'https://orcid.org/0000-0002-0151-6178'}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Yankai Lin', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5016443523', 'display_name': 'Ryuichi Takanobu', 'orcid': 'https://orcid.org/0000-0002-1382-8275'}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Ryuichi Takanobu', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100320723', 'display_name': 'Zhiyuan Liu', 'orcid': 'https://orcid.org/0000-0002-7709-2543'}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Zhiyuan Liu', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5108129241', 'display_name': 'Peng Li', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Peng Li', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5075033889', 'display_name': 'Heng Ji', 'orcid': 'https://orcid.org/0000-0002-0464-7966'}, 'institutions': [{'id': 'https://openalex.org/I157725225', 'display_name': 'University of Illinois Urbana-Champaign', 'ror': 'https://ror.org/047426m28', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I157725225']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Heng Ji', 'raw_affiliation_strings': ['University of Illinois at Urbana-Champaign ♦ Pattern Recognition Center, WeChat AI,'], 'affiliations': [{'raw_affiliation_string': 'University of Illinois at Urbana-Champaign ♦ Pattern Recognition Center, WeChat AI,', 'institution_ids': ['https://openalex.org/I157725225']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5044042138', 'display_name': 'Minlie Huang', 'orcid': 'https://orcid.org/0000-0001-7111-1849'}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Minlie Huang', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5046448314', 'display_name': 'Maosong Sun', 'orcid': 'https://orcid.org/0000-0002-6011-6115'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Maosong Sun', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5100770464', 'display_name': 'Jie Zhou', 'orcid': 'https://orcid.org/0000-0002-5899-5165'}, 'institutions': [{'id': 'https://openalex.org/I99065089', 'display_name': 'Tsinghua University', 'ror': 'https://ror.org/03cve4549', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I99065089']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Jie Zhou', 'raw_affiliation_strings': ['Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'Department of Computer Science and Technology, Tsinghua University, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science and Technology, Tsinghua University, Beijing, China', 'institution_ids': ['https://openalex.org/I99065089']}, {'raw_affiliation_string': 'Culiacán Municipality Sinaloa Guadalajara Mexico City Los Mochis', 'institution_ids': []}]}], 'institution_assertions': [], 'countries_distinct_count': 2, 'institutions_distinct_count': 2, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 7.831, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 77, 'citation_normalized_percentile': {'value': 0.999914, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 98, 'max': 99}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9987, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9638, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.57691586}, {'id': 'https://openalex.org/keywords/association', 'display_name': 'Association (psychology)', 'score': 0.5286658}], 'concepts': [{'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.7342444}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.6956079}, {'id': 'https://openalex.org/C25343380', 'wikidata': 'https://www.wikidata.org/wiki/Q277521', 'display_name': 'Relation (database)', 'level': 2, 'score': 0.6224306}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.610258}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.57691586}, {'id': 'https://openalex.org/C142853389', 'wikidata': 'https://www.wikidata.org/wiki/Q744778', 'display_name': 'Association (psychology)', 'level': 2, 'score': 0.5286658}, {'id': 'https://openalex.org/C20556612', 'wikidata': 'https://www.wikidata.org/wiki/Q4469374', 'display_name': 'Volume (thermodynamics)', 'level': 2, 'score': 0.52603817}, {'id': 'https://openalex.org/C41895202', 'wikidata': 'https://www.wikidata.org/wiki/Q8162', 'display_name': 'Linguistics', 'level': 1, 'score': 0.5152336}, {'id': 'https://openalex.org/C18555067', 'wikidata': 'https://www.wikidata.org/wiki/Q8375051', 'display_name': 'Joint (building)', 'level': 2, 'score': 0.4720674}, {'id': 'https://openalex.org/C127413603', 'wikidata': 'https://www.wikidata.org/wiki/Q11023', 'display_name': 'Engineering', 'level': 0, 'score': 0.14093694}, {'id': 'https://openalex.org/C124101348', 'wikidata': 'https://www.wikidata.org/wiki/Q172491', 'display_name': 'Data mining', 'level': 1, 'score': 0.100649655}, {'id': 'https://openalex.org/C138885662', 'wikidata': 'https://www.wikidata.org/wiki/Q5891', 'display_name': 'Philosophy', 'level': 0, 'score': 0.09748325}, {'id': 'https://openalex.org/C111472728', 'wikidata': 'https://www.wikidata.org/wiki/Q9471', 'display_name': 'Epistemology', 'level': 1, 'score': 0.057186663}, {'id': 'https://openalex.org/C170154142', 'wikidata': 'https://www.wikidata.org/wiki/Q150737', 'display_name': 'Architectural engineering', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C121332964', 'wikidata': 'https://www.wikidata.org/wiki/Q413', 'display_name': 'Physics', 'level': 0, 'score': 0.0}, {'id': 'https://openalex.org/C62520636', 'wikidata': 'https://www.wikidata.org/wiki/Q944', 'display_name': 'Quantum mechanics', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.260', 'pdf_url': 'https://aclanthology.org/2021.acl-long.260.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'http://arxiv.org/abs/2012.15022', 'pdf_url': 'http://arxiv.org/pdf/2012.15022', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.260', 'pdf_url': 'https://aclanthology.org/2021.acl-long.260.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'score': 0.86, 'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 60, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1566346388', 'https://openalex.org/W1682403713', 'https://openalex.org/W1713614699', 'https://openalex.org/W2064675550', 'https://openalex.org/W2129767020', 'https://openalex.org/W2138621090', 'https://openalex.org/W2157444450', 'https://openalex.org/W2170973209', 'https://openalex.org/W2181042685', 'https://openalex.org/W2250521169', 'https://openalex.org/W2551396370', 'https://openalex.org/W2626154462', 'https://openalex.org/W2759211898', 'https://openalex.org/W2896457183', 'https://openalex.org/W2908510526', 'https://openalex.org/W2912924812', 'https://openalex.org/W2923014074', 'https://openalex.org/W2938830017', 'https://openalex.org/W2944815030', 'https://openalex.org/W2951328433', 'https://openalex.org/W2951873305', 'https://openalex.org/W2952087486', 'https://openalex.org/W2952179106', 'https://openalex.org/W2952468927', 'https://openalex.org/W2952729433', 'https://openalex.org/W2953356739', 'https://openalex.org/W2963026768', 'https://openalex.org/W2963310665', 'https://openalex.org/W2963339397', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963748441', 'https://openalex.org/W2963866616', 'https://openalex.org/W2964022985', 'https://openalex.org/W2964121744', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970597249', 'https://openalex.org/W2970986510', 'https://openalex.org/W2980360762', 'https://openalex.org/W2983102021', 'https://openalex.org/W2988421999', 'https://openalex.org/W2994915912', 'https://openalex.org/W2995040292', 'https://openalex.org/W2996428491', 'https://openalex.org/W3005441132', 'https://openalex.org/W3011411500', 'https://openalex.org/W3021224558', 'https://openalex.org/W3082274269', 'https://openalex.org/W3098266846', 'https://openalex.org/W3102663935', 'https://openalex.org/W3104390324', 'https://openalex.org/W3104415840', 'https://openalex.org/W3114916066', 'https://openalex.org/W3151929433', 'https://openalex.org/W3175604467', 'https://openalex.org/W4287391717', 'https://openalex.org/W4288089799', 'https://openalex.org/W4288104771', 'https://openalex.org/W4385245566'], 'related_works': ['https://openalex.org/W4234874385', 'https://openalex.org/W4233308809', 'https://openalex.org/W2728221973', 'https://openalex.org/W2388988621', 'https://openalex.org/W2378782423', 'https://openalex.org/W2374905595', 'https://openalex.org/W2366623913', 'https://openalex.org/W2357797405', 'https://openalex.org/W2323648130', 'https://openalex.org/W2157140558'], 'abstract_inverted_index': {'Yujia': [0], 'Qin,': [1], 'Yankai': [2], 'Lin,': [3], 'Ryuichi': [4], 'Takanobu,': [5], 'Zhiyuan': [6], 'Liu,': [7], 'Peng': [8], 'Li,': [9], 'Heng': [10], 'Ji,': [11], 'Minlie': [12], 'Huang,': [13], 'Maosong': [14], 'Sun,': [15], 'Jie': [16], 'Zhou.': [17], 'Proceedings': [18], 'of': [19, 24], 'the': [20, 25, 31], '59th': [21], 'Annual': [22], 'Meeting': [23], 'Association': [26], 'for': [27], 'Computational': [28], 'Linguistics': [29], 'and': [30], '11th': [32], 'International': [33], 'Joint': [34], 'Conference': [35], 'on': [36], 'Natural': [37], 'Language': [38], 'Processing': [39], '(Volume': [40], '1:': [41], 'Long': [42], 'Papers).': [43], '2021.': [44]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3173169192', 'counts_by_year': [{'year': 2024, 'cited_by_count': 10}, {'year': 2023, 'cited_by_count': 36}, {'year': 2022, 'cited_by_count': 23}, {'year': 2021, 'cited_by_count': 5}], 'updated_date': '2024-12-13T03:11:45.609463', 'created_date': '2021-07-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
