Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation

Name: Work Video:
Duration: 3 min 30 s
Description: Xin Liu, Baosong Yang, Dayiheng Liu, Haibo Zhang, Weihua Luo, Min Zhang, Haiying Zhang, Jinsong Su. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Xin Liu; Baosong Yang; Dayiheng Liu; Haibo Zhang; Weihua Luo; M. Zhang; Haiying Zhang; Jinsong Su
{'id': 'https://openalex.org/W3176079416', 'doi': 'https://doi.org/10.18653/v1/2021.acl-long.468', 'title': 'Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation', 'display_name': 'Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3176079416', 'doi': 'https://doi.org/10.18653/v1/2021.acl-long.468', 'mag': '3176079416'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.468', 'pdf_url': 'https://aclanthology.org/2021.acl-long.468.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.acl-long.468.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5100352321', 'display_name': 'Xin Liu', 'orcid': 'https://orcid.org/0000-0003-2802-594X'}, 'institutions': [{'id': 'https://openalex.org/I191208505', 'display_name': 'Xiamen University', 'ror': 'https://ror.org/00mcjh785', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I191208505']}, {'id': 'https://openalex.org/I4210105595', 'display_name': 'Institute of Art', 'ror': 'https://ror.org/017fyx225', 'country_code': 'PL', 'type': 'facility', 'lineage': ['https://openalex.org/I4210105595', 'https://openalex.org/I99542240']}], 'countries': ['CN', 'PL'], 'is_corresponding': False, 'raw_author_name': 'Xin Liu', 'raw_affiliation_strings': ['Institute of Artificial Intelligence, Xiamen University', 'School of Informatics, Xiamen University'], 'affiliations': [{'raw_affiliation_string': 'School of Informatics, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505']}, {'raw_affiliation_string': 'Institute of Artificial Intelligence, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505', 'https://openalex.org/I4210105595']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5028040391', 'display_name': 'Baosong Yang', 'orcid': 'https://orcid.org/0000-0001-5002-2409'}, 'institutions': [{'id': 'https://openalex.org/I4210095624', 'display_name': 'Alibaba Group (United States)', 'ror': 'https://ror.org/00rn0m335', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I4210095624', 'https://openalex.org/I45928872']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Baosong Yang', 'raw_affiliation_strings': ['Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'Alibaba Group', 'institution_ids': ['https://openalex.org/I4210095624']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5062188134', 'display_name': 'Dayiheng Liu', 'orcid': 'https://orcid.org/0000-0002-8755-8941'}, 'institutions': [{'id': 'https://openalex.org/I4210095624', 'display_name': 'Alibaba Group (United States)', 'ror': 'https://ror.org/00rn0m335', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I4210095624', 'https://openalex.org/I45928872']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Dayiheng Liu', 'raw_affiliation_strings': ['Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'Alibaba Group', 'institution_ids': ['https://openalex.org/I4210095624']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100415757', 'display_name': 'Haibo Zhang', 'orcid': 'https://orcid.org/0000-0002-3752-0806'}, 'institutions': [{'id': 'https://openalex.org/I4210095624', 'display_name': 'Alibaba Group (United States)', 'ror': 'https://ror.org/00rn0m335', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I4210095624', 'https://openalex.org/I45928872']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Haibo Zhang', 'raw_affiliation_strings': ['Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'Alibaba Group', 'institution_ids': ['https://openalex.org/I4210095624']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5085736941', 'display_name': 'Weihua Luo', 'orcid': 'https://orcid.org/0000-0002-5002-6933'}, 'institutions': [{'id': 'https://openalex.org/I4210095624', 'display_name': 'Alibaba Group (United States)', 'ror': 'https://ror.org/00rn0m335', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I4210095624', 'https://openalex.org/I45928872']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Weihua Luo', 'raw_affiliation_strings': ['Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'Alibaba Group', 'institution_ids': ['https://openalex.org/I4210095624']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100671757', 'display_name': 'M. Zhang', 'orcid': 'https://orcid.org/0000-0001-8659-5727'}, 'institutions': [{'id': 'https://openalex.org/I3923682', 'display_name': 'Soochow University', 'ror': 'https://ror.org/05t8y2r12', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I3923682']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Min Zhang', 'raw_affiliation_strings': ['Soochow University, China'], 'affiliations': [{'raw_affiliation_string': 'Soochow University, China', 'institution_ids': ['https://openalex.org/I3923682']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100764111', 'display_name': 'Haiying Zhang', 'orcid': 'https://orcid.org/0000-0003-0625-6878'}, 'institutions': [{'id': 'https://openalex.org/I191208505', 'display_name': 'Xiamen University', 'ror': 'https://ror.org/00mcjh785', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I191208505']}, {'id': 'https://openalex.org/I4210105595', 'display_name': 'Institute of Art', 'ror': 'https://ror.org/017fyx225', 'country_code': 'PL', 'type': 'facility', 'lineage': ['https://openalex.org/I4210105595', 'https://openalex.org/I99542240']}], 'countries': ['CN', 'PL'], 'is_corresponding': False, 'raw_author_name': 'Haiying Zhang', 'raw_affiliation_strings': ['Institute of Artificial Intelligence, Xiamen University', 'School of Informatics, Xiamen University'], 'affiliations': [{'raw_affiliation_string': 'School of Informatics, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505']}, {'raw_affiliation_string': 'Institute of Artificial Intelligence, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505', 'https://openalex.org/I4210105595']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5066326238', 'display_name': 'Jinsong Su', 'orcid': 'https://orcid.org/0000-0001-5606-7122'}, 'institutions': [{'id': 'https://openalex.org/I191208505', 'display_name': 'Xiamen University', 'ror': 'https://ror.org/00mcjh785', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I191208505']}, {'id': 'https://openalex.org/I4210105595', 'display_name': 'Institute of Art', 'ror': 'https://ror.org/017fyx225', 'country_code': 'PL', 'type': 'facility', 'lineage': ['https://openalex.org/I4210105595', 'https://openalex.org/I99542240']}, {'id': 'https://openalex.org/I4210136793', 'display_name': 'Peng Cheng Laboratory', 'ror': 'https://ror.org/03qdqbt06', 'country_code': 'CN', 'type': 'facility', 'lineage': ['https://openalex.org/I4210136793']}], 'countries': ['CN', 'PL'], 'is_corresponding': False, 'raw_author_name': 'Jinsong Su', 'raw_affiliation_strings': ['Institute of Artificial Intelligence, Xiamen University', 'Pengcheng Lab, Shenzhen', 'School of Informatics, Xiamen University'], 'affiliations': [{'raw_affiliation_string': 'School of Informatics, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505']}, {'raw_affiliation_string': 'Institute of Artificial Intelligence, Xiamen University', 'institution_ids': ['https://openalex.org/I191208505', 'https://openalex.org/I4210105595']}, {'raw_affiliation_string': 'Pengcheng Lab, Shenzhen', 'institution_ids': ['https://openalex.org/I4210136793']}]}], 'institution_assertions': [], 'countries_distinct_count': 3, 'institutions_distinct_count': 5, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 1.017, 'has_fulltext': False, 'cited_by_count': 11, 'citation_normalized_percentile': {'value': 0.756396, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 88, 'max': 89}, 'biblio': {'volume': None, 'issue': None, 'first_page': '6001', 'last_page': '6011'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 1.0, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 1.0, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9908, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/zhàng', 'display_name': 'Zhàng', 'score': 0.7770312}, {'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.52728826}], 'concepts': [{'id': 'https://openalex.org/C174348530', 'wikidata': 'https://www.wikidata.org/wiki/Q188635', 'display_name': 'Bridging (networking)', 'level': 2, 'score': 0.8481006}, {'id': 'https://openalex.org/C2777045944', 'wikidata': 'https://www.wikidata.org/wiki/Q12170198', 'display_name': 'Zhàng', 'level': 3, 'score': 0.7770312}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.6624745}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.5655005}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.52728826}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.519886}, {'id': 'https://openalex.org/C41895202', 'wikidata': 'https://www.wikidata.org/wiki/Q8162', 'display_name': 'Linguistics', 'level': 1, 'score': 0.5189209}, {'id': 'https://openalex.org/C195324797', 'wikidata': 'https://www.wikidata.org/wiki/Q33742', 'display_name': 'Natural language', 'level': 2, 'score': 0.48921752}, {'id': 'https://openalex.org/C95457728', 'wikidata': 'https://www.wikidata.org/wiki/Q309', 'display_name': 'History', 'level': 0, 'score': 0.18516949}, {'id': 'https://openalex.org/C138885662', 'wikidata': 'https://www.wikidata.org/wiki/Q5891', 'display_name': 'Philosophy', 'level': 0, 'score': 0.16856363}, {'id': 'https://openalex.org/C191935318', 'wikidata': 'https://www.wikidata.org/wiki/Q148', 'display_name': 'China', 'level': 2, 'score': 0.1016441}, {'id': 'https://openalex.org/C31258907', 'wikidata': 'https://www.wikidata.org/wiki/Q1301371', 'display_name': 'Computer network', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C166957645', 'wikidata': 'https://www.wikidata.org/wiki/Q23498', 'display_name': 'Archaeology', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.468', 'pdf_url': 'https://aclanthology.org/2021.acl-long.468.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2106.06125', 'pdf_url': 'https://arxiv.org/pdf/2106.06125', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.acl-long.468', 'pdf_url': 'https://aclanthology.org/2021.acl-long.468.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4', 'score': 0.83}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 52, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1614298861', 'https://openalex.org/W1821462560', 'https://openalex.org/W2101105183', 'https://openalex.org/W2123301721', 'https://openalex.org/W2133564696', 'https://openalex.org/W2150824314', 'https://openalex.org/W2250876691', 'https://openalex.org/W2525778437', 'https://openalex.org/W2752630748', 'https://openalex.org/W2886342729', 'https://openalex.org/W2891680269', 'https://openalex.org/W2892244498', 'https://openalex.org/W2922709902', 'https://openalex.org/W2925618549', 'https://openalex.org/W2927746189', 'https://openalex.org/W2945789949', 'https://openalex.org/W2951561177', 'https://openalex.org/W2962784628', 'https://openalex.org/W2963250244', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963421945', 'https://openalex.org/W2963633299', 'https://openalex.org/W2963748441', 'https://openalex.org/W2963887123', 'https://openalex.org/W2963979492', 'https://openalex.org/W2964121744', 'https://openalex.org/W2964308564', 'https://openalex.org/W2970597249', 'https://openalex.org/W2990804422', 'https://openalex.org/W2994928925', 'https://openalex.org/W3006381853', 'https://openalex.org/W3034257506', 'https://openalex.org/W3034999214', 'https://openalex.org/W3035072529', 'https://openalex.org/W3035207248', 'https://openalex.org/W3035254119', 'https://openalex.org/W3036120435', 'https://openalex.org/W3100891510', 'https://openalex.org/W3101155369', 'https://openalex.org/W3104652516', 'https://openalex.org/W3106144205', 'https://openalex.org/W3107826490', 'https://openalex.org/W3115909586', 'https://openalex.org/W3119920397', 'https://openalex.org/W3172275282', 'https://openalex.org/W3176634614', 'https://openalex.org/W3176868790', 'https://openalex.org/W3176929804', 'https://openalex.org/W4385245566', 'https://openalex.org/W648786980'], 'related_works': ['https://openalex.org/W4308854837', 'https://openalex.org/W4226226396', 'https://openalex.org/W3153750606', 'https://openalex.org/W2389678104', 'https://openalex.org/W2387562377', 'https://openalex.org/W2380507695', 'https://openalex.org/W2375840727', 'https://openalex.org/W2375137083', 'https://openalex.org/W2367687999', 'https://openalex.org/W2364559953'], 'abstract_inverted_index': {'Xin': [0], 'Liu,': [1, 5], 'Baosong': [2], 'Yang,': [3], 'Dayiheng': [4], 'Haibo': [6], 'Zhang,': [7, 11, 13], 'Weihua': [8], 'Luo,': [9], 'Min': [10], 'Haiying': [12], 'Jinsong': [14], 'Su.': [15], 'Proceedings': [16], 'of': [17, 22], 'the': [18, 23, 29], '59th': [19], 'Annual': [20], 'Meeting': [21], 'Association': [24], 'for': [25], 'Computational': [26], 'Linguistics': [27], 'and': [28], '11th': [30], 'International': [31], 'Joint': [32], 'Conference': [33], 'on': [34], 'Natural': [35], 'Language': [36], 'Processing': [37], '(Volume': [38], '1:': [39], 'Long': [40], 'Papers).': [41], '2021.': [42]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3176079416', 'counts_by_year': [{'year': 2024, 'cited_by_count': 1}, {'year': 2023, 'cited_by_count': 5}, {'year': 2022, 'cited_by_count': 3}], 'updated_date': '2024-12-24T05:48:59.196503', 'created_date': '2021-07-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
