Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models

Name: Work Video:
Duration: 3 min 30 s
Description: Tianxing He, Jun Liu, Kyunghyun Cho, Myle Ott, Bing Liu, James Glass, Fuchun Peng. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. 2021.
Tianxing He; Jun Liu; Kyunghyun Cho; Myle Ott; Bing Liu; James Glass; Fuchun Peng
{'id': 'https://openalex.org/W3156476125', 'doi': 'https://doi.org/10.18653/v1/2021.eacl-main.95', 'title': 'Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models', 'display_name': 'Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3156476125', 'doi': 'https://doi.org/10.18653/v1/2021.eacl-main.95', 'mag': '3156476125'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.95', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.95.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.eacl-main.95.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5051747323', 'display_name': 'Tianxing He', 'orcid': 'https://orcid.org/0009-0008-6383-0307'}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Tianxing He', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100361857', 'display_name': 'Jun Liu', 'orcid': 'https://orcid.org/0000-0002-4365-4165'}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Jun Liu', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5091175785', 'display_name': 'Kyunghyun Cho', 'orcid': 'https://orcid.org/0000-0003-1669-3211'}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Kyunghyun Cho', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5076248976', 'display_name': 'Myle Ott', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Myle Ott', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100339921', 'display_name': 'Bing Liu', 'orcid': 'https://orcid.org/0000-0002-2365-6606'}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Bing Liu', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5112758056', 'display_name': 'James Glass', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'James Glass', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5047400593', 'display_name': 'Fuchun Peng', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I57206974', 'display_name': 'New York University', 'ror': 'https://ror.org/0190ak572', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I57206974']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Fuchun Peng', 'raw_affiliation_strings': ['New York University'], 'affiliations': [{'raw_affiliation_string': 'New York University', 'institution_ids': ['https://openalex.org/I57206974']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 1, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 3.051, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 30, 'citation_normalized_percentile': {'value': 0.999914, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 96, 'max': 97}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9937, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T12031', 'display_name': 'Speech and dialogue systems', 'score': 0.9912, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [], 'concepts': [{'id': 'https://openalex.org/C7149132', 'wikidata': 'https://www.wikidata.org/wiki/Q1377840', 'display_name': 'Forgetting', 'level': 2, 'score': 0.67866665}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.65254396}, {'id': 'https://openalex.org/C36503486', 'wikidata': 'https://www.wikidata.org/wiki/Q11235244', 'display_name': 'Domain (mathematical analysis)', 'level': 2, 'score': 0.49680665}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.44142398}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.41121545}, {'id': 'https://openalex.org/C41895202', 'wikidata': 'https://www.wikidata.org/wiki/Q8162', 'display_name': 'Linguistics', 'level': 1, 'score': 0.21021208}, {'id': 'https://openalex.org/C138885662', 'wikidata': 'https://www.wikidata.org/wiki/Q5891', 'display_name': 'Philosophy', 'level': 0, 'score': 0.13605812}, {'id': 'https://openalex.org/C33923547', 'wikidata': 'https://www.wikidata.org/wiki/Q395', 'display_name': 'Mathematics', 'level': 0, 'score': 0.10945693}, {'id': 'https://openalex.org/C134306372', 'wikidata': 'https://www.wikidata.org/wiki/Q7754', 'display_name': 'Mathematical analysis', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 1, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.95', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.95.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.95', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.95.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'score': 0.62, 'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 45, 'referenced_works': ['https://openalex.org/W1486649854', 'https://openalex.org/W1522301498', 'https://openalex.org/W1902237438', 'https://openalex.org/W2116522068', 'https://openalex.org/W2125320996', 'https://openalex.org/W2130942839', 'https://openalex.org/W2138857742', 'https://openalex.org/W2157331557', 'https://openalex.org/W2560647685', 'https://openalex.org/W2742947407', 'https://openalex.org/W2761590056', 'https://openalex.org/W2786958491', 'https://openalex.org/W2799176105', 'https://openalex.org/W2807873315', 'https://openalex.org/W2889326414', 'https://openalex.org/W2890365488', 'https://openalex.org/W2896457183', 'https://openalex.org/W2908460844', 'https://openalex.org/W2933138175', 'https://openalex.org/W2938704169', 'https://openalex.org/W2944815030', 'https://openalex.org/W2948975009', 'https://openalex.org/W2952468927', 'https://openalex.org/W2952592807', 'https://openalex.org/W2962739339', 'https://openalex.org/W2962784628', 'https://openalex.org/W2963096510', 'https://openalex.org/W2963206148', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963544536', 'https://openalex.org/W2964121744', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970597249', 'https://openalex.org/W2972664115', 'https://openalex.org/W2996287690', 'https://openalex.org/W3007672467', 'https://openalex.org/W3008686018', 'https://openalex.org/W3035239386', 'https://openalex.org/W3044438666', 'https://openalex.org/W3102659883', 'https://openalex.org/W3111372685', 'https://openalex.org/W4288334893', 'https://openalex.org/W4385245566', 'https://openalex.org/W4399584083'], 'related_works': ['https://openalex.org/W4289718052', 'https://openalex.org/W4287549553', 'https://openalex.org/W4248896073', 'https://openalex.org/W3204019825', 'https://openalex.org/W3183027292', 'https://openalex.org/W3116498279', 'https://openalex.org/W2974871044', 'https://openalex.org/W2748952813', 'https://openalex.org/W2164121020', 'https://openalex.org/W2145559838'], 'abstract_inverted_index': {'Tianxing': [0], 'He,': [1], 'Jun': [2], 'Liu,': [3, 9], 'Kyunghyun': [4], 'Cho,': [5], 'Myle': [6], 'Ott,': [7], 'Bing': [8], 'James': [10], 'Glass,': [11], 'Fuchun': [12], 'Peng.': [13], 'Proceedings': [14], 'of': [15, 19, 23], 'the': [16, 20, 24], '16th': [17], 'Conference': [18], 'European': [21], 'Chapter': [22], 'Association': [25], 'for': [26], 'Computational': [27], 'Linguistics:': [28], 'Main': [29], 'Volume.': [30], '2021.': [31]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3156476125', 'counts_by_year': [{'year': 2024, 'cited_by_count': 5}, {'year': 2023, 'cited_by_count': 10}, {'year': 2022, 'cited_by_count': 6}, {'year': 2021, 'cited_by_count': 7}], 'updated_date': '2024-12-18T08:40:25.522185', 'created_date': '2021-04-26'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
