Hint-Based Training for Non-Autoregressive Machine Translation

Name: Work Video:
Duration: 3 min 30 s
Description: Zhuohan Li, Zi Lin, Di He, Fei Tian, Tao Qin, Liwei Wang, Tie-Yan Liu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Zhuohan Li; Zi Lin; Di He; Fei Tian; Tao Qin; Liwei Wang; Tie‐Yan Liu
{'id': 'https://openalex.org/W2976965654', 'doi': 'https://doi.org/10.18653/v1/d19-1573', 'title': 'Hint-Based Training for Non-Autoregressive Machine Translation', 'display_name': 'Hint-Based Training for Non-Autoregressive Machine Translation', 'publication_year': 2019, 'publication_date': '2019-01-01', 'ids': {'openalex': 'https://openalex.org/W2976965654', 'doi': 'https://doi.org/10.18653/v1/d19-1573', 'mag': '2976965654'}, 'language': 'en', 'primary_location': {'is_oa': False, 'landing_page_url': 'https://doi.org/10.18653/v1/d19-1573', 'pdf_url': None, 'source': None, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'green', 'oa_url': 'https://arxiv.org/pdf/1909.06708', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5009362721', 'display_name': 'Zhuohan Li', 'orcid': 'https://orcid.org/0000-0001-5372-9450'}, 'institutions': [{'id': 'https://openalex.org/I134446601', 'display_name': 'Berkeley College', 'ror': 'https://ror.org/02xewxa75', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I134446601']}, {'id': 'https://openalex.org/I95457486', 'display_name': 'University of California, Berkeley', 'ror': 'https://ror.org/01an7q238', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I95457486']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Zhuohan Li', 'raw_affiliation_strings': ['UC Berkeley'], 'affiliations': [{'raw_affiliation_string': 'UC Berkeley', 'institution_ids': ['https://openalex.org/I134446601', 'https://openalex.org/I95457486']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5063684082', 'display_name': 'Zi Lin', 'orcid': 'https://orcid.org/0000-0001-8588-0868'}, 'institutions': [{'id': 'https://openalex.org/I20231570', 'display_name': 'Peking University', 'ror': 'https://ror.org/02v51f717', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I20231570']}, {'id': 'https://openalex.org/I1291425158', 'display_name': 'Google (United States)', 'ror': 'https://ror.org/00njsd438', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I1291425158', 'https://openalex.org/I4210128969']}], 'countries': ['CN', 'US'], 'is_corresponding': False, 'raw_author_name': 'Zi Lin', 'raw_affiliation_strings': ['Google AI', 'Peking University'], 'affiliations': [{'raw_affiliation_string': 'Peking University', 'institution_ids': ['https://openalex.org/I20231570']}, {'raw_affiliation_string': 'Google AI', 'institution_ids': ['https://openalex.org/I1291425158']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100739030', 'display_name': 'Di He', 'orcid': 'https://orcid.org/0000-0001-9561-0079'}, 'institutions': [{'id': 'https://openalex.org/I20231570', 'display_name': 'Peking University', 'ror': 'https://ror.org/02v51f717', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I20231570']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Di He', 'raw_affiliation_strings': ['Peking University'], 'affiliations': [{'raw_affiliation_string': 'Peking University', 'institution_ids': ['https://openalex.org/I20231570']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5103275673', 'display_name': 'Fei Tian', 'orcid': 'https://orcid.org/0000-0003-4345-3125'}, 'institutions': [{'id': 'https://openalex.org/I2252078561', 'display_name': 'Meta (Israel)', 'ror': 'https://ror.org/02388em19', 'country_code': 'IL', 'type': 'company', 'lineage': ['https://openalex.org/I2252078561', 'https://openalex.org/I4210114444']}], 'countries': ['IL'], 'is_corresponding': False, 'raw_author_name': 'Fei Tian', 'raw_affiliation_strings': ['Facebook'], 'affiliations': [{'raw_affiliation_string': 'Facebook', 'institution_ids': ['https://openalex.org/I2252078561']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5020025718', 'display_name': 'Tao Qin', 'orcid': 'https://orcid.org/0000-0002-9095-0776'}, 'institutions': [{'id': 'https://openalex.org/I4210164937', 'display_name': 'Microsoft Research (United Kingdom)', 'ror': 'https://ror.org/05k87vq12', 'country_code': 'GB', 'type': 'company', 'lineage': ['https://openalex.org/I1290206253', 'https://openalex.org/I4210164937']}], 'countries': ['GB'], 'is_corresponding': False, 'raw_author_name': 'Tao Qin', 'raw_affiliation_strings': ['Microsoft Research'], 'affiliations': [{'raw_affiliation_string': 'Microsoft Research', 'institution_ids': ['https://openalex.org/I4210164937']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100406711', 'display_name': 'Liwei Wang', 'orcid': 'https://orcid.org/0000-0001-9970-8604'}, 'institutions': [{'id': 'https://openalex.org/I20231570', 'display_name': 'Peking University', 'ror': 'https://ror.org/02v51f717', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I20231570']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Liwei Wang', 'raw_affiliation_strings': ['Peking University'], 'affiliations': [{'raw_affiliation_string': 'Peking University', 'institution_ids': ['https://openalex.org/I20231570']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5115592065', 'display_name': 'Tie‐Yan Liu', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210164937', 'display_name': 'Microsoft Research (United Kingdom)', 'ror': 'https://ror.org/05k87vq12', 'country_code': 'GB', 'type': 'company', 'lineage': ['https://openalex.org/I1290206253', 'https://openalex.org/I4210164937']}], 'countries': ['GB'], 'is_corresponding': False, 'raw_author_name': 'Tie-Yan Liu', 'raw_affiliation_strings': ['Microsoft Research'], 'affiliations': [{'raw_affiliation_string': 'Microsoft Research', 'institution_ids': ['https://openalex.org/I4210164937']}]}], 'institution_assertions': [], 'countries_distinct_count': 4, 'institutions_distinct_count': 6, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 3.703, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 65, 'citation_normalized_percentile': {'value': 0.999908, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 97, 'max': 98}, 'biblio': {'volume': None, 'issue': None, 'first_page': '5707', 'last_page': '5712'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9995, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9995, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9995, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9892, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/tian', 'display_name': 'Tian', 'score': 0.537829}], 'concepts': [{'id': 'https://openalex.org/C203005215', 'wikidata': 'https://www.wikidata.org/wiki/Q79798', 'display_name': 'Machine translation', 'level': 2, 'score': 0.7769171}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.7055429}, {'id': 'https://openalex.org/C159877910', 'wikidata': 'https://www.wikidata.org/wiki/Q2202883', 'display_name': 'Autoregressive model', 'level': 2, 'score': 0.6143621}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.60393023}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.56034636}, {'id': 'https://openalex.org/C2779802804', 'wikidata': 'https://www.wikidata.org/wiki/Q1364799', 'display_name': 'Tian', 'level': 2, 'score': 0.537829}, {'id': 'https://openalex.org/C149364088', 'wikidata': 'https://www.wikidata.org/wiki/Q185917', 'display_name': 'Translation (biology)', 'level': 4, 'score': 0.509528}, {'id': 'https://openalex.org/C18555067', 'wikidata': 'https://www.wikidata.org/wiki/Q8375051', 'display_name': 'Joint (building)', 'level': 2, 'score': 0.44563675}, {'id': 'https://openalex.org/C28490314', 'wikidata': 'https://www.wikidata.org/wiki/Q189436', 'display_name': 'Speech recognition', 'level': 1, 'score': 0.43920398}, {'id': 'https://openalex.org/C127413603', 'wikidata': 'https://www.wikidata.org/wiki/Q11023', 'display_name': 'Engineering', 'level': 0, 'score': 0.13421643}, {'id': 'https://openalex.org/C33923547', 'wikidata': 'https://www.wikidata.org/wiki/Q395', 'display_name': 'Mathematics', 'level': 0, 'score': 0.109428495}, {'id': 'https://openalex.org/C95457728', 'wikidata': 'https://www.wikidata.org/wiki/Q309', 'display_name': 'History', 'level': 0, 'score': 0.10350132}, {'id': 'https://openalex.org/C105795698', 'wikidata': 'https://www.wikidata.org/wiki/Q12483', 'display_name': 'Statistics', 'level': 1, 'score': 0.089954466}, {'id': 'https://openalex.org/C170154142', 'wikidata': 'https://www.wikidata.org/wiki/Q150737', 'display_name': 'Architectural engineering', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C195244886', 'wikidata': 'https://www.wikidata.org/wiki/Q41493', 'display_name': 'Ancient history', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C55493867', 'wikidata': 'https://www.wikidata.org/wiki/Q7094', 'display_name': 'Biochemistry', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C185592680', 'wikidata': 'https://www.wikidata.org/wiki/Q2329', 'display_name': 'Chemistry', 'level': 0, 'score': 0.0}, {'id': 'https://openalex.org/C105580179', 'wikidata': 'https://www.wikidata.org/wiki/Q188928', 'display_name': 'Messenger RNA', 'level': 3, 'score': 0.0}, {'id': 'https://openalex.org/C104317684', 'wikidata': 'https://www.wikidata.org/wiki/Q7187', 'display_name': 'Gene', 'level': 2, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': False, 'landing_page_url': 'https://doi.org/10.18653/v1/d19-1573', 'pdf_url': None, 'source': None, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/1909.06708', 'pdf_url': 'https://arxiv.org/pdf/1909.06708', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/1909.06708', 'pdf_url': 'https://arxiv.org/pdf/1909.06708', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}, 'sustainable_development_goals': [{'score': 0.79, 'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 27, 'referenced_works': ['https://openalex.org/W1690739335', 'https://openalex.org/W1821462560', 'https://openalex.org/W2101105183', 'https://openalex.org/W2133564696', 'https://openalex.org/W2183341477', 'https://openalex.org/W2194775991', 'https://openalex.org/W2487501366', 'https://openalex.org/W2525778437', 'https://openalex.org/W2540404261', 'https://openalex.org/W2552839021', 'https://openalex.org/W2613904329', 'https://openalex.org/W2659803504', 'https://openalex.org/W2767206889', 'https://openalex.org/W2789543585', 'https://openalex.org/W2963350559', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963434219', 'https://openalex.org/W2963736842', 'https://openalex.org/W2964118293', 'https://openalex.org/W2964190861', 'https://openalex.org/W2964265128', 'https://openalex.org/W2964308564', 'https://openalex.org/W2964352247', 'https://openalex.org/W4297747548', 'https://openalex.org/W4301368689', 'https://openalex.org/W4385245566', 'https://openalex.org/W4394666973'], 'related_works': ['https://openalex.org/W4398214277', 'https://openalex.org/W4398214195', 'https://openalex.org/W4232991284', 'https://openalex.org/W2883671469', 'https://openalex.org/W2728761353', 'https://openalex.org/W2394172368', 'https://openalex.org/W2386995406', 'https://openalex.org/W2381877804', 'https://openalex.org/W2367282044', 'https://openalex.org/W2358780700'], 'abstract_inverted_index': {'Zhuohan': [0], 'Li,': [1], 'Zi': [2], 'Lin,': [3], 'Di': [4], 'He,': [5], 'Fei': [6], 'Tian,': [7], 'Tao': [8], 'Qin,': [9], 'Liwei': [10], 'Wang,': [11], 'Tie-Yan': [12], 'Liu.': [13], 'Proceedings': [14], 'of': [15], 'the': [16, 27], '2019': [17], 'Conference': [18, 31], 'on': [19, 32], 'Empirical': [20], 'Methods': [21], 'in': [22], 'Natural': [23, 33], 'Language': [24, 34], 'Processing': [25, 35], 'and': [26], '9th': [28], 'International': [29], 'Joint': [30], '(EMNLP-IJCNLP).': [36], '2019.': [37]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W2976965654', 'counts_by_year': [{'year': 2024, 'cited_by_count': 1}, {'year': 2023, 'cited_by_count': 10}, {'year': 2022, 'cited_by_count': 7}, {'year': 2021, 'cited_by_count': 27}, {'year': 2020, 'cited_by_count': 17}, {'year': 2019, 'cited_by_count': 2}], 'updated_date': '2024-12-24T07:48:58.037763', 'created_date': '2019-10-03'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
