Unsupervised Cross-lingual Representation Learning at Scale

Name: Work Video:
Duration: 3 min 30 s
Description: Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020.
Alexis Conneau; Kartikay Khandelwal; Naman Goyal; Vishrav Chaudhary; Guillaume Wenzek; Francisco Guzmán; Édouard Grave; Myle Ott; Luke Zettlemoyer; Veselin Stoyanov
{'id': 'https://openalex.org/W3035390927', 'doi': 'https://doi.org/10.18653/v1/2020.acl-main.747', 'title': 'Unsupervised Cross-lingual Representation Learning at Scale', 'display_name': 'Unsupervised Cross-lingual Representation Learning at Scale', 'publication_year': 2020, 'publication_date': '2020-01-01', 'ids': {'openalex': 'https://openalex.org/W3035390927', 'doi': 'https://doi.org/10.18653/v1/2020.acl-main.747', 'mag': '3035390927'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.acl-main.747', 'pdf_url': 'https://www.aclweb.org/anthology/2020.acl-main.747.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://www.aclweb.org/anthology/2020.acl-main.747.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5068394403', 'display_name': 'Alexis Conneau', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Alexis Conneau', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5065919484', 'display_name': 'Kartikay Khandelwal', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Kartikay Khandelwal', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5075834790', 'display_name': 'Naman Goyal', 'orcid': 'https://orcid.org/0000-0002-7565-4303'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Naman Goyal', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5053028004', 'display_name': 'Vishrav Chaudhary', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Vishrav Chaudhary', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5023203387', 'display_name': 'Guillaume Wenzek', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Guillaume Wenzek', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5113551755', 'display_name': 'Francisco Guzmán', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Francisco Guzmán', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5069316249', 'display_name': 'Édouard Grave', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Edouard Grave', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5076248976', 'display_name': 'Myle Ott', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Myle Ott', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5067919401', 'display_name': 'Luke Zettlemoyer', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Luke Zettlemoyer', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5091317839', 'display_name': 'Veselin Stoyanov', 'orcid': None}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Veselin Stoyanov', 'raw_affiliation_strings': [], 'affiliations': []}], 'institution_assertions': [], 'countries_distinct_count': 0, 'institutions_distinct_count': 0, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 268.486, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 3909, 'citation_normalized_percentile': {'value': 0.999907, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 99, 'max': 100}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9998, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T13910', 'display_name': 'Computational and Text Analysis Methods', 'score': 0.9856, 'subfield': {'id': 'https://openalex.org/subfields/3300', 'display_name': 'General Social Sciences'}, 'field': {'id': 'https://openalex.org/fields/33', 'display_name': 'Social Sciences'}, 'domain': {'id': 'https://openalex.org/domains/2', 'display_name': 'Social Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/representation', 'display_name': 'Representation', 'score': 0.5506062}], 'concepts': [{'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.5689447}, {'id': 'https://openalex.org/C2778755073', 'wikidata': 'https://www.wikidata.org/wiki/Q10858537', 'display_name': 'Scale (ratio)', 'level': 2, 'score': 0.5582764}, {'id': 'https://openalex.org/C2776359362', 'wikidata': 'https://www.wikidata.org/wiki/Q2145286', 'display_name': 'Representation (politics)', 'level': 3, 'score': 0.5506062}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5276177}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.49496287}, {'id': 'https://openalex.org/C28490314', 'wikidata': 'https://www.wikidata.org/wiki/Q189436', 'display_name': 'Speech recognition', 'level': 1, 'score': 0.36718762}, {'id': 'https://openalex.org/C41895202', 'wikidata': 'https://www.wikidata.org/wiki/Q8162', 'display_name': 'Linguistics', 'level': 1, 'score': 0.34080714}, {'id': 'https://openalex.org/C138885662', 'wikidata': 'https://www.wikidata.org/wiki/Q5891', 'display_name': 'Philosophy', 'level': 0, 'score': 0.17460784}, {'id': 'https://openalex.org/C205649164', 'wikidata': 'https://www.wikidata.org/wiki/Q1071', 'display_name': 'Geography', 'level': 0, 'score': 0.12681752}, {'id': 'https://openalex.org/C58640448', 'wikidata': 'https://www.wikidata.org/wiki/Q42515', 'display_name': 'Cartography', 'level': 1, 'score': 0.12226942}, {'id': 'https://openalex.org/C94625758', 'wikidata': 'https://www.wikidata.org/wiki/Q7163', 'display_name': 'Politics', 'level': 2, 'score': 0.0}, {'id': 'https://openalex.org/C17744445', 'wikidata': 'https://www.wikidata.org/wiki/Q36442', 'display_name': 'Political science', 'level': 0, 'score': 0.0}, {'id': 'https://openalex.org/C199539241', 'wikidata': 'https://www.wikidata.org/wiki/Q7748', 'display_name': 'Law', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.acl-main.747', 'pdf_url': 'https://www.aclweb.org/anthology/2020.acl-main.747.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/1911.02116', 'pdf_url': 'https://arxiv.org/pdf/1911.02116', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2020.acl-main.747', 'pdf_url': 'https://www.aclweb.org/anthology/2020.acl-main.747.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 47, 'referenced_works': ['https://openalex.org/W1840435438', 'https://openalex.org/W2126725946', 'https://openalex.org/W2153579005', 'https://openalex.org/W2250539671', 'https://openalex.org/W2251939518', 'https://openalex.org/W2259472270', 'https://openalex.org/W2296283641', 'https://openalex.org/W2550821151', 'https://openalex.org/W2880875857', 'https://openalex.org/W2891555348', 'https://openalex.org/W2896457183', 'https://openalex.org/W2905933322', 'https://openalex.org/W2914120296', 'https://openalex.org/W2915128308', 'https://openalex.org/W2915429162', 'https://openalex.org/W2923014074', 'https://openalex.org/W2948017315', 'https://openalex.org/W2948384082', 'https://openalex.org/W2952087486', 'https://openalex.org/W2952650870', 'https://openalex.org/W2958953787', 'https://openalex.org/W2962369866', 'https://openalex.org/W2962739339', 'https://openalex.org/W2963250244', 'https://openalex.org/W2963310665', 'https://openalex.org/W2963323070', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963626623', 'https://openalex.org/W2963667932', 'https://openalex.org/W2963748441', 'https://openalex.org/W2963846996', 'https://openalex.org/W2963979492', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970854433', 'https://openalex.org/W2971207485', 'https://openalex.org/W2971863715', 'https://openalex.org/W2989539713', 'https://openalex.org/W2998653650', 'https://openalex.org/W3032816972', 'https://openalex.org/W3035497479', 'https://openalex.org/W3035547806', 'https://openalex.org/W3082274269', 'https://openalex.org/W4288089799', 'https://openalex.org/W4294170691', 'https://openalex.org/W4297801177', 'https://openalex.org/W4385245566'], 'related_works': ['https://openalex.org/W4324271173', 'https://openalex.org/W3118638206', 'https://openalex.org/W2795079307', 'https://openalex.org/W2793058541', 'https://openalex.org/W2352227742', 'https://openalex.org/W2062484128', 'https://openalex.org/W2062195135', 'https://openalex.org/W1983629434', 'https://openalex.org/W1967645776', 'https://openalex.org/W1480923359'], 'abstract_inverted_index': {'Alexis': [0], 'Conneau,': [1], 'Kartikay': [2], 'Khandelwal,': [3], 'Naman': [4], 'Goyal,': [5], 'Vishrav': [6], 'Chaudhary,': [7], 'Guillaume': [8], 'Wenzek,': [9], 'Francisco': [10], 'Guzmán,': [11], 'Edouard': [12], 'Grave,': [13], 'Myle': [14], 'Ott,': [15], 'Luke': [16], 'Zettlemoyer,': [17], 'Veselin': [18], 'Stoyanov.': [19], 'Proceedings': [20], 'of': [21, 26], 'the': [22, 27], '58th': [23], 'Annual': [24], 'Meeting': [25], 'Association': [28], 'for': [29], 'Computational': [30], 'Linguistics.': [31], '2020.': [32]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3035390927', 'counts_by_year': [{'year': 2024, 'cited_by_count': 492}, {'year': 2023, 'cited_by_count': 1247}, {'year': 2022, 'cited_by_count': 879}, {'year': 2021, 'cited_by_count': 957}, {'year': 2020, 'cited_by_count': 323}, {'year': 2019, 'cited_by_count': 3}, {'year': 2018, 'cited_by_count': 1}], 'updated_date': '2025-01-08T12:45:59.201056', 'created_date': '2020-06-19'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
