Towards Efficient NLP: A Standard Evaluation and A Strong Baseline

Name: Work Video:
Duration: 3 min 30 s
Description: Xiangyang Liu, Tianxiang Sun, Junliang He, Jiawen Wu, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Xiangyang Liu; Tianxiang Sun; Junliang He; Jiawen Wu; Lingling Wu; Xinyu Zhang; Hao Jiang; Zhao Cao; Xuanjing Huang; Xipeng Qiu
{'id': 'https://openalex.org/W3207878700', 'doi': 'https://doi.org/10.18653/v1/2022.naacl-main.240', 'title': 'Towards Efficient NLP: A Standard Evaluation and A Strong Baseline', 'display_name': 'Towards Efficient NLP: A Standard Evaluation and A Strong Baseline', 'publication_year': 2022, 'publication_date': '2022-01-01', 'ids': {'openalex': 'https://openalex.org/W3207878700', 'doi': 'https://doi.org/10.18653/v1/2022.naacl-main.240', 'mag': '3207878700'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.naacl-main.240', 'pdf_url': 'https://aclanthology.org/2022.naacl-main.240.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2022.naacl-main.240.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5100341810', 'display_name': 'Xiangyang Liu', 'orcid': 'https://orcid.org/0000-0003-0698-4162'}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Xiangyang Liu', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5058308999', 'display_name': 'Tianxiang Sun', 'orcid': 'https://orcid.org/0000-0001-8291-820X'}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Tianxiang Sun', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101200297', 'display_name': 'Junliang He', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Junliang He', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5072558594', 'display_name': 'Jiawen Wu', 'orcid': 'https://orcid.org/0000-0001-7448-3605'}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Jiawen Wu', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101534682', 'display_name': 'Lingling Wu', 'orcid': 'https://orcid.org/0000-0002-5051-5040'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Lingling Wu', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100390704', 'display_name': 'Xinyu Zhang', 'orcid': 'https://orcid.org/0000-0002-6829-4522'}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Xinyu Zhang', 'raw_affiliation_strings': ['Huawei Poisson Lab', 'School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Huawei Poisson Lab', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5002846606', 'display_name': 'Hao Jiang', 'orcid': 'https://orcid.org/0000-0002-2306-7596'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Hao Jiang', 'raw_affiliation_strings': ['Huawei Poisson Lab'], 'affiliations': [{'raw_affiliation_string': 'Huawei Poisson Lab', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5000560558', 'display_name': 'Zhao Cao', 'orcid': 'https://orcid.org/0000-0001-7648-0184'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Zhao Cao', 'raw_affiliation_strings': ['Huawei Poisson Lab'], 'affiliations': [{'raw_affiliation_string': 'Huawei Poisson Lab', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5111113722', 'display_name': 'Xuanjing Huang', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Xuanjing Huang', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5044665993', 'display_name': 'Xipeng Qiu', 'orcid': 'https://orcid.org/0000-0001-7163-5247'}, 'institutions': [{'id': 'https://openalex.org/I24943067', 'display_name': 'Fudan University', 'ror': 'https://ror.org/013q1eq08', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I24943067']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Xipeng Qiu', 'raw_affiliation_strings': ['School of Computer Science, Fudan University', 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University'], 'affiliations': [{'raw_affiliation_string': 'School of Computer Science, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}, {'raw_affiliation_string': 'Shanghai Key Laboratory of Intelligent Information Processing, Fudan University', 'institution_ids': ['https://openalex.org/I24943067']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 1, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 1.285, 'has_fulltext': False, 'cited_by_count': 8, 'citation_normalized_percentile': {'value': 0.999875, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 88, 'max': 90}, 'biblio': {'volume': None, 'issue': None, 'first_page': '3288', 'last_page': '3303'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9998, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9733, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/zhàng', 'display_name': 'Zhàng', 'score': 0.8381448}, {'id': 'https://openalex.org/keywords/baseline', 'display_name': 'Baseline (sea)', 'score': 0.64244187}, {'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.51208806}], 'concepts': [{'id': 'https://openalex.org/C2777045944', 'wikidata': 'https://www.wikidata.org/wiki/Q12170198', 'display_name': 'Zhàng', 'level': 3, 'score': 0.8381448}, {'id': 'https://openalex.org/C12725497', 'wikidata': 'https://www.wikidata.org/wiki/Q810247', 'display_name': 'Baseline (sea)', 'level': 2, 'score': 0.64244187}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.604476}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.59230644}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.5721383}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.51208806}, {'id': 'https://openalex.org/C203005215', 'wikidata': 'https://www.wikidata.org/wiki/Q79798', 'display_name': 'Machine translation', 'level': 2, 'score': 0.43926176}, {'id': 'https://openalex.org/C95457728', 'wikidata': 'https://www.wikidata.org/wiki/Q309', 'display_name': 'History', 'level': 0, 'score': 0.17671615}, {'id': 'https://openalex.org/C191935318', 'wikidata': 'https://www.wikidata.org/wiki/Q148', 'display_name': 'China', 'level': 2, 'score': 0.16333997}, {'id': 'https://openalex.org/C17744445', 'wikidata': 'https://www.wikidata.org/wiki/Q36442', 'display_name': 'Political science', 'level': 0, 'score': 0.08245775}, {'id': 'https://openalex.org/C166957645', 'wikidata': 'https://www.wikidata.org/wiki/Q23498', 'display_name': 'Archaeology', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C199539241', 'wikidata': 'https://www.wikidata.org/wiki/Q7748', 'display_name': 'Law', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.naacl-main.240', 'pdf_url': 'https://aclanthology.org/2022.naacl-main.240.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2110.07038', 'pdf_url': 'https://arxiv.org/pdf/2110.07038', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.naacl-main.240', 'pdf_url': 'https://aclanthology.org/2022.naacl-main.240.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'id': 'https://metadata.un.org/sdg/4', 'score': 0.79, 'display_name': 'Quality education'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 80, 'referenced_works': ['https://openalex.org/W131533222', 'https://openalex.org/W1522301498', 'https://openalex.org/W1549825062', 'https://openalex.org/W1566289585', 'https://openalex.org/W1840435438', 'https://openalex.org/W2113459411', 'https://openalex.org/W2242818861', 'https://openalex.org/W2251939518', 'https://openalex.org/W2325237720', 'https://openalex.org/W2788496822', 'https://openalex.org/W2790235966', 'https://openalex.org/W2809324505', 'https://openalex.org/W2866343820', 'https://openalex.org/W2889787757', 'https://openalex.org/W2893578842', 'https://openalex.org/W2908510526', 'https://openalex.org/W2923014074', 'https://openalex.org/W2943552823', 'https://openalex.org/W2953384591', 'https://openalex.org/W2963310665', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963748441', 'https://openalex.org/W2963846996', 'https://openalex.org/W2964072166', 'https://openalex.org/W2964121744', 'https://openalex.org/W2964165804', 'https://openalex.org/W2965373594', 'https://openalex.org/W2969601108', 'https://openalex.org/W2970454332', 'https://openalex.org/W2970597249', 'https://openalex.org/W2970971581', 'https://openalex.org/W2973727699', 'https://openalex.org/W2975381464', 'https://openalex.org/W2978017171', 'https://openalex.org/W2979826702', 'https://openalex.org/W2981757109', 'https://openalex.org/W2981812042', 'https://openalex.org/W2990704537', 'https://openalex.org/W2995983533', 'https://openalex.org/W2996159613', 'https://openalex.org/W2996428491', 'https://openalex.org/W2998183051', 'https://openalex.org/W3011574394', 'https://openalex.org/W3034292689', 'https://openalex.org/W3034457371', 'https://openalex.org/W3035030897', 'https://openalex.org/W3035038672', 'https://openalex.org/W3038012435', 'https://openalex.org/W3082274269', 'https://openalex.org/W3088409176', 'https://openalex.org/W3098824823', 'https://openalex.org/W3098903812', 'https://openalex.org/W3101163004', 'https://openalex.org/W3101248447', 'https://openalex.org/W3103682594', 'https://openalex.org/W3104033643', 'https://openalex.org/W3105966348', 'https://openalex.org/W3114651185', 'https://openalex.org/W3114916066', 'https://openalex.org/W3118423943', 'https://openalex.org/W3121592593', 'https://openalex.org/W3154971029', 'https://openalex.org/W3165511581', 'https://openalex.org/W3170113752', 'https://openalex.org/W3171649327', 'https://openalex.org/W3171654528', 'https://openalex.org/W3174461835', 'https://openalex.org/W3176017841', 'https://openalex.org/W3186655327', 'https://openalex.org/W3196295870', 'https://openalex.org/W3202031169', 'https://openalex.org/W3211899209', 'https://openalex.org/W3213805780', 'https://openalex.org/W4287165195', 'https://openalex.org/W4288089799', 'https://openalex.org/W4292779060', 'https://openalex.org/W4293350112', 'https://openalex.org/W4295312788', 'https://openalex.org/W4385245566'], 'related_works': ['https://openalex.org/W4386247111', 'https://openalex.org/W4327642362', 'https://openalex.org/W3107474891', 'https://openalex.org/W2775554247', 'https://openalex.org/W2587014613', 'https://openalex.org/W2389678104', 'https://openalex.org/W2375840727', 'https://openalex.org/W2364559953', 'https://openalex.org/W2250213760', 'https://openalex.org/W2110168585'], 'abstract_inverted_index': {'Xiangyang': [0], 'Liu,': [1], 'Tianxiang': [2], 'Sun,': [3], 'Junliang': [4], 'He,': [5], 'Jiawen': [6], 'Wu,': [7, 9], 'Lingling': [8], 'Xinyu': [10], 'Zhang,': [11], 'Hao': [12], 'Jiang,': [13], 'Zhao': [14], 'Cao,': [15], 'Xuanjing': [16], 'Huang,': [17], 'Xipeng': [18], 'Qiu.': [19], 'Proceedings': [20], 'of': [21, 25, 30], 'the': [22, 26, 31], '2022': [23], 'Conference': [24], 'North': [27], 'American': [28], 'Chapter': [29], 'Association': [32], 'for': [33], 'Computational': [34], 'Linguistics:': [35], 'Human': [36], 'Language': [37], 'Technologies.': [38], '2022.': [39]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3207878700', 'counts_by_year': [{'year': 2024, 'cited_by_count': 2}, {'year': 2023, 'cited_by_count': 4}, {'year': 2022, 'cited_by_count': 1}], 'updated_date': '2024-12-25T18:25:58.919190', 'created_date': '2021-10-25'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
