Noise Stability Regularization for Improving BERT Fine-tuning

Name: Work Video:
Duration: 3 min 30 s
Description: Hang Hua, Xingjian Li, Dejing Dou, Chengzhong Xu, Jiebo Luo. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.
Hang Hua; Xingjian Li; Dejing Dou; Cheng‐Zhong Xu; Jiebo Luo
{'id': 'https://openalex.org/W3172318343', 'doi': 'https://doi.org/10.18653/v1/2021.naacl-main.258', 'title': 'Noise Stability Regularization for Improving BERT Fine-tuning', 'display_name': 'Noise Stability Regularization for Improving BERT Fine-tuning', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3172318343', 'doi': 'https://doi.org/10.18653/v1/2021.naacl-main.258', 'mag': '3172318343'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.naacl-main.258', 'pdf_url': 'https://aclanthology.org/2021.naacl-main.258.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.naacl-main.258.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5102027020', 'display_name': 'Hang Hua', 'orcid': 'https://orcid.org/0000-0002-5441-5776'}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Hang Hua', 'raw_affiliation_strings': ['University of Rochester, Rochester, NY, USA'], 'affiliations': [{'raw_affiliation_string': 'University of Rochester, Rochester, NY, USA', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100770663', 'display_name': 'Xingjian Li', 'orcid': 'https://orcid.org/0000-0001-8073-7552'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}, {'id': 'https://openalex.org/I204512498', 'display_name': 'University of Macau', 'ror': 'https://ror.org/01r4q9n85', 'country_code': 'MO', 'type': 'education', 'lineage': ['https://openalex.org/I204512498']}], 'countries': ['CN', 'MO'], 'is_corresponding': False, 'raw_author_name': 'Xingjian Li', 'raw_affiliation_strings': ['Big Data Lab, Baidu Research, Beijing, China', 'Department of Computer Science, University of Macau, Macau, China'], 'affiliations': [{'raw_affiliation_string': 'Big Data Lab, Baidu Research, Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}, {'raw_affiliation_string': 'Department of Computer Science, University of Macau, Macau, China', 'institution_ids': ['https://openalex.org/I204512498']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5021332177', 'display_name': 'Dejing Dou', 'orcid': 'https://orcid.org/0000-0003-2949-6874'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Dejing Dou', 'raw_affiliation_strings': ['Big Data Lab, Baidu Research, Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Big Data Lab, Baidu Research, Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5012773300', 'display_name': 'Cheng‐Zhong Xu', 'orcid': 'https://orcid.org/0000-0001-9480-0356'}, 'institutions': [{'id': 'https://openalex.org/I204512498', 'display_name': 'University of Macau', 'ror': 'https://ror.org/01r4q9n85', 'country_code': 'MO', 'type': 'education', 'lineage': ['https://openalex.org/I204512498']}], 'countries': ['MO'], 'is_corresponding': False, 'raw_author_name': 'Chengzhong Xu', 'raw_affiliation_strings': ['Department of Computer Science, University of Macau, Macau, China'], 'affiliations': [{'raw_affiliation_string': 'Department of Computer Science, University of Macau, Macau, China', 'institution_ids': ['https://openalex.org/I204512498']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5055469774', 'display_name': 'Jiebo Luo', 'orcid': 'https://orcid.org/0000-0002-4516-9729'}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Jiebo Luo', 'raw_affiliation_strings': ['University of Rochester, Rochester, NY, USA'], 'affiliations': [{'raw_affiliation_string': 'University of Rochester, Rochester, NY, USA', 'institution_ids': ['https://openalex.org/I5388228']}]}], 'institution_assertions': [], 'countries_distinct_count': 3, 'institutions_distinct_count': 3, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 2.441, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 24, 'citation_normalized_percentile': {'value': 0.999914, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 94, 'max': 95}, 'biblio': {'volume': None, 'issue': None, 'first_page': '3229', 'last_page': '3241'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9993, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10201', 'display_name': 'Speech Recognition and Synthesis', 'score': 0.997, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/regularization', 'display_name': 'Regularization', 'score': 0.6966649}, {'id': 'https://openalex.org/keywords/hang', 'display_name': 'Hang', 'score': 0.4596154}], 'concepts': [{'id': 'https://openalex.org/C2776135515', 'wikidata': 'https://www.wikidata.org/wiki/Q17143721', 'display_name': 'Regularization (linguistics)', 'level': 2, 'score': 0.6966649}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5439333}, {'id': 'https://openalex.org/C2781323245', 'wikidata': 'https://www.wikidata.org/wiki/Q1363761', 'display_name': 'Hang', 'level': 2, 'score': 0.4596154}, {'id': 'https://openalex.org/C112972136', 'wikidata': 'https://www.wikidata.org/wiki/Q7595718', 'display_name': 'Stability (learning theory)', 'level': 2, 'score': 0.42578337}, {'id': 'https://openalex.org/C99498987', 'wikidata': 'https://www.wikidata.org/wiki/Q2210247', 'display_name': 'Noise (video)', 'level': 3, 'score': 0.42434818}, {'id': 'https://openalex.org/C28490314', 'wikidata': 'https://www.wikidata.org/wiki/Q189436', 'display_name': 'Speech recognition', 'level': 1, 'score': 0.39626735}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.303357}, {'id': 'https://openalex.org/C119857082', 'wikidata': 'https://www.wikidata.org/wiki/Q2539', 'display_name': 'Machine learning', 'level': 1, 'score': 0.13598228}, {'id': 'https://openalex.org/C111919701', 'wikidata': 'https://www.wikidata.org/wiki/Q9135', 'display_name': 'Operating system', 'level': 1, 'score': 0.0697985}, {'id': 'https://openalex.org/C115961682', 'wikidata': 'https://www.wikidata.org/wiki/Q860623', 'display_name': 'Image (mathematics)', 'level': 2, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.naacl-main.258', 'pdf_url': 'https://aclanthology.org/2021.naacl-main.258.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2107.04835', 'pdf_url': 'https://arxiv.org/pdf/2107.04835', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.naacl-main.258', 'pdf_url': 'https://aclanthology.org/2021.naacl-main.258.pdf', 'source': {'id': 'https://openalex.org/S4363608774', 'display_name': 'Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'score': 0.74, 'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 76, 'referenced_works': ['https://openalex.org/W131533222', 'https://openalex.org/W1522301498', 'https://openalex.org/W1690739335', 'https://openalex.org/W1821462560', 'https://openalex.org/W1840435438', 'https://openalex.org/W1980290744', 'https://openalex.org/W2076118331', 'https://openalex.org/W2095705004', 'https://openalex.org/W2100341991', 'https://openalex.org/W2109553965', 'https://openalex.org/W2111406701', 'https://openalex.org/W2117499988', 'https://openalex.org/W2130158090', 'https://openalex.org/W2138857742', 'https://openalex.org/W2153579005', 'https://openalex.org/W2250539671', 'https://openalex.org/W2396767181', 'https://openalex.org/W2561238782', 'https://openalex.org/W2618017917', 'https://openalex.org/W2732724430', 'https://openalex.org/W2786622092', 'https://openalex.org/W2788496822', 'https://openalex.org/W2896457183', 'https://openalex.org/W2898700502', 'https://openalex.org/W2908510526', 'https://openalex.org/W2914120296', 'https://openalex.org/W2923014074', 'https://openalex.org/W2924690340', 'https://openalex.org/W2943552823', 'https://openalex.org/W2948695030', 'https://openalex.org/W2949667497', 'https://openalex.org/W2952729433', 'https://openalex.org/W2962739339', 'https://openalex.org/W2963236897', 'https://openalex.org/W2963310665', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963664410', 'https://openalex.org/W2963739978', 'https://openalex.org/W2964118293', 'https://openalex.org/W2964121744', 'https://openalex.org/W2964186069', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970597249', 'https://openalex.org/W2975185270', 'https://openalex.org/W2978670439', 'https://openalex.org/W2980282514', 'https://openalex.org/W2984582583', 'https://openalex.org/W2990704537', 'https://openalex.org/W2994928925', 'https://openalex.org/W2995998574', 'https://openalex.org/W2996428491', 'https://openalex.org/W2996580933', 'https://openalex.org/W3005700362', 'https://openalex.org/W3006381853', 'https://openalex.org/W3006647218', 'https://openalex.org/W3007672467', 'https://openalex.org/W3007685714', 'https://openalex.org/W3034199299', 'https://openalex.org/W3034850762', 'https://openalex.org/W3035204084', 'https://openalex.org/W3104033643', 'https://openalex.org/W3120490999', 'https://openalex.org/W3122924117', 'https://openalex.org/W3126074026', 'https://openalex.org/W3127622310', 'https://openalex.org/W4253067820', 'https://openalex.org/W4287614078', 'https://openalex.org/W4287692509', 'https://openalex.org/W4287867774', 'https://openalex.org/W4294170691', 'https://openalex.org/W4299518610', 'https://openalex.org/W4313908941', 'https://openalex.org/W4322614701', 'https://openalex.org/W4385245566', 'https://openalex.org/W4919037'], 'related_works': ['https://openalex.org/W4389446539', 'https://openalex.org/W4253808407', 'https://openalex.org/W4252592614', 'https://openalex.org/W4212913504', 'https://openalex.org/W2429440904', 'https://openalex.org/W2352750813', 'https://openalex.org/W2167428716', 'https://openalex.org/W2128812668', 'https://openalex.org/W2100596841', 'https://openalex.org/W2002376734'], 'abstract_inverted_index': {'Hang': [0], 'Hua,': [1], 'Xingjian': [2], 'Li,': [3], 'Dejing': [4], 'Dou,': [5], 'Chengzhong': [6], 'Xu,': [7], 'Jiebo': [8], 'Luo.': [9], 'Proceedings': [10], 'of': [11, 15, 20], 'the': [12, 16, 21], '2021': [13], 'Conference': [14], 'North': [17], 'American': [18], 'Chapter': [19], 'Association': [22], 'for': [23], 'Computational': [24], 'Linguistics:': [25], 'Human': [26], 'Language': [27], 'Technologies.': [28], '2021.': [29]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3172318343', 'counts_by_year': [{'year': 2024, 'cited_by_count': 6}, {'year': 2023, 'cited_by_count': 10}, {'year': 2022, 'cited_by_count': 3}, {'year': 2021, 'cited_by_count': 5}], 'updated_date': '2024-12-12T22:06:22.731704', 'created_date': '2021-06-22'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
