BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla

Name: BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla
Uploaded: 2022-01-01
Description: Abhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, Kazi Samin Mubasshir, Md Saiful Islam, Anindya Iqbal, M. Sohel Rahman, Rifat Shahriyar. Findings of the Association for Computational Linguistics: NAACL 2022. 2022.
Abhik Bhattacharjee; Tahmid Hasan; Wasi Uddin Ahmad; Kazi Samin Mubasshir; Md. Saiful Islam; Anindya Iqbal; M. Sohel Rahman; Rifat Shahriyar
{'id': 'https://openalex.org/W4287888679', 'doi': 'https://doi.org/10.18653/v1/2022.findings-naacl.98', 'title': 'BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla', 'display_name': 'BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla', 'publication_year': 2022, 'publication_date': '2022-01-01', 'ids': {'openalex': 'https://openalex.org/W4287888679', 'doi': 'https://doi.org/10.18653/v1/2022.findings-naacl.98'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-naacl.98', 'pdf_url': 'https://aclanthology.org/2022.findings-naacl.98.pdf', 'source': {'id': 'https://openalex.org/S4363605604', 'display_name': 'Findings of the Association for Computational Linguistics: NAACL 2022', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2022.findings-naacl.98.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5015510710', 'display_name': 'Abhik Bhattacharjee', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Abhik Bhattacharjee', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5069644647', 'display_name': 'Tahmid Hasan', 'orcid': 'https://orcid.org/0000-0003-2748-5098'}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': True, 'raw_author_name': 'Tahmid Hasan', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5103968040', 'display_name': 'Wasi Uddin Ahmad', 'orcid': 'https://orcid.org/0000-0001-8171-9583'}, 'institutions': [{'id': 'https://openalex.org/I183697816', 'display_name': 'Bangladesh University of Engineering and Technology', 'ror': 'https://ror.org/05a1qpv97', 'country_code': 'BD', 'type': 'education', 'lineage': ['https://openalex.org/I183697816']}], 'countries': ['BD'], 'is_corresponding': False, 'raw_author_name': 'Wasi Ahmad', 'raw_affiliation_strings': ['Bangladesh University of Engineering and Technology (BUET)'], 'affiliations': [{'raw_affiliation_string': 'Bangladesh University of Engineering and Technology (BUET)', 'institution_ids': ['https://openalex.org/I183697816']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5006899349', 'display_name': 'Kazi Samin Mubasshir', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Kazi Samin Mubasshir', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100420857', 'display_name': 'Md. Saiful Islam', 'orcid': 'https://orcid.org/0000-0003-3725-3493'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Md Saiful Islam', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5027377957', 'display_name': 'Anindya Iqbal', 'orcid': 'https://orcid.org/0000-0002-2763-8819'}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Anindya Iqbal', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5104083661', 'display_name': 'M. Sohel Rahman', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'M. Sohel Rahman', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5090604535', 'display_name': 'Rifat Shahriyar', 'orcid': 'https://orcid.org/0000-0001-9540-315X'}, 'institutions': [{'id': 'https://openalex.org/I5388228', 'display_name': 'University of Rochester', 'ror': 'https://ror.org/022kthw22', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I5388228']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Rifat Shahriyar', 'raw_affiliation_strings': [', AWS AI Labs 2 , University of Rochester'], 'affiliations': [{'raw_affiliation_string': ', AWS AI Labs 2 , University of Rochester', 'institution_ids': ['https://openalex.org/I5388228']}]}], 'institution_assertions': [], 'countries_distinct_count': 2, 'institutions_distinct_count': 2, 'corresponding_author_ids': ['https://openalex.org/A5069644647'], 'corresponding_institution_ids': ['https://openalex.org/I5388228'], 'apc_list': None, 'apc_paid': None, 'fwci': 17.282, 'has_fulltext': False, 'cited_by_count': 75, 'citation_normalized_percentile': {'value': 0.999873, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 99, 'max': 100}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Statistical Machine Translation and Natural Language Processing', 'score': 0.9697, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Statistical Machine Translation and Natural Language Processing', 'score': 0.9697, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/language-modeling', 'display_name': 'Language Modeling', 'score': 0.557161}, {'id': 'https://openalex.org/keywords/syntax-based-translation-models', 'display_name': 'Syntax-based Translation Models', 'score': 0.535133}], 'concepts': [{'id': 'https://openalex.org/C19235068', 'wikidata': 'https://www.wikidata.org/wiki/Q9610', 'display_name': 'Bengali', 'level': 2, 'score': 0.8565886}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.7700579}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.52051204}, {'id': 'https://openalex.org/C206345919', 'wikidata': 'https://www.wikidata.org/wiki/Q20380951', 'display_name': 'Resource (disambiguation)', 'level': 2, 'score': 0.4537804}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.41646984}, {'id': 'https://openalex.org/C31258907', 'wikidata': 'https://www.wikidata.org/wiki/Q1301371', 'display_name': 'Computer network', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-naacl.98', 'pdf_url': 'https://aclanthology.org/2022.findings-naacl.98.pdf', 'source': {'id': 'https://openalex.org/S4363605604', 'display_name': 'Findings of the Association for Computational Linguistics: NAACL 2022', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'http://arxiv.org/abs/2101.00204', 'pdf_url': 'http://arxiv.org/pdf/2101.00204', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-naacl.98', 'pdf_url': 'https://aclanthology.org/2022.findings-naacl.98.pdf', 'source': {'id': 'https://openalex.org/S4363605604', 'display_name': 'Findings of the Association for Computational Linguistics: NAACL 2022', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'score': 0.58, 'id': 'https://metadata.un.org/sdg/4', 'display_name': 'Quality education'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 49, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1566289585', 'https://openalex.org/W2061272101', 'https://openalex.org/W222053410', 'https://openalex.org/W2251939518', 'https://openalex.org/W2525778437', 'https://openalex.org/W2591259438', 'https://openalex.org/W2891555348', 'https://openalex.org/W2902736485', 'https://openalex.org/W2902800387', 'https://openalex.org/W2903101678', 'https://openalex.org/W2914120296', 'https://openalex.org/W2915977242', 'https://openalex.org/W2923014074', 'https://openalex.org/W2948902769', 'https://openalex.org/W2963026768', 'https://openalex.org/W2963323070', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963626623', 'https://openalex.org/W2963846996', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970597249', 'https://openalex.org/W2971120622', 'https://openalex.org/W2973088264', 'https://openalex.org/W2989539713', 'https://openalex.org/W2990188683', 'https://openalex.org/W2995230342', 'https://openalex.org/W2996428491', 'https://openalex.org/W3008110149', 'https://openalex.org/W3011411500', 'https://openalex.org/W3013836620', 'https://openalex.org/W3035032094', 'https://openalex.org/W3035390927', 'https://openalex.org/W3038047279', 'https://openalex.org/W3045462440', 'https://openalex.org/W3099919888', 'https://openalex.org/W3103187652', 'https://openalex.org/W3104688854', 'https://openalex.org/W3162296828', 'https://openalex.org/W3170705121', 'https://openalex.org/W3174269049', 'https://openalex.org/W3198897702', 'https://openalex.org/W3212697960', 'https://openalex.org/W4287116725', 'https://openalex.org/W4287760320', 'https://openalex.org/W4287824654', 'https://openalex.org/W4294294857', 'https://openalex.org/W4299574851', 'https://openalex.org/W4385681388'], 'related_works': ['https://openalex.org/W4382933960', 'https://openalex.org/W4313156585', 'https://openalex.org/W4205316385', 'https://openalex.org/W3204019825', 'https://openalex.org/W3192589309', 'https://openalex.org/W3105168542', 'https://openalex.org/W2973887018', 'https://openalex.org/W2963364170', 'https://openalex.org/W2028401451', 'https://openalex.org/W147166030'], 'abstract_inverted_index': {'Abhik': [0], 'Bhattacharjee,': [1], 'Tahmid': [2], 'Hasan,': [3], 'Wasi': [4], 'Ahmad,': [5], 'Kazi': [6], 'Samin': [7], 'Mubasshir,': [8], 'Md': [9], 'Saiful': [10], 'Islam,': [11], 'Anindya': [12], 'Iqbal,': [13], 'M.': [14], 'Sohel': [15], 'Rahman,': [16], 'Rifat': [17], 'Shahriyar.': [18], 'Findings': [19], 'of': [20], 'the': [21], 'Association': [22], 'for': [23], 'Computational': [24], 'Linguistics:': [25], 'NAACL': [26], '2022.': [27, 28]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W4287888679', 'counts_by_year': [{'year': 2024, 'cited_by_count': 14}, {'year': 2023, 'cited_by_count': 56}, {'year': 2022, 'cited_by_count': 3}], 'updated_date': '2024-09-18T16:27:49.260219', 'created_date': '2022-07-26'}
Publication Information

Video

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
