Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates

Name: Work Video:
Duration: 3 min 30 s
Description: Artem Shelmanov, Dmitri Puzyrev, Lyubov Kupriyanova, Denis Belyakov, Daniil Larionov, Nikita Khromov, Olga Kozlova, Ekaterina Artemova, Dmitry V. Dylov, Alexander Panchenko. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. 2021.
Artem Shelmanov; Dmitri Puzyrev; Lyubov Kupriyanova; Denis Belyakov; Daniil Larionov; Nikita Khromov; Olga Kozlova; Ekaterina Artemova; Dmitry V. Dylov; Alexander Panchenko
{'id': 'https://openalex.org/W3156031277', 'doi': 'https://doi.org/10.18653/v1/2021.eacl-main.145', 'title': 'Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates', 'display_name': 'Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates', 'publication_year': 2021, 'publication_date': '2021-01-01', 'ids': {'openalex': 'https://openalex.org/W3156031277', 'doi': 'https://doi.org/10.18653/v1/2021.eacl-main.145', 'mag': '3156031277'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.145', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.145.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2021.eacl-main.145.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5071397402', 'display_name': 'Artem Shelmanov', 'orcid': 'https://orcid.org/0000-0002-2151-6212'}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Artem Shelmanov', 'raw_affiliation_strings': ['Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5000913080', 'display_name': 'Dmitri Puzyrev', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}, {'id': 'https://openalex.org/I118501908', 'display_name': 'National Research University Higher School of Economics', 'ror': 'https://ror.org/055f7t516', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I118501908']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Dmitri Puzyrev', 'raw_affiliation_strings': ['Higher School of Economics University, Russia', 'Mobile TeleSystems (MTS), Russia', 'Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Mobile TeleSystems (MTS), Russia', 'institution_ids': []}, {'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}, {'raw_affiliation_string': 'Higher School of Economics University, Russia', 'institution_ids': ['https://openalex.org/I118501908']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5069886417', 'display_name': 'Lyubov Kupriyanova', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Lyubov Kupriyanova', 'raw_affiliation_strings': ['Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5026342524', 'display_name': 'Denis Belyakov', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I118501908', 'display_name': 'National Research University Higher School of Economics', 'ror': 'https://ror.org/055f7t516', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I118501908']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Denis Belyakov', 'raw_affiliation_strings': ['Higher School of Economics University, Russia'], 'affiliations': [{'raw_affiliation_string': 'Higher School of Economics University, Russia', 'institution_ids': ['https://openalex.org/I118501908']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5041363906', 'display_name': 'Daniil Larionov', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I118501908', 'display_name': 'National Research University Higher School of Economics', 'ror': 'https://ror.org/055f7t516', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I118501908']}, {'id': 'https://openalex.org/I1313323035', 'display_name': 'Russian Academy of Sciences', 'ror': 'https://ror.org/05qrfxd25', 'country_code': 'RU', 'type': 'government', 'lineage': ['https://openalex.org/I1313323035']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Daniil Larionov', 'raw_affiliation_strings': ['Federal Research Center "Computer Science and Control" of Russian Academy of Sciences', 'Higher School of Economics University, Russia', 'Mobile TeleSystems (MTS), Russia'], 'affiliations': [{'raw_affiliation_string': 'Higher School of Economics University, Russia', 'institution_ids': ['https://openalex.org/I118501908']}, {'raw_affiliation_string': 'Mobile TeleSystems (MTS), Russia', 'institution_ids': []}, {'raw_affiliation_string': 'Federal Research Center "Computer Science and Control" of Russian Academy of Sciences', 'institution_ids': ['https://openalex.org/I1313323035']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5038995644', 'display_name': 'Nikita Khromov', 'orcid': 'https://orcid.org/0000-0001-5603-6174'}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Nikita Khromov', 'raw_affiliation_strings': ['Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5019849300', 'display_name': 'Olga Kozlova', 'orcid': 'https://orcid.org/0000-0002-5974-0228'}, 'institutions': [], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Olga Kozlova', 'raw_affiliation_strings': ['Mobile TeleSystems (MTS), Russia'], 'affiliations': [{'raw_affiliation_string': 'Mobile TeleSystems (MTS), Russia', 'institution_ids': []}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5071539494', 'display_name': 'Ekaterina Artemova', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I118501908', 'display_name': 'National Research University Higher School of Economics', 'ror': 'https://ror.org/055f7t516', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I118501908']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Ekaterina Artemova', 'raw_affiliation_strings': ['Higher School of Economics University, Russia'], 'affiliations': [{'raw_affiliation_string': 'Higher School of Economics University, Russia', 'institution_ids': ['https://openalex.org/I118501908']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5031517308', 'display_name': 'Dmitry V. Dylov', 'orcid': 'https://orcid.org/0000-0003-2251-3221'}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Dmitry V. Dylov', 'raw_affiliation_strings': ['Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5026157285', 'display_name': 'Alexander Panchenko', 'orcid': 'https://orcid.org/0000-0001-6097-6118'}, 'institutions': [{'id': 'https://openalex.org/I125989756', 'display_name': 'Skolkovo Institute of Science and Technology', 'ror': 'https://ror.org/03f9nc143', 'country_code': 'RU', 'type': 'funder', 'lineage': ['https://openalex.org/I125989756']}], 'countries': ['RU'], 'is_corresponding': False, 'raw_author_name': 'Alexander Panchenko', 'raw_affiliation_strings': ['Skolkovo Institute of Science and Technology, Russia'], 'affiliations': [{'raw_affiliation_string': 'Skolkovo Institute of Science and Technology, Russia', 'institution_ids': ['https://openalex.org/I125989756']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 3, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 2.079, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 21, 'citation_normalized_percentile': {'value': 0.832635, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 93, 'max': 94}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9986, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9986, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T12072', 'display_name': 'Machine Learning and Algorithms', 'score': 0.9983, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9981, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/sequence', 'display_name': 'Sequence (biology)', 'score': 0.61336434}], 'concepts': [{'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.7069487}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.6889354}, {'id': 'https://openalex.org/C2778112365', 'wikidata': 'https://www.wikidata.org/wiki/Q3511065', 'display_name': 'Sequence (biology)', 'level': 2, 'score': 0.61336434}, {'id': 'https://openalex.org/C107673813', 'wikidata': 'https://www.wikidata.org/wiki/Q812534', 'display_name': 'Bayesian probability', 'level': 2, 'score': 0.5908283}, {'id': 'https://openalex.org/C119857082', 'wikidata': 'https://www.wikidata.org/wiki/Q2539', 'display_name': 'Machine learning', 'level': 1, 'score': 0.51179594}, {'id': 'https://openalex.org/C108583219', 'wikidata': 'https://www.wikidata.org/wiki/Q197536', 'display_name': 'Deep learning', 'level': 2, 'score': 0.4771254}, {'id': 'https://openalex.org/C86803240', 'wikidata': 'https://www.wikidata.org/wiki/Q420', 'display_name': 'Biology', 'level': 0, 'score': 0.0}, {'id': 'https://openalex.org/C54355233', 'wikidata': 'https://www.wikidata.org/wiki/Q7162', 'display_name': 'Genetics', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.145', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.145.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2101.08133', 'pdf_url': 'https://arxiv.org/pdf/2101.08133', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_indexed_in_scopus': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2021.eacl-main.145', 'pdf_url': 'https://aclanthology.org/2021.eacl-main.145.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'id': 'https://metadata.un.org/sdg/4', 'display_name': 'Quality education', 'score': 0.61}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 49, 'referenced_works': ['https://openalex.org/W1821462560', 'https://openalex.org/W1872312298', 'https://openalex.org/W2064675550', 'https://openalex.org/W2085989833', 'https://openalex.org/W2103076621', 'https://openalex.org/W2144578941', 'https://openalex.org/W2147880316', 'https://openalex.org/W2164411961', 'https://openalex.org/W2171671120', 'https://openalex.org/W2212703438', 'https://openalex.org/W2250539671', 'https://openalex.org/W2252069213', 'https://openalex.org/W2296283641', 'https://openalex.org/W2332754757', 'https://openalex.org/W2597787948', 'https://openalex.org/W2612120747', 'https://openalex.org/W2785787385', 'https://openalex.org/W2797764714', 'https://openalex.org/W2798587560', 'https://openalex.org/W2880875857', 'https://openalex.org/W2903158431', 'https://openalex.org/W2946417913', 'https://openalex.org/W2946728200', 'https://openalex.org/W2951262644', 'https://openalex.org/W2951786554', 'https://openalex.org/W2951911250', 'https://openalex.org/W2952087486', 'https://openalex.org/W2962739339', 'https://openalex.org/W2962902328', 'https://openalex.org/W2963266340', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963403868', 'https://openalex.org/W2963625095', 'https://openalex.org/W2963696295', 'https://openalex.org/W2963756980', 'https://openalex.org/W2964059111', 'https://openalex.org/W2964282813', 'https://openalex.org/W2970450573', 'https://openalex.org/W2978017171', 'https://openalex.org/W2980282514', 'https://openalex.org/W2981644170', 'https://openalex.org/W3001060565', 'https://openalex.org/W3011594683', 'https://openalex.org/W3037588750', 'https://openalex.org/W3105522431', 'https://openalex.org/W3118485687', 'https://openalex.org/W4287824654', 'https://openalex.org/W4385245566', 'https://openalex.org/W582134693'], 'related_works': ['https://openalex.org/W4360585206', 'https://openalex.org/W4321369474', 'https://openalex.org/W4306674287', 'https://openalex.org/W4285208911', 'https://openalex.org/W3215138031', 'https://openalex.org/W3046775127', 'https://openalex.org/W3009238340', 'https://openalex.org/W2961085424', 'https://openalex.org/W2939353110', 'https://openalex.org/W2731899572'], 'abstract_inverted_index': {'Artem': [0], 'Shelmanov,': [1], 'Dmitri': [2], 'Puzyrev,': [3], 'Lyubov': [4], 'Kupriyanova,': [5], 'Denis': [6], 'Belyakov,': [7], 'Daniil': [8], 'Larionov,': [9], 'Nikita': [10], 'Khromov,': [11], 'Olga': [12], 'Kozlova,': [13], 'Ekaterina': [14], 'Artemova,': [15], 'Dmitry': [16], 'V.': [17], 'Dylov,': [18], 'Alexander': [19], 'Panchenko.': [20], 'Proceedings': [21], 'of': [22, 26, 30], 'the': [23, 27, 31], '16th': [24], 'Conference': [25], 'European': [28], 'Chapter': [29], 'Association': [32], 'for': [33], 'Computational': [34], 'Linguistics:': [35], 'Main': [36], 'Volume.': [37], '2021.': [38]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W3156031277', 'counts_by_year': [{'year': 2024, 'cited_by_count': 6}, {'year': 2023, 'cited_by_count': 9}, {'year': 2022, 'cited_by_count': 3}, {'year': 2021, 'cited_by_count': 3}], 'updated_date': '2025-01-24T15:41:37.865410', 'created_date': '2021-04-26'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
