Is GPT-3 a Good Data Annotator?

Name: Work Video:
Duration: 3 min 30 s
Description: Bosheng Ding, Chengwei Qin, Linlin Liu, Yew Ken Chia, Boyang Li, Shafiq Joty, Lidong Bing. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Bosheng Ding; Chengwei Qin; Linlin Liu; Yew Ken Chia; Boyang Li; Shafiq Joty; Lidong Bing
{'id': 'https://openalex.org/W4385571411', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.626', 'title': 'Is GPT-3 a Good Data Annotator?', 'display_name': 'Is GPT-3 a Good Data Annotator?', 'publication_year': 2023, 'publication_date': '2023-01-01', 'ids': {'openalex': 'https://openalex.org/W4385571411', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.626'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.626', 'pdf_url': 'https://aclanthology.org/2023.acl-long.626.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2023.acl-long.626.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5015941893', 'display_name': 'Bosheng Ding', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210086143', 'display_name': 'Alibaba Group (Cayman Islands)', 'ror': 'https://ror.org/00mnrxf72', 'country_code': 'KY', 'type': 'company', 'lineage': ['https://openalex.org/I4210086143', 'https://openalex.org/I45928872']}, {'id': 'https://openalex.org/I172675005', 'display_name': 'Nanyang Technological University', 'ror': 'https://ror.org/02e7b5302', 'country_code': 'SG', 'type': 'education', 'lineage': ['https://openalex.org/I172675005']}], 'countries': ['KY', 'SG'], 'is_corresponding': False, 'raw_author_name': 'Bosheng Ding', 'raw_affiliation_strings': ['DAMO Academy, Alibaba Group', 'Nanyang Technological University, Singapore'], 'affiliations': [{'raw_affiliation_string': 'DAMO Academy, Alibaba Group', 'institution_ids': ['https://openalex.org/I4210086143']}, {'raw_affiliation_string': 'Nanyang Technological University, Singapore', 'institution_ids': ['https://openalex.org/I172675005']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5084658659', 'display_name': 'Chengwei Qin', 'orcid': 'https://orcid.org/0000-0002-1121-2100'}, 'institutions': [{'id': 'https://openalex.org/I172675005', 'display_name': 'Nanyang Technological University', 'ror': 'https://ror.org/02e7b5302', 'country_code': 'SG', 'type': 'education', 'lineage': ['https://openalex.org/I172675005']}], 'countries': ['SG'], 'is_corresponding': False, 'raw_author_name': 'Chengwei Qin', 'raw_affiliation_strings': ['Nanyang Technological University, Singapore'], 'affiliations': [{'raw_affiliation_string': 'Nanyang Technological University, Singapore', 'institution_ids': ['https://openalex.org/I172675005']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100409390', 'display_name': 'Linlin Liu', 'orcid': 'https://orcid.org/0000-0002-5001-0026'}, 'institutions': [{'id': 'https://openalex.org/I172675005', 'display_name': 'Nanyang Technological University', 'ror': 'https://ror.org/02e7b5302', 'country_code': 'SG', 'type': 'education', 'lineage': ['https://openalex.org/I172675005']}, {'id': 'https://openalex.org/I4210086143', 'display_name': 'Alibaba Group (Cayman Islands)', 'ror': 'https://ror.org/00mnrxf72', 'country_code': 'KY', 'type': 'company', 'lineage': ['https://openalex.org/I4210086143', 'https://openalex.org/I45928872']}], 'countries': ['KY', 'SG'], 'is_corresponding': False, 'raw_author_name': 'Linlin Liu', 'raw_affiliation_strings': ['DAMO Academy, Alibaba Group', 'Nanyang Technological University, Singapore'], 'affiliations': [{'raw_affiliation_string': 'Nanyang Technological University, Singapore', 'institution_ids': ['https://openalex.org/I172675005']}, {'raw_affiliation_string': 'DAMO Academy, Alibaba Group', 'institution_ids': ['https://openalex.org/I4210086143']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5087486426', 'display_name': 'Yew Ken Chia', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210086143', 'display_name': 'Alibaba Group (Cayman Islands)', 'ror': 'https://ror.org/00mnrxf72', 'country_code': 'KY', 'type': 'company', 'lineage': ['https://openalex.org/I4210086143', 'https://openalex.org/I45928872']}], 'countries': ['KY'], 'is_corresponding': False, 'raw_author_name': 'Yew Ken Chia', 'raw_affiliation_strings': ['DAMO Academy, Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'DAMO Academy, Alibaba Group', 'institution_ids': ['https://openalex.org/I4210086143']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100732746', 'display_name': 'Boyang Li', 'orcid': 'https://orcid.org/0000-0002-6230-2376'}, 'institutions': [{'id': 'https://openalex.org/I172675005', 'display_name': 'Nanyang Technological University', 'ror': 'https://ror.org/02e7b5302', 'country_code': 'SG', 'type': 'education', 'lineage': ['https://openalex.org/I172675005']}], 'countries': ['SG'], 'is_corresponding': False, 'raw_author_name': 'Boyang Li', 'raw_affiliation_strings': ['Nanyang Technological University, Singapore'], 'affiliations': [{'raw_affiliation_string': 'Nanyang Technological University, Singapore', 'institution_ids': ['https://openalex.org/I172675005']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5005443526', 'display_name': 'Shafiq Joty', 'orcid': 'https://orcid.org/0000-0002-9222-2641'}, 'institutions': [{'id': 'https://openalex.org/I172675005', 'display_name': 'Nanyang Technological University', 'ror': 'https://ror.org/02e7b5302', 'country_code': 'SG', 'type': 'education', 'lineage': ['https://openalex.org/I172675005']}], 'countries': ['SG'], 'is_corresponding': False, 'raw_author_name': 'Shafiq Joty', 'raw_affiliation_strings': ['Nanyang Technological University, Singapore'], 'affiliations': [{'raw_affiliation_string': 'Nanyang Technological University, Singapore', 'institution_ids': ['https://openalex.org/I172675005']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5086674741', 'display_name': 'Lidong Bing', 'orcid': 'https://orcid.org/0000-0003-4565-6313'}, 'institutions': [{'id': 'https://openalex.org/I4210086143', 'display_name': 'Alibaba Group (Cayman Islands)', 'ror': 'https://ror.org/00mnrxf72', 'country_code': 'KY', 'type': 'company', 'lineage': ['https://openalex.org/I4210086143', 'https://openalex.org/I45928872']}], 'countries': ['KY'], 'is_corresponding': False, 'raw_author_name': 'Lidong Bing', 'raw_affiliation_strings': ['DAMO Academy, Alibaba Group'], 'affiliations': [{'raw_affiliation_string': 'DAMO Academy, Alibaba Group', 'institution_ids': ['https://openalex.org/I4210086143']}]}], 'institution_assertions': [], 'countries_distinct_count': 2, 'institutions_distinct_count': 2, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 24.31, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 70, 'citation_normalized_percentile': {'value': 0.999976, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 99, 'max': 100}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9491, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9491, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9283, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.55533445}], 'concepts': [{'id': 'https://openalex.org/C20556612', 'wikidata': 'https://www.wikidata.org/wiki/Q4469374', 'display_name': 'Volume (thermodynamics)', 'level': 2, 'score': 0.61823654}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.55533445}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5235295}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.34412372}, {'id': 'https://openalex.org/C161191863', 'wikidata': 'https://www.wikidata.org/wiki/Q199655', 'display_name': 'Library science', 'level': 1, 'score': 0.32854396}, {'id': 'https://openalex.org/C121332964', 'wikidata': 'https://www.wikidata.org/wiki/Q413', 'display_name': 'Physics', 'level': 0, 'score': 0.108721256}, {'id': 'https://openalex.org/C62520636', 'wikidata': 'https://www.wikidata.org/wiki/Q944', 'display_name': 'Quantum mechanics', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.626', 'pdf_url': 'https://aclanthology.org/2023.acl-long.626.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2212.10450', 'pdf_url': 'https://arxiv.org/pdf/2212.10450', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.626', 'pdf_url': 'https://aclanthology.org/2023.acl-long.626.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4', 'score': 0.85}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 64, 'referenced_works': ['https://openalex.org/W2251939518', 'https://openalex.org/W22861983', 'https://openalex.org/W2805249667', 'https://openalex.org/W2962369866', 'https://openalex.org/W2962739339', 'https://openalex.org/W2962897020', 'https://openalex.org/W2963341956', 'https://openalex.org/W2963777632', 'https://openalex.org/W2965373594', 'https://openalex.org/W2970597249', 'https://openalex.org/W2971296908', 'https://openalex.org/W2991468406', 'https://openalex.org/W3103291112', 'https://openalex.org/W3104182623', 'https://openalex.org/W3105083537', 'https://openalex.org/W3127488360', 'https://openalex.org/W3162734203', 'https://openalex.org/W3167602185', 'https://openalex.org/W3173156538', 'https://openalex.org/W3173777717', 'https://openalex.org/W3174571625', 'https://openalex.org/W3176693010', 'https://openalex.org/W3176920001', 'https://openalex.org/W3196820561', 'https://openalex.org/W3205270560', 'https://openalex.org/W3205616434', 'https://openalex.org/W3207583316', 'https://openalex.org/W4205991051', 'https://openalex.org/W4221143046', 'https://openalex.org/W4221149883', 'https://openalex.org/W4224308101', 'https://openalex.org/W4225591000', 'https://openalex.org/W4225908005', 'https://openalex.org/W4226146865', 'https://openalex.org/W4226278401', 'https://openalex.org/W4226399820', 'https://openalex.org/W4229005866', 'https://openalex.org/W4281557260', 'https://openalex.org/W4283768109', 'https://openalex.org/W4284971361', 'https://openalex.org/W4285225959', 'https://openalex.org/W4286987939', 'https://openalex.org/W4288089799', 'https://openalex.org/W4291582788', 'https://openalex.org/W4292779060', 'https://openalex.org/W4297253404', 'https://openalex.org/W4297801719', 'https://openalex.org/W4298187912', 'https://openalex.org/W4300996741', 'https://openalex.org/W4309444617', 'https://openalex.org/W4312091865', 'https://openalex.org/W4320005767', 'https://openalex.org/W4322718191', 'https://openalex.org/W4327656064', 'https://openalex.org/W4361019453', 'https://openalex.org/W4377865924', 'https://openalex.org/W4378464976', 'https://openalex.org/W4384662964', 'https://openalex.org/W4385570451', 'https://openalex.org/W4385573439', 'https://openalex.org/W4385574293', 'https://openalex.org/W4385970309', 'https://openalex.org/W4389519872', 'https://openalex.org/W4389523957'], 'related_works': ['https://openalex.org/W2748952813', 'https://openalex.org/W2530322880', 'https://openalex.org/W2390279801', 'https://openalex.org/W2382290278', 'https://openalex.org/W2376932109', 'https://openalex.org/W2359140296', 'https://openalex.org/W2358668433', 'https://openalex.org/W2350741829', 'https://openalex.org/W2001405890', 'https://openalex.org/W1596801655'], 'abstract_inverted_index': {'Bosheng': [0], 'Ding,': [1], 'Chengwei': [2], 'Qin,': [3], 'Linlin': [4], 'Liu,': [5], 'Yew': [6], 'Ken': [7], 'Chia,': [8], 'Boyang': [9], 'Li,': [10], 'Shafiq': [11], 'Joty,': [12], 'Lidong': [13], 'Bing.': [14], 'Proceedings': [15], 'of': [16, 21], 'the': [17, 22], '61st': [18], 'Annual': [19], 'Meeting': [20], 'Association': [23], 'for': [24], 'Computational': [25], 'Linguistics': [26], '(Volume': [27], '1:': [28], 'Long': [29], 'Papers).': [30], '2023.': [31]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W4385571411', 'counts_by_year': [{'year': 2024, 'cited_by_count': 36}, {'year': 2023, 'cited_by_count': 31}], 'updated_date': '2024-12-23T09:53:23.685080', 'created_date': '2023-08-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
