Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters

Name: Work Video:
Duration: 3 min 30 s
Description: Boshi Wang, Sewon Min, Xiang Deng, Jiaming Shen, You Wu, Luke Zettlemoyer, Huan Sun. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Boshi Wang; Sewon Min; Xiang Deng; Jiaming Shen; You Wu; Luke Zettlemoyer; Huan Sun
{'id': 'https://openalex.org/W4385571045', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.153', 'title': 'Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters', 'display_name': 'Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters', 'publication_year': 2023, 'publication_date': '2023-01-01', 'ids': {'openalex': 'https://openalex.org/W4385571045', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.153'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.153', 'pdf_url': 'https://aclanthology.org/2023.acl-long.153.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2023.acl-long.153.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5103541243', 'display_name': 'Boshi Wang', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I52357470', 'display_name': 'The Ohio State University', 'ror': 'https://ror.org/00rs6vg23', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I52357470']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Boshi Wang', 'raw_affiliation_strings': ['The Ohio State University'], 'affiliations': [{'raw_affiliation_string': 'The Ohio State University', 'institution_ids': ['https://openalex.org/I52357470']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5039158419', 'display_name': 'Sewon Min', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Sewon Min', 'raw_affiliation_strings': ['University of Washington'], 'affiliations': [{'raw_affiliation_string': 'University of Washington', 'institution_ids': ['https://openalex.org/I201448701']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100870515', 'display_name': 'Xiang Deng', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I52357470', 'display_name': 'The Ohio State University', 'ror': 'https://ror.org/00rs6vg23', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I52357470']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Xiang Deng', 'raw_affiliation_strings': ['The Ohio State University'], 'affiliations': [{'raw_affiliation_string': 'The Ohio State University', 'institution_ids': ['https://openalex.org/I52357470']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5041327449', 'display_name': 'Jiaming Shen', 'orcid': 'https://orcid.org/0000-0002-0467-4956'}, 'institutions': [{'id': 'https://openalex.org/I1291425158', 'display_name': 'Google (United States)', 'ror': 'https://ror.org/00njsd438', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I1291425158', 'https://openalex.org/I4210128969']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Jiaming Shen', 'raw_affiliation_strings': ['Google Research {wang.13930,'], 'affiliations': [{'raw_affiliation_string': 'Google Research {wang.13930,', 'institution_ids': ['https://openalex.org/I1291425158']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100659454', 'display_name': 'You Wu', 'orcid': 'https://orcid.org/0000-0001-8586-1325'}, 'institutions': [{'id': 'https://openalex.org/I1291425158', 'display_name': 'Google (United States)', 'ror': 'https://ror.org/00njsd438', 'country_code': 'US', 'type': 'company', 'lineage': ['https://openalex.org/I1291425158', 'https://openalex.org/I4210128969']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'You Wu', 'raw_affiliation_strings': ['Google Research {wang.13930,'], 'affiliations': [{'raw_affiliation_string': 'Google Research {wang.13930,', 'institution_ids': ['https://openalex.org/I1291425158']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5067919401', 'display_name': 'Luke Zettlemoyer', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I201448701', 'display_name': 'University of Washington', 'ror': 'https://ror.org/00cvxb145', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I201448701']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Luke Zettlemoyer', 'raw_affiliation_strings': ['University of Washington'], 'affiliations': [{'raw_affiliation_string': 'University of Washington', 'institution_ids': ['https://openalex.org/I201448701']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5101610217', 'display_name': 'Huan Sun', 'orcid': 'https://orcid.org/0000-0003-1592-5367'}, 'institutions': [{'id': 'https://openalex.org/I52357470', 'display_name': 'The Ohio State University', 'ror': 'https://ror.org/00rs6vg23', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I52357470']}], 'countries': ['US'], 'is_corresponding': False, 'raw_author_name': 'Huan Sun', 'raw_affiliation_strings': ['The Ohio State University'], 'affiliations': [{'raw_affiliation_string': 'The Ohio State University', 'institution_ids': ['https://openalex.org/I52357470']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 3, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 9.053, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 34, 'citation_normalized_percentile': {'value': 0.999964, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 98, 'max': 99}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10799', 'display_name': 'Data Visualization and Analytics', 'score': 0.7589, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10799', 'display_name': 'Data Visualization and Analytics', 'score': 0.7589, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.5072965}, {'id': 'https://openalex.org/keywords/empirical-research', 'display_name': 'Empirical Research', 'score': 0.41624528}], 'concepts': [{'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.5072965}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5064236}, {'id': 'https://openalex.org/C120936955', 'wikidata': 'https://www.wikidata.org/wiki/Q2155640', 'display_name': 'Empirical research', 'level': 2, 'score': 0.41624528}, {'id': 'https://openalex.org/C41895202', 'wikidata': 'https://www.wikidata.org/wiki/Q8162', 'display_name': 'Linguistics', 'level': 1, 'score': 0.3675691}, {'id': 'https://openalex.org/C111472728', 'wikidata': 'https://www.wikidata.org/wiki/Q9471', 'display_name': 'Epistemology', 'level': 1, 'score': 0.3350686}, {'id': 'https://openalex.org/C138885662', 'wikidata': 'https://www.wikidata.org/wiki/Q5891', 'display_name': 'Philosophy', 'level': 0, 'score': 0.29644436}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.27599406}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.153', 'pdf_url': 'https://aclanthology.org/2023.acl-long.153.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2212.10001', 'pdf_url': 'https://arxiv.org/pdf/2212.10001', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.153', 'pdf_url': 'https://aclanthology.org/2023.acl-long.153.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4', 'score': 0.81}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 26, 'referenced_works': ['https://openalex.org/W3198599617', 'https://openalex.org/W4221143046', 'https://openalex.org/W4221161695', 'https://openalex.org/W4224308101', 'https://openalex.org/W4226278401', 'https://openalex.org/W4281690148', 'https://openalex.org/W4286769130', 'https://openalex.org/W4286892945', 'https://openalex.org/W4292779060', 'https://openalex.org/W4296415404', 'https://openalex.org/W4297412056', 'https://openalex.org/W4302305823', 'https://openalex.org/W4304194220', 'https://openalex.org/W4307079201', 'https://openalex.org/W4309953112', 'https://openalex.org/W4310509152', 'https://openalex.org/W4311728219', 'https://openalex.org/W4323697341', 'https://openalex.org/W4385567149', 'https://openalex.org/W4385571157', 'https://openalex.org/W4385571505', 'https://openalex.org/W4385571689', 'https://openalex.org/W4385573261', 'https://openalex.org/W4385573636', 'https://openalex.org/W4389520103', 'https://openalex.org/W4394653315'], 'related_works': ['https://openalex.org/W2748952813', 'https://openalex.org/W2530322880', 'https://openalex.org/W2390279801', 'https://openalex.org/W2382290278', 'https://openalex.org/W2376932109', 'https://openalex.org/W2359140296', 'https://openalex.org/W2358668433', 'https://openalex.org/W2350741829', 'https://openalex.org/W2001405890', 'https://openalex.org/W1596801655'], 'abstract_inverted_index': {'Boshi': [0], 'Wang,': [1], 'Sewon': [2], 'Min,': [3], 'Xiang': [4], 'Deng,': [5], 'Jiaming': [6], 'Shen,': [7], 'You': [8], 'Wu,': [9], 'Luke': [10], 'Zettlemoyer,': [11], 'Huan': [12], 'Sun.': [13], 'Proceedings': [14], 'of': [15, 20], 'the': [16, 21], '61st': [17], 'Annual': [18], 'Meeting': [19], 'Association': [22], 'for': [23], 'Computational': [24], 'Linguistics': [25], '(Volume': [26], '1:': [27], 'Long': [28], 'Papers).': [29], '2023.': [30]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W4385571045', 'counts_by_year': [{'year': 2024, 'cited_by_count': 15}, {'year': 2023, 'cited_by_count': 18}], 'updated_date': '2025-01-19T15:06:39.324953', 'created_date': '2023-08-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
