Stochastic approximation for Monte Carlo optimization (1986)

Name: Work Video:
Duration: 3 min 30 s
Description: In this paper, we introduce two convergent Monte Carlo algorithms for optimizing complex stochastic systems. The first algorithm, which is applicable to regenerative processes, operates by estimating finite differences. The second method is of Robbins-Monro type and is applicable to Markov chains. The algorithm is driven by derivative estimates obtained via a likelihood ratio argument.
Peter W. Glynn
{'id': 'https://openalex.org/W1970602736', 'doi': 'https://doi.org/10.5555/1351542.1352005', 'title': 'Stochastic approximation for Monte Carlo optimization (1986)', 'display_name': 'Stochastic approximation for Monte Carlo optimization (1986)', 'publication_year': 1986, 'publication_date': '1986-12-01', 'ids': {'openalex': 'https://openalex.org/W1970602736', 'doi': 'https://doi.org/10.5555/1351542.1352005', 'mag': '1970602736'}, 'language': 'en', 'primary_location': {'is_oa': False, 'landing_page_url': 'https://repository.lib.ncsu.edu/bitstream/1840.4/4480/1/1986_0054.pdf', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4306421180', 'display_name': 'Winter Simulation Conference', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': [], 'open_access': {'is_oa': False, 'oa_status': 'closed', 'oa_url': None, 'any_repository_has_fulltext': False}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5019114258', 'display_name': 'Peter W. Glynn', 'orcid': 'https://orcid.org/0000-0003-1370-6638'}, 'institutions': [{'id': 'https://openalex.org/I135310074', 'display_name': 'University of Wisconsin–Madison', 'ror': 'https://ror.org/01y2jtd41', 'country_code': 'US', 'type': 'education', 'lineage': ['https://openalex.org/I135310074']}], 'countries': ['US'], 'is_corresponding': True, 'raw_author_name': 'Peter W. Glynn', 'raw_affiliation_strings': ['Department of Industrial Elngineering and Mathematics Research Center, University of Wisconsin--Madison, Madison, WI'], 'affiliations': [{'raw_affiliation_string': 'Department of Industrial Elngineering and Mathematics Research Center, University of Wisconsin--Madison, Madison, WI', 'institution_ids': ['https://openalex.org/I135310074']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 1, 'corresponding_author_ids': ['https://openalex.org/A5019114258'], 'corresponding_institution_ids': ['https://openalex.org/I135310074'], 'apc_list': None, 'apc_paid': None, 'fwci': 3.0, 'has_fulltext': False, 'cited_by_count': 109, 'citation_normalized_percentile': {'value': 0.5, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 97, 'max': 98}, 'biblio': {'volume': None, 'issue': None, 'first_page': '356', 'last_page': '365'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T12011', 'display_name': 'Insurance, Mortality, Demography, Risk Management', 'score': 0.8369, 'subfield': {'id': 'https://openalex.org/subfields/3317', 'display_name': 'Demography'}, 'field': {'id': 'https://openalex.org/fields/33', 'display_name': 'Social Sciences'}, 'domain': {'id': 'https://openalex.org/domains/2', 'display_name': 'Social Sciences'}}, 'topics': [{'id': 'https://openalex.org/T12011', 'display_name': 'Insurance, Mortality, Demography, Risk Management', 'score': 0.8369, 'subfield': {'id': 'https://openalex.org/subfields/3317', 'display_name': 'Demography'}, 'field': {'id': 'https://openalex.org/fields/33', 'display_name': 'Social Sciences'}, 'domain': {'id': 'https://openalex.org/domains/2', 'display_name': 'Social Sciences'}}, {'id': 'https://openalex.org/T10067', 'display_name': 'Stochastic processes and financial applications', 'score': 0.8324, 'subfield': {'id': 'https://openalex.org/subfields/2003', 'display_name': 'Finance'}, 'field': {'id': 'https://openalex.org/fields/20', 'display_name': 'Economics, Econometrics and Finance'}, 'domain': {'id': 'https://openalex.org/domains/2', 'display_name': 'Social Sciences'}}, {'id': 'https://openalex.org/T12404', 'display_name': 'Mathematical Approximation and Integration', 'score': 0.7853, 'subfield': {'id': 'https://openalex.org/subfields/2612', 'display_name': 'Numerical Analysis'}, 'field': {'id': 'https://openalex.org/fields/26', 'display_name': 'Mathematics'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [], 'concepts': [{'id': 'https://openalex.org/C19499675', 'wikidata': 'https://www.wikidata.org/wiki/Q232207', 'display_name': 'Monte Carlo method', 'level': 2, 'score': 0.7014992}, {'id': 'https://openalex.org/C111350023', 'wikidata': 'https://www.wikidata.org/wiki/Q1191869', 'display_name': 'Markov chain Monte Carlo', 'level': 3, 'score': 0.5901203}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5779158}, {'id': 'https://openalex.org/C13153151', 'wikidata': 'https://www.wikidata.org/wiki/Q1639846', 'display_name': 'Hybrid Monte Carlo', 'level': 4, 'score': 0.5463028}, {'id': 'https://openalex.org/C126255220', 'wikidata': 'https://www.wikidata.org/wiki/Q141495', 'display_name': 'Mathematical optimization', 'level': 1, 'score': 0.5313122}, {'id': 'https://openalex.org/C98763669', 'wikidata': 'https://www.wikidata.org/wiki/Q176645', 'display_name': 'Markov chain', 'level': 2, 'score': 0.48996845}, {'id': 'https://openalex.org/C159886148', 'wikidata': 'https://www.wikidata.org/wiki/Q176645', 'display_name': 'Markov process', 'level': 2, 'score': 0.41133857}, {'id': 'https://openalex.org/C28826006', 'wikidata': 'https://www.wikidata.org/wiki/Q33521', 'display_name': 'Applied mathematics', 'level': 1, 'score': 0.41113305}, {'id': 'https://openalex.org/C11413529', 'wikidata': 'https://www.wikidata.org/wiki/Q8366', 'display_name': 'Algorithm', 'level': 1, 'score': 0.40066373}, {'id': 'https://openalex.org/C33923547', 'wikidata': 'https://www.wikidata.org/wiki/Q395', 'display_name': 'Mathematics', 'level': 0, 'score': 0.30837655}, {'id': 'https://openalex.org/C105795698', 'wikidata': 'https://www.wikidata.org/wiki/Q12483', 'display_name': 'Statistics', 'level': 1, 'score': 0.08118808}, {'id': 'https://openalex.org/C119857082', 'wikidata': 'https://www.wikidata.org/wiki/Q2539', 'display_name': 'Machine learning', 'level': 1, 'score': 0.077385336}], 'mesh': [], 'locations_count': 1, 'locations': [{'is_oa': False, 'landing_page_url': 'https://repository.lib.ncsu.edu/bitstream/1840.4/4480/1/1986_0054.pdf', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4306421180', 'display_name': 'Winter Simulation Conference', 'issn_l': None, 'issn': None, 'is_oa': False, 'is_in_doaj': False, 'is_core': False, 'host_organization': None, 'host_organization_name': None, 'host_organization_lineage': [], 'host_organization_lineage_names': [], 'type': 'conference'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}], 'best_oa_location': None, 'sustainable_development_goals': [], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 3, 'referenced_works': ['https://openalex.org/W1580334350', 'https://openalex.org/W2007854530', 'https://openalex.org/W2100942298'], 'related_works': ['https://openalex.org/W2235056388', 'https://openalex.org/W2155027007', 'https://openalex.org/W2127255353', 'https://openalex.org/W2121863487', 'https://openalex.org/W2119717200', 'https://openalex.org/W2118000334', 'https://openalex.org/W2104726827', 'https://openalex.org/W2088812255', 'https://openalex.org/W2087018957', 'https://openalex.org/W2060228835', 'https://openalex.org/W2051195188', 'https://openalex.org/W2046765929', 'https://openalex.org/W2029185001', 'https://openalex.org/W2009797711', 'https://openalex.org/W2006036383', 'https://openalex.org/W1994616650', 'https://openalex.org/W1988288472', 'https://openalex.org/W1965786092', 'https://openalex.org/W1593494339', 'https://openalex.org/W1576452626'], 'abstract_inverted_index': {'In': [0], 'this': [1], 'paper,': [2], 'we': [3], 'introduce': [4], 'two': [5], 'convergent': [6], 'Monte': [7], 'Carlo': [8], 'algorithms': [9], 'for': [10], 'optimizing': [11], 'complex': [12], 'stochastic': [13], 'systems.': [14], 'The': [15, 29, 42], 'first': [16], 'algorithm,': [17], 'which': [18], 'is': [19, 32, 37, 44], 'applicable': [20, 38], 'to': [21, 39], 'regenerative': [22], 'processes,': [23], 'operates': [24], 'by': [25, 46], 'estimating': [26], 'finite': [27], 'differences.': [28], 'second': [30], 'method': [31], 'of': [33], 'Robbins-Monro': [34], 'type': [35], 'and': [36], 'Markov': [40], 'chains.': [41], 'algorithm': [43], 'driven': [45], 'derivative': [47], 'estimates': [48], 'obtained': [49], 'via': [50], 'a': [51], 'likelihood': [52], 'ratio': [53], 'argument.': [54]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W1970602736', 'counts_by_year': [{'year': 2021, 'cited_by_count': 1}, {'year': 2020, 'cited_by_count': 1}, {'year': 2017, 'cited_by_count': 2}, {'year': 2016, 'cited_by_count': 2}, {'year': 2013, 'cited_by_count': 1}], 'updated_date': '2024-12-05T23:43:47.469870', 'created_date': '2016-06-24'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
