Effective natural language parsing with probabilistic grammars

Name: Work Video:
Duration: 3 min 30 s
Description: This paper presents an example of application of a PCFG parsing algorithm based on the A* search procedure in a machine translation system. We modified the existing CYK-based parser used in the machine translation system Translatica and applied the A* parsing algorithm in order to improve the performance of the parser.
Paweł Skórzewski
{'id': 'https://openalex.org/W2008892266', 'doi': 'https://doi.org/10.1109/imcsit.2010.5679860', 'title': 'Effective natural language parsing with probabilistic grammars', 'display_name': 'Effective natural language parsing with probabilistic grammars', 'publication_year': 2010, 'publication_date': '2010-10-01', 'ids': {'openalex': 'https://openalex.org/W2008892266', 'doi': 'https://doi.org/10.1109/imcsit.2010.5679860', 'mag': '2008892266'}, 'language': 'en', 'primary_location': {'is_oa': False, 'landing_page_url': 'https://doi.org/10.1109/imcsit.2010.5679860', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4210192132', 'display_name': 'Proceedings of the International Multiconference on Computer Science and Information Technology', 'issn_l': '1896-7094', 'issn': ['1896-7094', '2157-5525', '2157-5533'], 'is_oa': False, 'is_in_doaj': False, 'is_core': True, 'host_organization': 'https://openalex.org/P4310319808', 'host_organization_name': 'Institute of Electrical and Electronics Engineers', 'host_organization_lineage': ['https://openalex.org/P4310319808'], 'host_organization_lineage_names': ['Institute of Electrical and Electronics Engineers'], 'type': 'journal'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': False, 'oa_status': 'closed', 'oa_url': None, 'any_repository_has_fulltext': False}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5007928071', 'display_name': 'Paweł Skórzewski', 'orcid': 'https://orcid.org/0000-0002-5056-2808'}, 'institutions': [{'id': 'https://openalex.org/I59411706', 'display_name': 'Adam Mickiewicz University in Poznań', 'ror': 'https://ror.org/04g6bbq64', 'country_code': 'PL', 'type': 'education', 'lineage': ['https://openalex.org/I59411706']}], 'countries': ['PL'], 'is_corresponding': True, 'raw_author_name': 'P Skorzewski', 'raw_affiliation_strings': ['Adam Mickiewicz University, Faculty of Mathematics and Computer Science, ul. Umultowska 87, 61-614 Poznań, Poland'], 'affiliations': [{'raw_affiliation_string': 'Adam Mickiewicz University, Faculty of Mathematics and Computer Science, ul. Umultowska 87, 61-614 Poznań, Poland', 'institution_ids': ['https://openalex.org/I59411706']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 1, 'corresponding_author_ids': ['https://openalex.org/A5007928071'], 'corresponding_institution_ids': ['https://openalex.org/I59411706'], 'apc_list': None, 'apc_paid': None, 'fwci': 0.234, 'has_fulltext': True, 'fulltext_origin': 'ngrams', 'cited_by_count': 4, 'citation_normalized_percentile': {'value': 0.58397, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 77, 'max': 79}, 'biblio': {'volume': '24', 'issue': None, 'first_page': '501', 'last_page': '504'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9912, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T11269', 'display_name': 'Algorithms and Data Compression', 'score': 0.9866, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/parsing-expression-grammar', 'display_name': 'Parsing expression grammar', 'score': 0.8449558}, {'id': 'https://openalex.org/keywords/top-down-parsing-language', 'display_name': 'Top-down parsing language', 'score': 0.6994152}, {'id': 'https://openalex.org/keywords/s-attributed-grammar', 'display_name': 'S-attributed grammar', 'score': 0.6397578}, {'id': 'https://openalex.org/keywords/synchronous-context-free-grammar', 'display_name': 'Synchronous context-free grammar', 'score': 0.5344844}, {'id': 'https://openalex.org/keywords/lr-parser', 'display_name': 'LR parser', 'score': 0.46381447}], 'concepts': [{'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.8736619}, {'id': 'https://openalex.org/C146810361', 'wikidata': 'https://www.wikidata.org/wiki/Q32271', 'display_name': 'Parsing expression grammar', 'level': 5, 'score': 0.8449558}, {'id': 'https://openalex.org/C118364021', 'wikidata': 'https://www.wikidata.org/wiki/Q7139956', 'display_name': 'Parser combinator', 'level': 3, 'score': 0.7768434}, {'id': 'https://openalex.org/C42560504', 'wikidata': 'https://www.wikidata.org/wiki/Q15419395', 'display_name': 'Top-down parsing', 'level': 3, 'score': 0.76149964}, {'id': 'https://openalex.org/C186644900', 'wikidata': 'https://www.wikidata.org/wiki/Q194152', 'display_name': 'Parsing', 'level': 2, 'score': 0.7252647}, {'id': 'https://openalex.org/C166651950', 'wikidata': 'https://www.wikidata.org/wiki/Q7824365', 'display_name': 'Top-down parsing language', 'level': 5, 'score': 0.6994152}, {'id': 'https://openalex.org/C147547768', 'wikidata': 'https://www.wikidata.org/wiki/Q3113342', 'display_name': 'S-attributed grammar', 'level': 3, 'score': 0.6397578}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.6292263}, {'id': 'https://openalex.org/C60690694', 'wikidata': 'https://www.wikidata.org/wiki/Q894902', 'display_name': 'Bottom-up parsing', 'level': 4, 'score': 0.61151475}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.59211326}, {'id': 'https://openalex.org/C53893814', 'wikidata': 'https://www.wikidata.org/wiki/Q7378909', 'display_name': 'Rule-based machine translation', 'level': 2, 'score': 0.5482335}, {'id': 'https://openalex.org/C51802942', 'wikidata': 'https://www.wikidata.org/wiki/Q7662211', 'display_name': 'Synchronous context-free grammar', 'level': 4, 'score': 0.5344844}, {'id': 'https://openalex.org/C199360897', 'wikidata': 'https://www.wikidata.org/wiki/Q9143', 'display_name': 'Programming language', 'level': 1, 'score': 0.4844313}, {'id': 'https://openalex.org/C35164859', 'wikidata': 'https://www.wikidata.org/wiki/Q1756442', 'display_name': 'LR parser', 'level': 4, 'score': 0.46381447}, {'id': 'https://openalex.org/C203005215', 'wikidata': 'https://www.wikidata.org/wiki/Q79798', 'display_name': 'Machine translation', 'level': 2, 'score': 0.45383173}, {'id': 'https://openalex.org/C49937458', 'wikidata': 'https://www.wikidata.org/wiki/Q2599292', 'display_name': 'Probabilistic logic', 'level': 2, 'score': 0.44459987}, {'id': 'https://openalex.org/C67621940', 'wikidata': 'https://www.wikidata.org/wiki/Q3113340', 'display_name': 'L-attributed grammar', 'level': 4, 'score': 0.41284916}, {'id': 'https://openalex.org/C97212296', 'wikidata': 'https://www.wikidata.org/wiki/Q338047', 'display_name': 'Context-free grammar', 'level': 3, 'score': 0.37432468}, {'id': 'https://openalex.org/C24687705', 'wikidata': 'https://www.wikidata.org/wiki/Q3753284', 'display_name': 'Example-based machine translation', 'level': 3, 'score': 0.31052142}], 'mesh': [], 'locations_count': 1, 'locations': [{'is_oa': False, 'landing_page_url': 'https://doi.org/10.1109/imcsit.2010.5679860', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4210192132', 'display_name': 'Proceedings of the International Multiconference on Computer Science and Information Technology', 'issn_l': '1896-7094', 'issn': ['1896-7094', '2157-5525', '2157-5533'], 'is_oa': False, 'is_in_doaj': False, 'is_core': True, 'host_organization': 'https://openalex.org/P4310319808', 'host_organization_name': 'Institute of Electrical and Electronics Engineers', 'host_organization_lineage': ['https://openalex.org/P4310319808'], 'host_organization_lineage_names': ['Institute of Electrical and Electronics Engineers'], 'type': 'journal'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}], 'best_oa_location': None, 'sustainable_development_goals': [{'display_name': 'Quality education', 'id': 'https://metadata.un.org/sdg/4', 'score': 0.58}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 7, 'referenced_works': ['https://openalex.org/W1496659931', 'https://openalex.org/W1574901103', 'https://openalex.org/W1813353840', 'https://openalex.org/W1953828586', 'https://openalex.org/W2123893795', 'https://openalex.org/W2169755331', 'https://openalex.org/W3021928671'], 'related_works': ['https://openalex.org/W4320024782', 'https://openalex.org/W3105233674', 'https://openalex.org/W2529664582', 'https://openalex.org/W2483839524', 'https://openalex.org/W2246820938', 'https://openalex.org/W2164260211', 'https://openalex.org/W2105710547', 'https://openalex.org/W2038278636', 'https://openalex.org/W2008892266', 'https://openalex.org/W1908013816'], 'abstract_inverted_index': {'This': [0], 'paper': [1], 'presents': [2], 'an': [3], 'example': [4], 'of': [5, 7, 48], 'application': [6], 'a': [8, 19], 'PCFG': [9], 'parsing': [10, 40], 'algorithm': [11, 41], 'based': [12], 'on': [13], 'the': [14, 25, 31, 38, 46, 49], 'A*': [15, 39], 'search': [16], 'procedure': [17], 'in': [18, 30, 42], 'machine': [20, 32], 'translation': [21, 33], 'system.': [22], 'We': [23], 'modified': [24], 'existing': [26], 'CYK-based': [27], 'parser': [28], 'used': [29], 'system': [34], 'Translatica': [35], 'and': [36], 'applied': [37], 'order': [43], 'to': [44], 'improve': [45], 'performance': [47], 'parser.': [50]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W2008892266', 'counts_by_year': [{'year': 2022, 'cited_by_count': 1}, {'year': 2019, 'cited_by_count': 1}, {'year': 2016, 'cited_by_count': 1}], 'updated_date': '2024-12-16T12:42:31.423594', 'created_date': '2016-06-24'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
