ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding

Name: Work Video:
Duration: 3 min 30 s
Description: Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Yuhui Cao, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang. Findings of the Association for Computational Linguistics: EMNLP 2022. 2022.
Qiming Peng; Yinxu Pan; Wenjin Wang; Bin Luo; Zhenyu Zhang; Zhengjie Huang; Yuhui Cao; Weichong Yin; Yongfeng Chen; Yin Zhang⋆; Shikun Feng; Yu Sun; Hao Tian; Hua Wu; Haifeng Wang
{'id': 'https://openalex.org/W4385574075', 'doi': 'https://doi.org/10.18653/v1/2022.findings-emnlp.274', 'title': 'ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding', 'display_name': 'ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding', 'publication_year': 2022, 'publication_date': '2022-01-01', 'ids': {'openalex': 'https://openalex.org/W4385574075', 'doi': 'https://doi.org/10.18653/v1/2022.findings-emnlp.274'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-emnlp.274', 'pdf_url': 'https://aclanthology.org/2022.findings-emnlp.274.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2022.findings-emnlp.274.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5003779843', 'display_name': 'Qiming Peng', 'orcid': 'https://orcid.org/0000-0002-7558-3234'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Qiming Peng', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5021818887', 'display_name': 'Yinxu Pan', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Yinxu Pan', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100636792', 'display_name': 'Wenjin Wang', 'orcid': 'https://orcid.org/0000-0003-3942-5308'}, 'institutions': [{'id': 'https://openalex.org/I76130692', 'display_name': 'Zhejiang University', 'ror': 'https://ror.org/00a2xv884', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I76130692']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Wenjin Wang', 'raw_affiliation_strings': ['Zhejiang University, Hangzhou, China'], 'affiliations': [{'raw_affiliation_string': 'Zhejiang University, Hangzhou, China', 'institution_ids': ['https://openalex.org/I76130692']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100372676', 'display_name': 'Bin Luo', 'orcid': 'https://orcid.org/0000-0001-5948-5055'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Bin Luo', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100389530', 'display_name': 'Zhenyu Zhang', 'orcid': 'https://orcid.org/0000-0002-4888-4023'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Zhenyu Zhang', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5062586768', 'display_name': 'Zhengjie Huang', 'orcid': 'https://orcid.org/0000-0001-6298-8112'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Zhengjie Huang', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5054286522', 'display_name': 'Yuhui Cao', 'orcid': 'https://orcid.org/0000-0002-7841-0830'}, 'institutions': [], 'countries': [], 'is_corresponding': False, 'raw_author_name': 'Yuhui Cao', 'raw_affiliation_strings': [], 'affiliations': []}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5064465647', 'display_name': 'Weichong Yin', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Weichong Yin', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101735404', 'display_name': 'Yongfeng Chen', 'orcid': 'https://orcid.org/0009-0008-8676-324X'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Yongfeng Chen', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100343712', 'display_name': 'Yin Zhang⋆', 'orcid': 'https://orcid.org/0000-0002-1772-0763'}, 'institutions': [{'id': 'https://openalex.org/I76130692', 'display_name': 'Zhejiang University', 'ror': 'https://ror.org/00a2xv884', 'country_code': 'CN', 'type': 'education', 'lineage': ['https://openalex.org/I76130692']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Yin Zhang', 'raw_affiliation_strings': ['Zhejiang University, Hangzhou, China'], 'affiliations': [{'raw_affiliation_string': 'Zhejiang University, Hangzhou, China', 'institution_ids': ['https://openalex.org/I76130692']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5005049423', 'display_name': 'Shikun Feng', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Shikun Feng', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101890451', 'display_name': 'Yu Sun', 'orcid': 'https://orcid.org/0000-0003-4944-7404'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Yu Sun', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5115501041', 'display_name': 'Hao Tian', 'orcid': 'https://orcid.org/0009-0007-0271-7135'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Hao Tian', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5112382549', 'display_name': 'Hua Wu', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Hua Wu', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5100386394', 'display_name': 'Haifeng Wang', 'orcid': 'https://orcid.org/0000-0002-0672-7468'}, 'institutions': [{'id': 'https://openalex.org/I98301712', 'display_name': 'Baidu (China)', 'ror': 'https://ror.org/03vs3wt56', 'country_code': 'CN', 'type': 'company', 'lineage': ['https://openalex.org/I98301712']}], 'countries': ['CN'], 'is_corresponding': False, 'raw_author_name': 'Haifeng Wang', 'raw_affiliation_strings': ['Baidu Inc., Beijing, China'], 'affiliations': [{'raw_affiliation_string': 'Baidu Inc., Beijing, China', 'institution_ids': ['https://openalex.org/I98301712']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 2, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 5.836, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 37, 'citation_normalized_percentile': {'value': 0.685436, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 98, 'max': 99}, 'biblio': {'volume': None, 'issue': None, 'first_page': None, 'last_page': None}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9893, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T10181', 'display_name': 'Natural Language Processing Techniques', 'score': 0.9893, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10601', 'display_name': 'Handwritten Text Recognition Techniques', 'score': 0.9835, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10028', 'display_name': 'Topic Modeling', 'score': 0.9684, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/zhàng', 'display_name': 'Zhàng', 'score': 0.7863623}, {'id': 'https://openalex.org/keywords/chen', 'display_name': 'Chen', 'score': 0.7180068}, {'id': 'https://openalex.org/keywords/tian', 'display_name': 'Tian', 'score': 0.5524732}], 'concepts': [{'id': 'https://openalex.org/C2777045944', 'wikidata': 'https://www.wikidata.org/wiki/Q12170198', 'display_name': 'Zhàng', 'level': 3, 'score': 0.7863623}, {'id': 'https://openalex.org/C2776085556', 'wikidata': 'https://www.wikidata.org/wiki/Q183361', 'display_name': 'Chen', 'level': 2, 'score': 0.7180068}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.57134414}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5693649}, {'id': 'https://openalex.org/C2779802804', 'wikidata': 'https://www.wikidata.org/wiki/Q1364799', 'display_name': 'Tian', 'level': 2, 'score': 0.5524732}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.4795132}, {'id': 'https://openalex.org/C23123220', 'wikidata': 'https://www.wikidata.org/wiki/Q816826', 'display_name': 'Information retrieval', 'level': 1, 'score': 0.4275426}, {'id': 'https://openalex.org/C121684516', 'wikidata': 'https://www.wikidata.org/wiki/Q7600677', 'display_name': 'Computer graphics (images)', 'level': 1, 'score': 0.38830835}, {'id': 'https://openalex.org/C142362112', 'wikidata': 'https://www.wikidata.org/wiki/Q735', 'display_name': 'Art', 'level': 0, 'score': 0.1711308}, {'id': 'https://openalex.org/C95457728', 'wikidata': 'https://www.wikidata.org/wiki/Q309', 'display_name': 'History', 'level': 0, 'score': 0.14155248}, {'id': 'https://openalex.org/C124952713', 'wikidata': 'https://www.wikidata.org/wiki/Q8242', 'display_name': 'Literature', 'level': 1, 'score': 0.102834135}, {'id': 'https://openalex.org/C151730666', 'wikidata': 'https://www.wikidata.org/wiki/Q7205', 'display_name': 'Paleontology', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C166957645', 'wikidata': 'https://www.wikidata.org/wiki/Q23498', 'display_name': 'Archaeology', 'level': 1, 'score': 0.0}, {'id': 'https://openalex.org/C191935318', 'wikidata': 'https://www.wikidata.org/wiki/Q148', 'display_name': 'China', 'level': 2, 'score': 0.0}, {'id': 'https://openalex.org/C86803240', 'wikidata': 'https://www.wikidata.org/wiki/Q420', 'display_name': 'Biology', 'level': 0, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-emnlp.274', 'pdf_url': 'https://aclanthology.org/2022.findings-emnlp.274.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2210.06155', 'pdf_url': 'https://arxiv.org/pdf/2210.06155', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2022.findings-emnlp.274', 'pdf_url': 'https://aclanthology.org/2022.findings-emnlp.274.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'display_name': 'Quality education', 'score': 0.83, 'id': 'https://metadata.un.org/sdg/4'}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 38, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1966382373', 'https://openalex.org/W2470673105', 'https://openalex.org/W2891117443', 'https://openalex.org/W2896457183', 'https://openalex.org/W2938830017', 'https://openalex.org/W2953356739', 'https://openalex.org/W2962772269', 'https://openalex.org/W2964346820', 'https://openalex.org/W2965085721', 'https://openalex.org/W2965373594', 'https://openalex.org/W2966715458', 'https://openalex.org/W2998385486', 'https://openalex.org/W3000758063', 'https://openalex.org/W3003273206', 'https://openalex.org/W3003484198', 'https://openalex.org/W3004082545', 'https://openalex.org/W3007759824', 'https://openalex.org/W3010341014', 'https://openalex.org/W3011411500', 'https://openalex.org/W3092968218', 'https://openalex.org/W3098266846', 'https://openalex.org/W3104953317', 'https://openalex.org/W3120043490', 'https://openalex.org/W3122890974', 'https://openalex.org/W3151929433', 'https://openalex.org/W3173325518', 'https://openalex.org/W3173909648', 'https://openalex.org/W3175604467', 'https://openalex.org/W3176664887', 'https://openalex.org/W3176851559', 'https://openalex.org/W3194594797', 'https://openalex.org/W3202839357', 'https://openalex.org/W3205981739', 'https://openalex.org/W3210120707', 'https://openalex.org/W4221167941', 'https://openalex.org/W4385245566', 'https://openalex.org/W639708223'], 'related_works': ['https://openalex.org/W3210957918', 'https://openalex.org/W3152356608', 'https://openalex.org/W2792944589', 'https://openalex.org/W2389295586', 'https://openalex.org/W2384986722', 'https://openalex.org/W2381762621', 'https://openalex.org/W2375840727', 'https://openalex.org/W2375792328', 'https://openalex.org/W2364559953', 'https://openalex.org/W2352935415'], 'abstract_inverted_index': {'Qiming': [0], 'Peng,': [1], 'Yinxu': [2], 'Pan,': [3], 'Wenjin': [4], 'Wang,': [5], 'Bin': [6], 'Luo,': [7], 'Zhenyu': [8], 'Zhang,': [9, 19], 'Zhengjie': [10], 'Huang,': [11], 'Yuhui': [12], 'Cao,': [13], 'Weichong': [14], 'Yin,': [15], 'Yongfeng': [16], 'Chen,': [17], 'Yin': [18], 'Shikun': [20], 'Feng,': [21], 'Yu': [22], 'Sun,': [23], 'Hao': [24], 'Tian,': [25], 'Hua': [26], 'Wu,': [27], 'Haifeng': [28], 'Wang.': [29], 'Findings': [30], 'of': [31], 'the': [32], 'Association': [33], 'for': [34], 'Computational': [35], 'Linguistics:': [36], 'EMNLP': [37], '2022.': [38, 39]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W4385574075', 'counts_by_year': [{'year': 2024, 'cited_by_count': 17}, {'year': 2023, 'cited_by_count': 18}], 'updated_date': '2024-12-18T09:58:08.105210', 'created_date': '2023-08-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
