Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding

Name: Work Video:
Duration: 3 min 30 s
Description: Haoli Bai, Zhiguang Liu, Xiaojun Meng, Li Wentao, Shuang Liu, Yifeng Luo, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Haoli Bai; Zhiguang Liu; Xiaojun Meng; LI Wen-tao; Shuang Liu; Yifeng Luo; Nian Xie; Rongfu Zheng; Handong Wang; Lu Hou; Jiansheng Wei; Xin Jiang; Qun Liu
{'id': 'https://openalex.org/W4385571998', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.748', 'title': 'Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding', 'display_name': 'Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding', 'publication_year': 2023, 'publication_date': '2023-01-01', 'ids': {'openalex': 'https://openalex.org/W4385571998', 'doi': 'https://doi.org/10.18653/v1/2023.acl-long.748'}, 'language': 'en', 'primary_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.748', 'pdf_url': 'https://aclanthology.org/2023.acl-long.748.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': True, 'oa_status': 'hybrid', 'oa_url': 'https://aclanthology.org/2023.acl-long.748.pdf', 'any_repository_has_fulltext': True}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5080943673', 'display_name': 'Haoli Bai', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Haoli Bai', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101564586', 'display_name': 'Zhiguang Liu', 'orcid': 'https://orcid.org/0000-0002-9011-5156'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Zhiguang Liu', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100693147', 'display_name': 'Xiaojun Meng', 'orcid': 'https://orcid.org/0000-0002-7809-7012'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Xiaojun Meng', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5103674672', 'display_name': 'LI Wen-tao', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Li Wentao', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100319096', 'display_name': 'Shuang Liu', 'orcid': 'https://orcid.org/0000-0002-6332-7209'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Shuang Liu', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5102883111', 'display_name': 'Yifeng Luo', 'orcid': 'https://orcid.org/0000-0003-4863-3432'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Yifeng Luo', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5012890370', 'display_name': 'Nian Xie', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Nian Xie', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5021772803', 'display_name': 'Rongfu Zheng', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Rongfu Zheng', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100383628', 'display_name': 'Handong Wang', 'orcid': 'https://orcid.org/0000-0001-5989-9338'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Liangwei Wang', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101663633', 'display_name': 'Lu Hou', 'orcid': 'https://orcid.org/0000-0002-4694-1821'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Lu Hou', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5101182327', 'display_name': 'Jiansheng Wei', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Jiansheng Wei', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5100650977', 'display_name': 'Xin Jiang', 'orcid': 'https://orcid.org/0009-0005-5164-306X'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Xin Jiang', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5100426170', 'display_name': 'Qun Liu', 'orcid': 'https://orcid.org/0000-0002-7000-1792'}, 'institutions': [{'id': 'https://openalex.org/I4210159102', 'display_name': 'Huawei Technologies (Sweden)', 'ror': 'https://ror.org/0500fyd17', 'country_code': 'SE', 'type': 'company', 'lineage': ['https://openalex.org/I2250955327', 'https://openalex.org/I4210159102']}], 'countries': ['SE'], 'is_corresponding': False, 'raw_author_name': 'Qun Liu', 'raw_affiliation_strings': ['Ark Lab, Huawei Technologies'], 'affiliations': [{'raw_affiliation_string': 'Ark Lab, Huawei Technologies', 'institution_ids': ['https://openalex.org/I4210159102']}]}], 'institution_assertions': [], 'countries_distinct_count': 1, 'institutions_distinct_count': 1, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 0.548, 'has_fulltext': True, 'fulltext_origin': 'pdf', 'cited_by_count': 2, 'citation_normalized_percentile': {'value': 0.999956, 'is_in_top_1_percent': True, 'is_in_top_10_percent': True}, 'cited_by_percentile_year': {'min': 79, 'max': 84}, 'biblio': {'volume': None, 'issue': None, 'first_page': '13386', 'last_page': '13401'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9629, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T11714', 'display_name': 'Multimodal Machine Learning Applications', 'score': 0.9629, 'subfield': {'id': 'https://openalex.org/subfields/1707', 'display_name': 'Computer Vision and Pattern Recognition'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/computational-linguistics', 'display_name': 'Computational linguistics', 'score': 0.44145548}], 'concepts': [{'id': 'https://openalex.org/C71139939', 'wikidata': 'https://www.wikidata.org/wiki/Q910194', 'display_name': 'Modal', 'level': 2, 'score': 0.63543034}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.5515782}, {'id': 'https://openalex.org/C204321447', 'wikidata': 'https://www.wikidata.org/wiki/Q30642', 'display_name': 'Natural language processing', 'level': 1, 'score': 0.51791257}, {'id': 'https://openalex.org/C154945302', 'wikidata': 'https://www.wikidata.org/wiki/Q11660', 'display_name': 'Artificial intelligence', 'level': 1, 'score': 0.44722947}, {'id': 'https://openalex.org/C155092808', 'wikidata': 'https://www.wikidata.org/wiki/Q182557', 'display_name': 'Computational linguistics', 'level': 2, 'score': 0.44145548}, {'id': 'https://openalex.org/C23123220', 'wikidata': 'https://www.wikidata.org/wiki/Q816826', 'display_name': 'Information retrieval', 'level': 1, 'score': 0.3730087}, {'id': 'https://openalex.org/C28490314', 'wikidata': 'https://www.wikidata.org/wiki/Q189436', 'display_name': 'Speech recognition', 'level': 1, 'score': 0.36024857}, {'id': 'https://openalex.org/C185592680', 'wikidata': 'https://www.wikidata.org/wiki/Q2329', 'display_name': 'Chemistry', 'level': 0, 'score': 0.0}, {'id': 'https://openalex.org/C188027245', 'wikidata': 'https://www.wikidata.org/wiki/Q750446', 'display_name': 'Polymer chemistry', 'level': 1, 'score': 0.0}], 'mesh': [], 'locations_count': 2, 'locations': [{'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.748', 'pdf_url': 'https://aclanthology.org/2023.acl-long.748.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, {'is_oa': True, 'landing_page_url': 'https://arxiv.org/abs/2212.09621', 'pdf_url': 'https://arxiv.org/pdf/2212.09621', 'source': {'id': 'https://openalex.org/S4306400194', 'display_name': 'arXiv (Cornell University)', 'issn_l': None, 'issn': None, 'is_oa': True, 'is_in_doaj': False, 'is_core': False, 'host_organization': 'https://openalex.org/I205783295', 'host_organization_name': 'Cornell University', 'host_organization_lineage': ['https://openalex.org/I205783295'], 'host_organization_lineage_names': ['Cornell University'], 'type': 'repository'}, 'license': None, 'license_id': None, 'version': 'submittedVersion', 'is_accepted': False, 'is_published': False}], 'best_oa_location': {'is_oa': True, 'landing_page_url': 'https://doi.org/10.18653/v1/2023.acl-long.748', 'pdf_url': 'https://aclanthology.org/2023.acl-long.748.pdf', 'source': None, 'license': 'cc-by', 'license_id': 'https://openalex.org/licenses/cc-by', 'version': 'publishedVersion', 'is_accepted': True, 'is_published': True}, 'sustainable_development_goals': [{'id': 'https://metadata.un.org/sdg/4', 'display_name': 'Quality education', 'score': 0.85}], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 36, 'referenced_works': ['https://openalex.org/W1522301498', 'https://openalex.org/W1966382373', 'https://openalex.org/W2338908902', 'https://openalex.org/W2962772269', 'https://openalex.org/W2965373594', 'https://openalex.org/W2986619406', 'https://openalex.org/W3000758063', 'https://openalex.org/W3003484198', 'https://openalex.org/W3003711898', 'https://openalex.org/W3007759824', 'https://openalex.org/W3035390927', 'https://openalex.org/W3094502228', 'https://openalex.org/W3096609285', 'https://openalex.org/W3104953317', 'https://openalex.org/W3120043490', 'https://openalex.org/W3132296545', 'https://openalex.org/W3152774549', 'https://openalex.org/W3166396011', 'https://openalex.org/W3173325518', 'https://openalex.org/W3176664887', 'https://openalex.org/W3176851559', 'https://openalex.org/W3184735396', 'https://openalex.org/W3190292546', 'https://openalex.org/W3194594797', 'https://openalex.org/W3202839357', 'https://openalex.org/W3212456749', 'https://openalex.org/W3212748493', 'https://openalex.org/W3214042621', 'https://openalex.org/W4221167912', 'https://openalex.org/W4221167941', 'https://openalex.org/W4226020328', 'https://openalex.org/W4226182655', 'https://openalex.org/W4287123554', 'https://openalex.org/W4304013646', 'https://openalex.org/W4304014014', 'https://openalex.org/W4385574075'], 'related_works': ['https://openalex.org/W3022131925', 'https://openalex.org/W2789919619', 'https://openalex.org/W2357241418', 'https://openalex.org/W2349174110', 'https://openalex.org/W2293457016', 'https://openalex.org/W2153015554', 'https://openalex.org/W2119135658', 'https://openalex.org/W2115485936', 'https://openalex.org/W2086064646', 'https://openalex.org/W1597238586'], 'abstract_inverted_index': {'Haoli': [0], 'Bai,': [1], 'Zhiguang': [2], 'Liu,': [3, 9], 'Xiaojun': [4], 'Meng,': [5], 'Li': [6], 'Wentao,': [7], 'Shuang': [8], 'Yifeng': [10], 'Luo,': [11], 'Nian': [12], 'Xie,': [13], 'Rongfu': [14], 'Zheng,': [15], 'Liangwei': [16], 'Wang,': [17], 'Lu': [18], 'Hou,': [19], 'Jiansheng': [20], 'Wei,': [21], 'Xin': [22], 'Jiang,': [23], 'Qun': [24], 'Liu.': [25], 'Proceedings': [26], 'of': [27, 32], 'the': [28, 33], '61st': [29], 'Annual': [30], 'Meeting': [31], 'Association': [34], 'for': [35], 'Computational': [36], 'Linguistics': [37], '(Volume': [38], '1:': [39], 'Long': [40], 'Papers).': [41], '2023.': [42]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W4385571998', 'counts_by_year': [{'year': 2024, 'cited_by_count': 1}, {'year': 2023, 'cited_by_count': 1}], 'updated_date': '2024-12-23T09:32:23.834657', 'created_date': '2023-08-05'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
