Title: Automated Data Validation Framework for Data Quality in Big Data Migration Projects
Abstract: The process of moving vast amount of data from one place to another is called big data migration. Huge volume of data is extracted, transformed, structured and loaded from legacy data base into a newer structure in the process which leads to data corruption. Data validation testing is essential after data migration process over to ensure data quality. To perform efficient data migration process, source data are mapped to new system which handles all the data formats. It is important when upgrade and relocation of existing systems. Businesses are creating significant data management challenges by increasing volumes of data. They should be able to access and organize volumes of data stored in a variety formats. Compare to manual process, automate data validation improve data quality in less time and cost with good quality. This paper emphasis on proposing model to do automatic quality checks for huge volume of data migrations.
Publication Year: 2014
Publication Date: 2014-01-01
Language: en
Type: article
Access and Citation
Cited By Count: 1
AI Researcher Chatbot
Get quick answers to your questions about the article from our AI researcher chatbot