A Review of Contemporary Data Quality Issues in Data Warehouse ETL Environment


Rupali Gill1 and Jaiteg Singh2 
1Assistant Professor, School of Computer Sciences, 2 Associate Professor, School of Computer Applications, Chitkara University, Punjab, India

Email: rupali.gill@chitkara.edu.in

 Abstract: In today’s scenario, Extraction–transformation– loading (ETL) tools have become important pieces of software responsible for integrating heterogeneous information from several sources. The task of carrying out the ETL process is potentially a complex, hard and time consuming. Organisations now –a-days are concerned about vast qualities of data. The data quality is concerned with technical issues in data warehouse environment. Research in last few decades has laid more stress on data quality issues in a data warehouse ETL process. The data quality can be ensured cleaning the data prior to loading the data into a warehouse. Since the data is collected from various sources, it comes in various formats. The standardization of formats and cleaning such data becomes the need of clean data warehouse environment. Data quality attributes like accuracy, correctness, consistency, timeliness are required for a Knowledge discovery process. The present state -of –the- art purpose of the research work is to deal on data quality issues at all the aforementioned stages of data warehousing 1) Data sources, 2) Data integration 3) Data staging, 4) Data warehouse modelling and schematic design and to formulate descriptive classification of these causes. The discovered knowledge is used to repair the data deficiencies. This work proposes a framework for quality of extraction transformation and loading of data into a warehouse.
DOI: 10.15415/jotitt.2014.22012
LINK: http://dspace.chitkara.edu.in/jspui/bitstream/1/520/1/22012_JOTITT_Rupali.pdf

                                      











Comments

Post a Comment

Popular posts from this blog

Manpower Planning, Scheduling and Tracking of a Construction Project Using Microsoft Project Software

Image
ABHISHEK SHARMA AND K.K. PATHAK  National Institute of Technical Teachers’ Training and Research, Bhopal (M.P.), India Email: abhishek08887@gmail.com Abstract: Many project suffers time and cost overruns due to improper planning, scheduling and execution works that results in several issues like delay in providing facilities, development, reduction in quality of construction and making the project more expensive. A little consideration shows that the time required to complete the project is inversely proportional to the supply of manpower. As the manpower is increased, the completion time of the project is decreased and on the other hand if the manpower is decreased, the completion time of the project is increased. The present study deals with the manpower planning, scheduling and tracking of “Construction of a Residential Block at Mahadev Parisar, Bhopal”, a six storied (G+6) building project whose construction is in progress at Shivaji Nagar, Bhopal, Madhya Pradesh. A c...
Read more

Analysis of Student’s Data using Rapid Miner

Image
SHEENA ANGRA, SACHIN AHUJA  Ph.D Scholar, Chitkara University, India Associate Director, CURIN, Chitkara University, India E-mail: sheena.angra@chitkara.edu.in, sachin.ahuja@chitkara.edu.in Abstract: Data mining offers a new advance to data analysis using techniques based on machine learning, together with the conventional methods collectively known as educational data mining (EDM). Educational Data Mining has turned up as an interesting and useful research area for finding methods to improve quality of education and to identify various patterns in educational settings. It is useful in extracting information of students, teachers, courses, administrators from educational institutes such as schools/ colleges/universities and helps to suggest interesting learning experiences to various stakeholders. This paper focuses on the applications of data mining in the field of education and implementation of three widely used data mining techniques using Rapid Miner on the data coll...
Read more

Review of Modeling and Simulation Technologies Application to Wind Turbines Drive Train

Image
M Sh saleh* , A A El-Betar, A M El-Assal  Mechanical Engineering Department, Benha Faculty of Engineering, Benha University AL Qalyubiya, Egypt *Email: Mohamed.saleh@bhit.bu.edu.eg Abstract: In this paper, a review of past and recent developments in the wind turbine drive train is being studied. The objective is to review some of the basic approaches of drive train configuration in wind turbines and to identify drive train models including the modeling and simulation results of these models. In recent years, considerable effort has been devoted to modeling, design, and control of wind turbine including drive train .The number of publications on computational strategies (multibody dynamics) are widely used for design and simulation of wind turbines components has been steadily increasing. Lists and reviews many contributes of design and simulation method are given in survey papers [1], [2]. DOI: 10.15415/jotitt.2014.22009 LINK:   http://dspace.chitkara.edu.in/jspui/b...
Read more