摘 要: 随着信息技术的不断发展与成熟,数据中心建设是值得我们探讨的课题。本文从大数据时代ETL所面临 的挑战进行分析,提出解决问题的思路和措施,研究和设计了企业级数据中心的分布式ETL方案,并就ETL关键技术、 Data Vault混合数据建模、异常处理及保障进行了探讨。 |
关键词: 信息技术;大数据;ETL;Data Vault |
中图分类号: TP311.1
文献标识码: A
|
|
Research and Design of Distributed ETL for Enterprise Data Center |
WENG Yelin,ZHOU Hong,HOU Bing1,2,3
|
1.( 1.Jiangsu Vocational and Technical College of Finance and Economics, Huai'an 223001, China;2. 2.Huaiyin Institute of Technology, Huai'an 223001, China;3. 3.Nanjing Lianchuang Data Company, Nanjing 210001, China)
|
Abstract: With the continuous development and maturity of information technology,data center construction is one of the topics worth discussing.This paper analyses the challenges faced by ETL in the era of big data,puts forward the ideas and measures to solve these problems,studies and designs the distributed ETL scheme of enterprise data center,and discusses the key technologies of ETL,data Vault mixed data modeling,exception handling and guarantees. |
Keywords: information technology;big data;ETL;Data Vault |