Skip to main content
Presentation
TTL: A transference, transformation and loading approach for active monitoring
13th international conference on Data Warehousing and Knowledge Discovery (DaWaK'11) (2011)
  • Emma Chavez-Mora, Bond University
  • Gavin Finnie, Bond University
Abstract
In Data Warehouse (DW) environments, operational processes move data from sources to the warehouse. This includes data export, preparation, and loading usually performed using Extraction, Transformation and Loading (ETL) tools. Past research has treated DW ”as collections of materialized views” whose data is regularly refreshed and locally stored [1]. Requirements have changed and real time transactions are required to support on-line operational decision making. Traditional DW systems may impose unacceptable delays due to their batch nature. ETL techniques are difficult to scale up to address the challenge of data loading, performance and low latency to provide real-time decision support. We propose a new approach for designing real-time DW in which traditional ETL does not apply. Data is pre-analysed by agents in each data source before being pushed as needed to the DW. The approach has been evaluated in a simulated environment and some of the results are discussed here.
Disciplines
Publication Date
August 29, 2011
Comments
Citation only.

Chavez-Mora, E. & Finnie, G. (2011). TTL: A transference, transformation and loading approach for active monitoring. Presented at the13th international conference on Data Warehousing and Knowledge Discovery (DaWaK'11), Toulouse, France.

Access the conference website.

2011 HERDC submission. FoR code: 080609

© Copyright Emma Chavez-Mora & Gavin Finnie, 2011
Citation Information
Emma Chavez-Mora and Gavin Finnie. "TTL: A transference, transformation and loading approach for active monitoring" 13th international conference on Data Warehousing and Knowledge Discovery (DaWaK'11) (2011)
Available at: http://works.bepress.com/emma_chavezmora/6/