Real-Time Data Streaming
Traditionally, data warehouses received periodic batch loads on varying schedules:
- Typically daily
- Sometimes weekly
- Rarely monthly
Modern data analytic repositories are incrementally loaded several times during the business work day or even at an hourly level, with some systems updating data in near real time, such as every five minutes.
Data Latency
Data Latency is the time delay between when data is generated and when it is available for use. When critical data fails to arrive within established Service Level Agreements (SLAs), it constitutes a Data Outage.
Real-Time Streaming Technologies
- Quest SharePlex
- Oracle GoldenGate
- QLIK Replicate
- FiveTran HVR
These tools enable asynchronous data pushing from source to target systems, maintaining continuous data synchronization.