Patexia. Research
Issue Date Nov 15, 2001
Claim this application

Patent Application - Continuous flow compute point based data processing > Summary

US Patent Application

Patent Application No. US 20010042224

Published on Nov 15, 2001

Application No. 09/731234

Filed on Dec 5, 2000

Priority Date -

Inventor/Applicants

3

Stanfill, Craig W. (44)

Shapiro, Richard A. (16)

Kukolich, Stephen A.

Abstract

A data processing system and method that provides two processes, checkpointing and compute point propagation, and permits a continuous flow of data processing by allowing each process to (1) return to normal operation after checkpointing or (2) respond to receipt of a compute point indicator, independently of the time required by other processes for similar responsive actions. Checkpointing makes use of a command message from a checkpoint processor that sequentially propagates through a process stage from data sources through processes to data sinks, triggering each process to checkpoint its state and then pass on a checkpointing message to connected downstream processes. A compute point indicator marks blocks of records that should be processed as a group within each process. A compute point indicator is triggered and sequentially propagates through a process stage from data sources through processes to data sinks without external control. Compute point indicators also effectively self-synchronize multiple data flows without external control. Use of compute point indicators rather than checkpoints avoids the time delay that saving state imposes, while permitting a continuous flow of data processing, including outputting results.

Classification

International:

G06F 11/00

National:

714/160.