Academic
Publications
Processing of volumetric data by slice- and process-based streaming

Processing of volumetric data by slice- and process-based streaming,10.1145/1294685.1294703,Andrej Varchola,Anton Vasko,Viliam Solcany,Leonid I. Dimit

Processing of volumetric data by slice- and process-based streaming  
BibTex | RIS | RefWorks Download
Although the main memory capacity of modern computers is con- stantly growing, the developers and users of data manipulation and visualization tools fight all over again with the problem of its short- age. In this paper, we advocate slice-based streaming as a possible solution for the memory shortage problem in the case of preprocess- ing and analysis of volumetric data defined over Cartesian, regular and other types of structured grids. In our version of streaming, data flows through independent processing units—filters—represented by individual system processes, which store each just a minimal fraction of the whole data set, with a slice as a basic data entity. Such filters can be easily interconnected in complex networks by means of standard interprocess communication using named pipes and are executed concurrently on a parallel system without a re- quirement of specific modification or explicit parallelization. In our technique, the amount of stored data by a filter is defined by the algorithm implemented therein, and is in most cases as small as one data slice or only several slices. Thus, the upper bound on the processed data volume is not any more defined by the main mem- ory size but is shifted to the disc capacity, which is usually orders of magnitude larger. We propose implementations of this technique for various point, local and even global data processing operations, which may require multiple runs over the input data or eventually temporary data buffering. Further, we give a detailed performance analysis and show how well this approach fits to the current trend of employing cheap multicore processors and multiprocessor com- puters.
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.