Difference between revisions of "Request for Changes-26: MPI Image File Writer"

From OTBWiki
Jump to: navigation, search
(MPI Image file writer)
 
(MPI Image file writer)
Line 4: Line 4:
  
 
* Author: Rémi Cresson
 
* Author: Rémi Cresson
* Additional Contributors (if different than authors)
+
* Additional Contributors: David Matthew Mattli
 
* Submitted on 11.02.2016
 
* Submitted on 11.02.2016
 
* Proposed target release 5.4
 
* Proposed target release 5.4
Line 24: Line 24:
 
otbMPIHelpers.h (containing some bridge definitions between OTB and MPI, like data types.)
 
otbMPIHelpers.h (containing some bridge definitions between OTB and MPI, like data types.)
  
 +
The actual writer writes only GeoTiffs. It relies on the SPTW (Simple Parallel Tiff Writer) [https://github.com/dmm/prasterblaster] developed by David Matthew Mattli.
 +
I have modified the SPTW to make it writing stripped images (only tiled writing was implemented).
 +
Maybe it could be convenient to refactor SPTW into the writer class and add David to the contributor list.
  
 
==== Applications ====  
 
==== Applications ====  

Revision as of 12:19, 11 February 2016

[Request for Changes - 24] MPI Image file writer

Status

  • Author: Rémi Cresson
  • Additional Contributors: David Matthew Mattli
  • Submitted on 11.02.2016
  • Proposed target release 5.4

Summary

Provide a parallel image file writer, which use MPI-IO to write one image with multiple processing nodes simultaneously

Rationale

Use OTB on HPC architectures

Implementation details

Classes and files

otbMPIImageFileWriter.h (or something like this?) otbMPIImageFileWriter.hxx otbMPIHelpers.h (containing some bridge definitions between OTB and MPI, like data types.)

The actual writer writes only GeoTiffs. It relies on the SPTW (Simple Parallel Tiff Writer) [1] developed by David Matthew Mattli. I have modified the SPTW to make it writing stripped images (only tiled writing was implemented). Maybe it could be convenient to refactor SPTW into the writer class and add David to the contributor list.

Applications

No changes.

Tests

Tests could consist in comparing one image writed with the original otb::ImageFileWriter to images produced with the parallel image file writer using different tiling scheme, strategies, etc.

Documentation

No changes.

Additional notes

List remaining open issues if any, and additional notes.