Request for Changes-26: MPI Image File Writer

From OTBWiki
Revision as of 15:44, 13 June 2016 by Remicress (Talk | contribs) ([Request for Changes - 24] MPI Image file writer)

Jump to: navigation, search

[Request for Changes - 24] MPI Image writing


  • Author: Rémi Cresson
  • Additional contributors: Julien Michel, Emmanuelle Sarazin
  • Submitted on 11.02.2016
  • Proposed target release 5.6


Provide a set of parallel image file writers: -MPITiffWriter, that use MPI-IO to write one single Geotiff image simultaneously -MPIVrtWriter, that writes multiple files simultaneously then produce a VRT


Use OTB on HPC architectures

Implementation details

Classes and files

A       Modules/MPI/MPIConfig/test/CMakeLists.txt
A       Modules/MPI/MPIConfig/test/otbMPIConfigTestDriver.cxx
A       Modules/MPI/MPIConfig/test/otbMPIConfigTest.cxx
A       Modules/MPI/MPIConfig/include/otbMPIConfig.h
A       Modules/MPI/MPIConfig/otb-module.cmake
A       Modules/MPI/MPIConfig/CMakeLists.txt
A       Modules/MPI/MPIConfig/src/CMakeLists.txt
A       Modules/MPI/MPIConfig/src/otbMPIConfig.cxx
A       Modules/MPI/MPIConfig/README
A       Modules/MPI/MPIVrtWriter/test/CMakeLists.txt
A       Modules/MPI/MPIVrtWriter/test/otbMPIVrtWriterTestDriver.cxx
A       Modules/MPI/MPIVrtWriter/test/otbMPIReadWriteTest.cxx
A       Modules/MPI/MPIVrtWriter/include/otbMPIVrtWriter.h
A       Modules/MPI/MPIVrtWriter/otb-module.cmake
A       Modules/MPI/MPIVrtWriter/CMakeLists.txt
A       Modules/MPI/MPITiffWriter/test/otbMPISPTWReadWriteTest.cxx
A       Modules/MPI/MPITiffWriter/test/CMakeLists.txt
A       Modules/MPI/MPITiffWriter/test/otbMPITiffWriterTestDriver.cxx
A       Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.txx
A       Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.h
A       Modules/MPI/MPITiffWriter/otb-module.cmake
A       Modules/MPI/MPITiffWriter/CMakeLists.txt

The MPITiffWriter writes only GeoTiffs. It relies on the SPTW (Simple Parallel Tiff Writer) developed by David Matthew Mattli. Pull request submitted on 15.02.2016 (to make SPTW writing stripped images,only tiled writing was implemented).


No changes.


Tests could consist in comparing one image writed with the original otb::ImageFileWriter to images produced with the parallel image file writer using different tiling scheme, strategies, etc.


No changes.

Additional notes

List remaining open issues if any, and additional notes.