Request for Changes-26: MPI Image File Writer

From OTBWiki
Revision as of 15:44, 13 June 2016 by Remicress (Talk | contribs) ([Request for Changes - 24] MPI Image file writer)

Jump to: navigation, search

[Request for Changes - 24] MPI Image writing

Status

  • Author: Rémi Cresson
  • Additional contributors: Julien Michel, Emmanuelle Sarazin
  • Submitted on 11.02.2016
  • Proposed target release 5.6

Summary

Provide a set of parallel image file writers: -MPITiffWriter, that use MPI-IO to write one single Geotiff image simultaneously -MPIVrtWriter, that writes multiple files simultaneously then produce a VRT

Rationale

Use OTB on HPC architectures

Implementation details

Classes and files

A       Modules/MPI/MPIConfig/test/CMakeLists.txt
A       Modules/MPI/MPIConfig/test/otbMPIConfigTestDriver.cxx
A       Modules/MPI/MPIConfig/test/otbMPIConfigTest.cxx
A       Modules/MPI/MPIConfig/include/otbMPIConfig.h
A       Modules/MPI/MPIConfig/otb-module.cmake
A       Modules/MPI/MPIConfig/CMakeLists.txt
A       Modules/MPI/MPIConfig/src/CMakeLists.txt
A       Modules/MPI/MPIConfig/src/otbMPIConfig.cxx
A       Modules/MPI/MPIConfig/README
A       Modules/MPI/MPIVrtWriter/test/CMakeLists.txt
A       Modules/MPI/MPIVrtWriter/test/otbMPIVrtWriterTestDriver.cxx
A       Modules/MPI/MPIVrtWriter/test/otbMPIReadWriteTest.cxx
A       Modules/MPI/MPIVrtWriter/include/otbMPIVrtWriter.h
A       Modules/MPI/MPIVrtWriter/otb-module.cmake
A       Modules/MPI/MPIVrtWriter/CMakeLists.txt
A       Modules/MPI/MPITiffWriter/test/otbMPISPTWReadWriteTest.cxx
A       Modules/MPI/MPITiffWriter/test/CMakeLists.txt
A       Modules/MPI/MPITiffWriter/test/otbMPITiffWriterTestDriver.cxx
A       Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.txx
A       Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.h
A       Modules/MPI/MPITiffWriter/otb-module.cmake
A       Modules/MPI/MPITiffWriter/CMakeLists.txt

The MPITiffWriter writes only GeoTiffs. It relies on the SPTW (Simple Parallel Tiff Writer) developed by David Matthew Mattli. Pull request submitted on 15.02.2016 (to make SPTW writing stripped images,only tiled writing was implemented).

Applications

No changes.

Tests

Tests could consist in comparing one image writed with the original otb::ImageFileWriter to images produced with the parallel image file writer using different tiling scheme, strategies, etc.

Documentation

No changes.

Additional notes

List remaining open issues if any, and additional notes.