Request for Changes-26: MPI Image File Writer
[Request for Changes - 24] MPI Image writing
- Author: Rémi Cresson
- Additional contributors: Julien Michel, Emmanuelle Sarazin
- Submitted on 11.02.2016
- Proposed target release 5.6
Provide a set of parallel image file writers: -MPITiffWriter, that use MPI-IO to write one single Geotiff image simultaneously -MPIVrtWriter, that writes multiple files simultaneously then produce a VRT
Use OTB on HPC architectures
Classes and files
A Modules/MPI/MPIConfig/test/CMakeLists.txt A Modules/MPI/MPIConfig/test/otbMPIConfigTestDriver.cxx A Modules/MPI/MPIConfig/test/otbMPIConfigTest.cxx A Modules/MPI/MPIConfig/include/otbMPIConfig.h A Modules/MPI/MPIConfig/otb-module.cmake A Modules/MPI/MPIConfig/CMakeLists.txt A Modules/MPI/MPIConfig/src/CMakeLists.txt A Modules/MPI/MPIConfig/src/otbMPIConfig.cxx A Modules/MPI/MPIConfig/README A Modules/MPI/MPIVrtWriter/test/CMakeLists.txt A Modules/MPI/MPIVrtWriter/test/otbMPIVrtWriterTestDriver.cxx A Modules/MPI/MPIVrtWriter/test/otbMPIReadWriteTest.cxx A Modules/MPI/MPIVrtWriter/include/otbMPIVrtWriter.h A Modules/MPI/MPIVrtWriter/otb-module.cmake A Modules/MPI/MPIVrtWriter/CMakeLists.txt A Modules/MPI/MPITiffWriter/test/otbMPISPTWReadWriteTest.cxx A Modules/MPI/MPITiffWriter/test/CMakeLists.txt A Modules/MPI/MPITiffWriter/test/otbMPITiffWriterTestDriver.cxx A Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.txx A Modules/MPI/MPITiffWriter/include/otbSimpleParallelTiffWriter.h A Modules/MPI/MPITiffWriter/otb-module.cmake A Modules/MPI/MPITiffWriter/CMakeLists.txt
The MPITiffWriter writes only GeoTiffs. It relies on the SPTW (Simple Parallel Tiff Writer) developed by David Matthew Mattli. Pull request submitted on 15.02.2016 (to make SPTW writing stripped images,only tiled writing was implemented).
Tests could consist in comparing one image writed with the original otb::ImageFileWriter to images produced with the parallel image file writer using different tiling scheme, strategies, etc.
List remaining open issues if any, and additional notes.