Changes between Version 5 and Version 6 of GSoC/2021/RasterParallelization

Timestamp:

06/28/21 01:03:46 (4 years ago)

Author:

aaronsms

Comment:

--

GSoC/2021/RasterParallelization

@@ -228 +228 @@
 No, it has been good so far, but I hope to improve on my pace.
 
+=== Week 2 ===
+
+'''1) What did I get done this week?'''
+
+r.univar\\
+ - Address changes for the PR (1) , e.g. to use a standard option "nprocs" will now be a parameter for users to indicate the number of threads
+
+r.neighbor\\
+ - Write test cases for parallel execution
+ - Drafted a PR alongside its implementation (2)
+
+r.proj\\
+ - Write new test cases for the modules (3)
+
+'''2) What do I plan on doing next week?'''\\
+
+I have managed to come up with a way to parallelize output-based modules like r.neighbor. The idea is to make use of a temporary segment file to allow threads to perform random write operations, which is not possible directly on compressed raster format file without using intermediate cache. With this design in mind, I intend to continue to parallelize similar modules next week. Also, there may be ideas in discussion to encapsulate a benchmarking framework possibly under grass.benchmark as this will be used repeatedly in the future to measure performance.
+
+
+'''3) Am I blocked on anything?'''\\
+
+No, it has been good so far.
+
+(1) [https://github.com/OSGeo/grass/pull/1634]\\
+(2) [https://github.com/OSGeo/grass/pull/1654]\\
+(3) [https://github.com/OSGeo/grass/pull/1663]\\
+(4) [https://github.com/OSGeo/grass/pull/1670]\\
+
+
+=== Week 3 ===
+
+'''1) What did I get done this week?'''
+
+Upon discussion with the mentors, we have decided to explore alternative designs to using Segment library as intermediate output buffer. Specifically, there are two designs in mind, one which simply increases the size of the buffer but does sequential I/O to fill and output from the buffer with intermediate parallel computation, and a more complicated one which tries to eliminate having the threads to wait for the I/O.
+
+'''2) What do I plan on doing next week?'''\\
+
+I plan to finalize the design by this week. (1)
+
+'''3) Am I blocked on anything?'''\\
+
+No, it has been good so far.
+
+(1) https://github.com/aaronsms/grass
+
 == Final report ==