diff options
| author | Vemana <vemana.github@gmail.com> | 2024-01-20 02:17:55 +0530 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-19 21:47:55 +0100 |
| commit | 6e3893c6a60ba8c514601e41f61b1d8240e2b8b5 (patch) | |
| tree | 569f8775c38133d6be0e69d060e5f5100f987f83 /prepare_phd3.sh | |
| parent | 144a6af1645d8ae9b302463f3ad472a5b8a50d62 (diff) | |
Reduce variance by (1) Using common chunks at the end (2) Busy looping (#486)
on automatic closing of ByteBuffers.. previously, a straggler could hold
up closing the ByteBuffers.
Also
- Improve Tracing code
- Parametrize additional options to aid in tuning
Our previous PR was surprising; parallelizing munmap() call did not
yield anywhere near the performance gain I expected. Local machine had
10% gain while testing machine only showed 2% gain. I am still not clear
why it happened and the two best theories I have are
1) Variance due to stragglers (that this change addresses)
2) munmap() is either too fast or too slow relative to the other
instructions compared to our local machine. I don't know which. We'll
have to use adaptive tuning, but that's in a different change.
Diffstat (limited to 'prepare_phd3.sh')
0 files changed, 0 insertions, 0 deletions
