Updated gradle to 6.9.3 and optimized build process

[ajordanow]

Build Optimisations

This PR provides set of optimisations that lead to faster build times and more robust local builds:

1. Incremental builds are now supported (hermes-consumers/build.gradle, hermes-management/build.gradle)
2. Parallel execution is enabled (org.gradle.parallel=true in gradle.properties)
3. Tests are now executed in parallel (HermesSenderTest, ReactiveHermesSenderTest, IntegrationTest and ZookeeperBaseTest had to be modified to use random ports - as reusing the same port numbers prevented the tests to be successful when running in parallel mode)
4. Gradle has been updated to 6.9.3 (latest 6.x version)

Benchmarks

The bencharks were performed on Apple M1 Max machine.

Original build

• ./gradlew clean assemble check took about 3m 11s (build scan)
• subsequent ./gradlew clean assemble check took about 20s (build scan)

Optimized build

• ./gradlew clean assemble check took about 1m 14s (build scan)
• subsequent ./gradlew clean assemble check took about 1s (build scan)

Build cache

The build cache was not enabled in the build scripts, but the builds can already benefit from it (e.g. when building locally):

# clear the cache
rm -rf ~/.gradle/caches/build-cache-1

# first build
./gradlew clean build --build-cache
...
BUILD SUCCESSFUL in 1m 16s
157 actionable tasks: 157 executed

# subsequent builds
./gradlew clean build --build-cache
...
BUILD SUCCESSFUL in 5s
157 actionable tasks: 78 executed, 79 from cache

[runningcode]

looks good, just one issue (which was already present in the build before)

[runningcode]

just some nits, but feel free to open the PR

[runningcode]

you can add the task provider here to automatically wire the task dependencies to ensure they are executed in the correct order

Suggested change

	resources.srcDir consoleDir
	resources.srcDir tasks.named('attachHermesConsole')

[ajordanow]

I think this will break the current behaviour of the build as the static files are not attached to the distZip package. This change would add a dependency that will cause static files to be included in the output.

[runningcode]

ah, i see. i suggested this with the assumption that all the outputs would be added.

Do we still would need to make sure that the ProcessResources task dependsOn attachHermesConsole?

[ajordanow]

I think not - attachHermesConsole is an auxilliary task that copies static files from other subproject. It's intended to be run manually when needed.

[alextu]

Small improvement, you should be able to replace this by from tasks.named('buildHermesConsole') and you can remove the dependsOn: 'buildHermesConsole'

[ajordanow]

done. I also had to rework this task a little bit to have dist as a source (and static part included when copying)

[szczygiel-m]

Hi @ajordanow, is this PR still relevant?

[ajordanow]

Hi @ajordanow, is this PR still relevant?

@szczygiel-m - Should be (once the merge conflicts are resolved). But the checks were never green for this PR because at the time of the PR submission they constantly failed on main.

[szczygiel-m]

Since then we have improved the stability of the tests, would you be willing to update this PR?