HIVE-28638: Refactor stats handling in StatsRecordingThreadPool

[abstractdog]

What changes were proposed in this pull request?

Refactoring StatsRecordingThreadPool and creating a new class LlapThreadLocalStatistics.

Why are the changes needed?

Describe in jira.

Does this PR introduce any user-facing change?

No.

Is the change a dependency upgrade?

No.

How was this patch tested?

Unit tests were added for the new class LlapThreadLocalStatistics.

Tested on a cluster (using file + s3), before/after results were almost the same. Ignoring <1% difference between different runs.

E.g. without patch
1.

INFO  : File System Counters:
INFO  :    FILE_BYTES_READ: 0
INFO  :    FILE_BYTES_WRITTEN: 39544287
INFO  :    FILE_READ_OPS: 0
INFO  :    FILE_LARGE_READ_OPS: 0
INFO  :    FILE_WRITE_OPS: 0
INFO  :    S3A_BYTES_READ: 53568465091
INFO  :    S3A_BYTES_WRITTEN: 0
INFO  :    S3A_READ_OPS: 3553
INFO  :    S3A_LARGE_READ_OPS: 0
INFO  :    S3A_WRITE_OPS: 0
INFO  : org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable$LlapExecutorCounters:
INFO  :    EXECUTOR_CPU_NS: 8966273470486
INFO  :    EXECUTOR_USER_NS: 8663430000000

INFO  : File System Counters:
INFO  :    FILE_BYTES_READ: 0
INFO  :    FILE_BYTES_WRITTEN: 39544265
INFO  :    FILE_READ_OPS: 0
INFO  :    FILE_LARGE_READ_OPS: 0
INFO  :    FILE_WRITE_OPS: 0
INFO  :    S3A_BYTES_READ: 53568432323
INFO  :    S3A_BYTES_WRITTEN: 0
INFO  :    S3A_READ_OPS: 3549
INFO  :    S3A_LARGE_READ_OPS: 0
INFO  :    S3A_WRITE_OPS: 0
INFO  : org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable$LlapExecutorCounters:
INFO  :    EXECUTOR_CPU_NS: 9374354807466
INFO  :    EXECUTOR_USER_NS: 9058920000000

with patch:
1.

INFO  : File System Counters:
INFO  :    FILE_BYTES_READ: 0
INFO  :    FILE_BYTES_WRITTEN: 39544250
INFO  :    FILE_READ_OPS: 0
INFO  :    FILE_LARGE_READ_OPS: 0
INFO  :    FILE_WRITE_OPS: 0
INFO  :    S3A_BYTES_READ: 53568399555
INFO  :    S3A_BYTES_WRITTEN: 0
INFO  :    S3A_READ_OPS: 3545
INFO  :    S3A_LARGE_READ_OPS: 0
INFO  :    S3A_WRITE_OPS: 0
INFO  : org.apache.hadoop.hive.llap.LlapThreadLocalStatistics$LlapExecutorCounters:
INFO  :    EXECUTOR_CPU_NS: 9240866526570
INFO  :    EXECUTOR_USER_NS: 8923940000000

INFO  : File System Counters:
INFO  :    FILE_BYTES_READ: 0
INFO  :    FILE_BYTES_WRITTEN: 39544274
INFO  :    FILE_READ_OPS: 0
INFO  :    FILE_LARGE_READ_OPS: 0
INFO  :    FILE_WRITE_OPS: 0
INFO  :    S3A_BYTES_READ: 53568432323
INFO  :    S3A_BYTES_WRITTEN: 0
INFO  :    S3A_READ_OPS: 3549
INFO  :    S3A_LARGE_READ_OPS: 0
INFO  :    S3A_WRITE_OPS: 0
INFO  : org.apache.hadoop.hive.llap.LlapThreadLocalStatistics$LlapExecutorCounters:
INFO  :    EXECUTOR_CPU_NS: 9263414528077
INFO  :    EXECUTOR_USER_NS: 8946070000000

[zratkai]

Please check my comments!

[abstractdog]

Please check my comments!

thanks, responded to those, please let me know if a follow-up needed somewhere

[zratkai]

Thanks for the answers!

[sonarcloud]

Quality Gate passed

Issues
6 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud