Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cleanup InstanceOperations API for active scans/compactions #5102

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

cshannon
Copy link
Contributor

This simplifies the API for getting active scans and active compactions. The new API has been updated to just use a collection of servers instead of trying to also support other arguments (like a single server). Other methods were removed if new or deprecated if old, such as getActiveCompactions().

Getting active scans was updated to be multi-threaded like getting active compactions, and they now share the same code. If there are not multiple servers to query then the code now just uses a direct executor to prevent creating a thread pool.

The listscans command was updated to take advantage of the new API and to use multiple threads to collect the scans to speed things up.

Lastly, the tests have been updated to account for the API changes.

This closes #5096

This simplifies the API for getting active scans and active compactions.
The new API has been updated to just use a collection of servers instead
of trying to also support other arguments (like a single server). Other
methods were removed if new or deprecated if old, such as
getActiveCompactions().

Getting active scans was updated to be multi-threaded like getting
active compactions, and they now share the same code. If there are not
multiple servers to query then the code now just uses a direct executor
to prevent creating a thread pool.

The listscans command was updated to take advantage of the new API and
to use multiple threads to collect the scans to speed things up.

Lastly, the tests have been updated to account for the API changes.

This closes apache#5096
@cshannon cshannon added this to the 4.0.0 milestone Nov 24, 2024
@cshannon cshannon self-assigned this Nov 24, 2024
as.getScanid(), as.getSsiList(), as.getSsio()));
});
} catch (AccumuloException | AccumuloSecurityException e) {
return Stream.of("ERROR " + e.getMessage());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That is an interesting way to propagate the error message.

Copy link
Contributor Author

@cshannon cshannon Nov 24, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same thing as my comment on getHost(), that's what listcompactions does and I modeled the changes here after that command. Also the original iterator printed an error message in the same way if there was an error.

@cshannon
Copy link
Contributor Author

@keith-turner - this is ready for another review after the latest updates

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cleanup InstanceOperations API for retrieving active scans and compactions
2 participants