Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cloud: Load submissions into PostgreSQL only, faster #542

Merged
merged 2 commits into from
Jul 5, 2024
Merged

cloud: Load submissions into PostgreSQL only, faster #542

merged 2 commits into from
Jul 5, 2024

Commits on Jul 5, 2024

  1. tests: Make no assumption on KCIDB_DATABASE value

    @spbnick
    spbnick committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    3ac8ce8 View commit details
    Browse the repository at this point in the history

  2. cloud: Load submissions into PostgreSQL only, faster 

    Remove loading submissions into BigQuery until we come up with a way to
increase throughput (likely pulling chunks from PostgreSQL). This should
help us deal with the backlog in production submission queue.

We might also need to either switch to direct triggering of Cloud
Functions by messages from the queue, to reduce latency, or simply
switch to a persistent Cloud Run service.

Concerns: #541
    @spbnick
    spbnick committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    91e3025 View commit details
    Browse the repository at this point in the history