Skip to content

Investigate cause of slow performance for TOMs with large databases #668

Open
0 of 1 issue completed

Description

@rachel3834

Is your feature request related to a problem? Please describe.
A number of projects have build TOMs with very large databases, including some that have customised the TOM DB.
A good example is the DESC-TOM, which ingested alert and classification information for a large set of simulated LSST alerts from several different brokers. The goal was to compare the classification data for the same alerts from different brokers, necessitating a large table join. Queries against this DB were very slow.

Describe the solution you'd like
Explore alternative DB structures that might offer better performance for these kinds of projects, for example no-SQL.

Additional context
This has been highlighed as an issue for the DESC-TOM and Sagguro projects.

This is related to:

Note
Snex has found some success with lazy-loading their plots to speed up page loads:

Activity

  1. moved this from Backlog to Icebox in TOM Toolkiton Oct 30, 2023
  2. linked a pull request that will close this issueFix/slow target list #619on Oct 1, 2024
  3. added
    bugSomething isn't working
    EpicOverview topic for high level discussion
    on Oct 1, 2024
  4. moved this from Icebox to Triage in TOM Toolkiton Oct 1, 2024
  5. moved this from Triage to Backlog in TOM Toolkiton Oct 17, 2024
  6. moved this from Backlog to Epic in TOM Toolkiton Apr 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    EpicOverview topic for high level discussionbugSomething isn't workingenhancementNew feature or request

    Type

    No type

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions