Opened 3 years ago

Last modified 2 years ago

#3537 new enhancement

console_view is slow when the db is very big

Reported by: tardyp Owned by:
Priority: critical Milestone: 0.9.5
Version: master Keywords:
Cc:

Description

console view does some big queries, with limit=xx, order=timestamp, but the queries are not optimized with limits, and the

db2data takes a lot of time, before dropping most of the data

We should at least optimize the query made by console view in data api.

Probably, we should optimize all limit=xx, order=timestamp

consoleview wants buildsets buildrequests builds and changes

Change History (6)

comment:1 Changed 3 years ago by dustin

  • Milestone changed from 0.9.0 to 0.9.1
  • Priority changed from major to critical
  • Type changed from undecided to enhancement

I think this is a good idea, and important, but let's not block 0.9.0 for it.

comment:2 Changed 3 years ago by aelsabbahy

We're running into a similar problem with the buildbot main page. It is also degrading over time.

time curl 'https://nine.buildbot.net/api/v2/builds?complete=true&limit=1&order=-buildid'

1.3 seconds for ~15k builds

In our BB deployment we're seeing:

~3-5 seconds for ~80k builds

comment:3 Changed 3 years ago by tardyp

  • Milestone changed from 0.9.1 to 0.9.2

Ticket retargeted after milestone closed

comment:4 Changed 3 years ago by tardyp

  • Milestone changed from 0.9.2 to 0.9.3

Ticket retargeted after milestone closed

comment:5 Changed 3 years ago by tardyp

  • Milestone changed from 0.9.3 to 0.9.4

Ticket retargeted after milestone closed

comment:6 Changed 2 years ago by tardyp

  • Milestone changed from 0.9.4 to 0.9.5

Ticket retargeted after milestone closed

Note: See TracTickets for help on using tickets.