Project

General

Profile

Feature #16067

Use "streaming" mode in queries to reduce memory usage

Added by Marc Mengel over 3 years ago. Updated over 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
Start date:
04/04/2017
Due date:
% Done:

100%

Estimated time:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

Queries that look at, in particular lots of Jobs, pull down the whole query result into memory by default.
Since we are using Postgres in SqlAlchemy, we have the option to turn on "streaming" mode via

execution_options(stream_results=True)

for the queries, so we read the query results a few at a time as we go, and use less memory.

Changes are in JobsPOMS.py, TriagePOMS.py in 5bed12c5

History

#1 Updated by Anna Mazzacane over 3 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF