conduit v0.2 leaks memory #192

Closed
opened 2021-11-22 19:14:42 +00:00 by jpds · 6 comments
jpds commented 2021-11-22 19:14:42 +00:00 (Migrated from gitlab.com)

Description

I've been running conduit v0.2 on a small 1GB RAM cloud instance with less than 20 users on it.

It consistently runs out of memory after a week or week and a half days of running:

Out of memory: Killed process 559 (conduit) total-vm:1719304kB, anon-rss:707400kB, file-rss:0kB, shmem-rss:0kB, UID:1000 pgtables:1640kB oom_score_adj:0

I tried dumping the memory with gdb today to try and help pinpoint where the leak is, but conduit was killed by the kernel before this happened. Filing this tracking bug for now until I see it again.

System Configuration

OS: Debian 11
Conduit Version: v0.2
Database backend (default is sqlite): sqlite

### Description I've been running conduit v0.2 on a small 1GB RAM cloud instance with less than 20 users on it. It consistently runs out of memory after a week or week and a half days of running: ``` Out of memory: Killed process 559 (conduit) total-vm:1719304kB, anon-rss:707400kB, file-rss:0kB, shmem-rss:0kB, UID:1000 pgtables:1640kB oom_score_adj:0 ``` I tried dumping the memory with `gdb` today to try and help pinpoint where the leak is, but conduit was killed by the kernel before this happened. Filing this tracking bug for now until I see it again. ### System Configuration OS: Debian 11 Conduit Version: v0.2 Database backend (default is sqlite): sqlite
timokoesters commented 2021-11-22 19:27:48 +00:00 (Migrated from gitlab.com)

Yeah I am aware of this problem. This is what is currently blocking the next release (along with fixing high IO usage). If you can find out more about the problem, please tell me. It has to be something about sqlite... (conduit to sqlite connection code is at src/database/abstraction/sqlite.rs)

Yeah I am aware of this problem. This is what is currently blocking the next release (along with fixing high IO usage). If you can find out more about the problem, please tell me. It has to be something about sqlite... (conduit to sqlite connection code is at src/database/abstraction/sqlite.rs)
shadowjonathan commented 2021-11-22 22:03:50 +00:00 (Migrated from gitlab.com)

mentioned in merge request !227

mentioned in merge request !227
timokoesters commented 2021-12-14 13:54:18 +00:00 (Migrated from gitlab.com)

mentioned in issue #202

mentioned in issue #202
timokoesters commented 2021-12-14 14:03:57 +00:00 (Migrated from gitlab.com)

Hopefully this will be fixed with !227. If not this might improve when we rocksdb.

Hopefully this will be fixed with !227. If not this might improve when we rocksdb.
timokoesters commented 2022-01-06 10:10:31 +00:00 (Migrated from gitlab.com)

People have reported that it is indeed stable with rocksdb, can you try out the rocksdb branch? Happy to help you set it up in the #conduit chat room

People have reported that it is indeed stable with rocksdb, can you try out the rocksdb branch? Happy to help you set it up in the #conduit chat room
timokoesters commented 2022-02-09 19:09:11 +00:00 (Migrated from gitlab.com)

Please try again on Conduit v0.3.0, if it is still an issue for you, please reopen.

Please try again on Conduit v0.3.0, if it is still an issue for you, please reopen.
Sign in to join this conversation.
No labels
Android
CS::needs customer feedback
CS::needs follow up
CS::needs on prem installation
CS::waiting
Chrome
Design:: Ready
Design:: in progress
Design::UX
E2EE
Edge
Firefox
GDPR
Iteration 13 IM
Linux
MacOS
Need::Discussion
Need::Steps to reproduce
Need::Upstream fix
Needs:: Planning
Needs::Dev-Team
Needs::More information
Needs::Priority
Needs::Product
Needs::Refinement
Needs::Severity
Priority::1-Critical
Priority::2-Max
Priority::3-Impending
Priority::4-High
Priority::5-Medium
Priority::6-Low
Priority::7-None
Progress::Backlog
Progress::Review
Progress::Started
Progress::Testing
Progress::Triage
Progress::Waiting
Reporter::Sentry
Safari
Target::Community
Target::Customer
Target::Internal
Target::PoC
Target::Security
Team:Customer-Success
Team:Design
Team:Infrastructure
Team:Instant-Messaging
Team:Product
Team:Workflows
Type::Bug
Type::Design
Type::Documentation
Type::Feature
Type::Improvement
Type::Support
Type::Tests
Windows
blocked
blocked-by-spec
cla-signed
conduit
contribution::advanced
contribution::easy
contribution::help needed
from::review
iOS
p::ti-tenant
performance
product::triage
proposal
refactor
release-blocker
s: dart_openapi_codegen
s::Famedly-Patient
s::Org-Directory
s::Passport-Generator
s::Requeuest
s:CRM
s:Famedly-App
s:Famedly-Web
s:Fhiroxide
s:Fhiroxide-cli
s:Fhiroxide-client
s:Fhirs
s:Hedwig
s:LISA
s:Matrix-Dart-SDK
s:Role-Manager
s:Synapse
s:User-Directory
s:WFS-Matrix
s:Workflow Engine
s:dtls
s:famedly-error
s:fcm-shared-isolate
s:matrix-api-lite
s:multiple-tab-detector
s:native-imaging
severity::1
severity::2
severity::3
severity::4
technical-debt
voip
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Matthias/conduit#192
No description provided.