Matthias/conduit
1
0
Fork 0
Code Issues 179 Pull requests 44 Projects Releases 5 Packages Wiki Activity

Implement backfill over federation #846

Closed
Nyaaori wants to merge 16 commits from Nyaaori/federation-backfill into next
pull from: Nyaaori/federation-backfill
merge into: Matthias:next
Conversation 18 Commits 16 Files changed 7 +630 -54
Nyaaori commented 2022-11-21 10:34:36 +00:00 (Migrated from gitlab.com)
Copy link

Updated version of !252, needs further review/testing, depends on !420, closes #44

Updated version of !252, needs further review/testing, depends on !420, closes #44
Nyaaori commented 2022-11-21 10:53:36 +00:00 (Migrated from gitlab.com)
Copy link

added 3 commits

  • f53fe66c - feat: Add federation backfill and event visibility
  • b55e4d20 - feat: Implement backfill joined/invited checks for private history
  • 69503de7 - fix: Add backfill ACL check

Compare with previous version

added 3 commits <ul><li>f53fe66c - feat: Add federation backfill and event visibility</li><li>b55e4d20 - feat: Implement backfill joined/invited checks for private history</li><li>69503de7 - fix: Add backfill ACL check</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=538011646&start_sha=29884731b3f300025e6875b63e6bbbb12067a463)
Nyaaori commented 2022-11-21 11:23:33 +00:00 (Migrated from gitlab.com)
Copy link

added 2 commits

  • 87c44ef9 - feat: Implement backfill joined/invited checks for private history
  • 125a07ba - fix: Add backfill ACL check

Compare with previous version

added 2 commits <ul><li>87c44ef9 - feat: Implement backfill joined/invited checks for private history</li><li>125a07ba - fix: Add backfill ACL check</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=538046620&start_sha=69503de71250e0df3505c3cfb68c862460bf1c89)
Nyaaori commented 2022-11-21 19:55:08 +00:00 (Migrated from gitlab.com)
Copy link

added 5 commits

  • 6786c44f - chore: Fix MSRV
  • 66bc4112 - refactor: cleanup
  • 7fbaeabf - feat: Add federation backfill and event visibility
  • b3221f92 - feat: Implement backfill joined/invited checks for private history
  • 83d3a3bc - fix: Add backfill ACL check

Compare with previous version

added 5 commits <ul><li>6786c44f - chore: Fix MSRV</li><li>66bc4112 - refactor: cleanup</li><li>7fbaeabf - feat: Add federation backfill and event visibility</li><li>b3221f92 - feat: Implement backfill joined/invited checks for private history</li><li>83d3a3bc - fix: Add backfill ACL check</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=538584048&start_sha=125a07ba30841e5b1724ef8a0c7209ec8403e86f)
Nyaaori commented 2022-11-26 12:12:49 +00:00 (Migrated from gitlab.com)
Copy link

added 13 commits

  • 83d3a3bc...249960b1 - 9 commits from branch next
  • d51f8a6c - feat: Add federation backfill and event visibility
  • 36202685 - feat: Implement backfill joined/invited checks for private history
  • 3518ee04 - fix: Add backfill ACL check
  • d47e1761 - fix: Proper S2S Backfill visibility handling

Compare with previous version

added 13 commits <ul><li>83d3a3bc...249960b1 - 9 commits from branch <code>next</code></li><li>d51f8a6c - feat: Add federation backfill and event visibility</li><li>36202685 - feat: Implement backfill joined/invited checks for private history</li><li>3518ee04 - fix: Add backfill ACL check</li><li>d47e1761 - fix: Proper S2S Backfill visibility handling</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=542809328&start_sha=83d3a3bca3a947a08230d77ee7fe2b4ae9cd882b)
Nyaaori commented 2022-11-26 12:34:03 +00:00 (Migrated from gitlab.com)
Copy link

added 1 commit

  • 5ae551b1 - fix: Default to Shared history visibility for s2s permissions, per spec

Compare with previous version

added 1 commit <ul><li>5ae551b1 - fix: Default to Shared history visibility for s2s permissions, per spec</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=542811582&start_sha=d47e1761ecb7db8e570fb68d72a942e41001850b)
Nyaaori commented 2022-11-28 03:19:36 +00:00 (Migrated from gitlab.com)
Copy link

marked this merge request as draft

marked this merge request as **draft**
timokoesters commented 2022-12-16 08:43:15 +00:00 (Migrated from gitlab.com)
Copy link

added 11 commits

  • f13673e2 - refactor: Replace specialized interface for user's membership with more...
  • 5c0b0cdc - refactor: Replace re-serialization with plain coercion
  • 297c7168 - refactor: Replace imperative style with short-circuit .any()
  • 65d7df29 - refactor: Do not extract members for room each time
  • b0238669 - refactor: Use same order as in trait
  • 179aafc9 - refactor: Take away some methods from public
  • 7f8f6b52 - refactor: Pull up invariants from the loop
  • 0d14451b - refactor: Rewrite backfill algorithm according to specification in more readable form
  • 060d88ff - refactor: Added tests to backfill
  • f2a9080b - refactor: Fixed logical condition for evil events
  • 71ab22f6 - Merge branch 'federation-backfill-suggestions' into 'Nyaaori/federation-backfill'

Compare with previous version

added 11 commits <ul><li>f13673e2 - refactor: Replace specialized interface for user&#39;s membership with more...</li><li>5c0b0cdc - refactor: Replace re-serialization with plain coercion</li><li>297c7168 - refactor: Replace imperative style with short-circuit .any()</li><li>65d7df29 - refactor: Do not extract members for room each time</li><li>b0238669 - refactor: Use same order as in trait</li><li>179aafc9 - refactor: Take away some methods from public</li><li>7f8f6b52 - refactor: Pull up invariants from the loop</li><li>0d14451b - refactor: Rewrite backfill algorithm according to specification in more readable form</li><li>060d88ff - refactor: Added tests to backfill</li><li>f2a9080b - refactor: Fixed logical condition for evil events</li><li>71ab22f6 - Merge branch &#39;federation-backfill-suggestions&#39; into &#39;Nyaaori/federation-backfill&#39;</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=559126522&start_sha=5ae551b101b72ccd561910f5785d90c46e15cc77)
Orhideous commented 2022-12-18 07:32:29 +00:00 (Migrated from gitlab.com)
Copy link

@Nyaaori What else needs to be done in this task?

@Nyaaori What else needs to be done in this task?
timokoesters commented 2022-12-18 08:48:12 +00:00 (Migrated from gitlab.com)
Copy link

Please remove the "draft" if you want a review already. Or do you want to test it more first?

Please remove the "draft" if you want a review already. Or do you want to test it more first?
Nyaaori commented 2022-12-21 09:25:39 +00:00 (Migrated from gitlab.com)
Copy link

added 41 commits

  • 71ab22f6...7b987411 - 25 commits from branch next
  • 5805c909 - feat: Add federation backfill and event visibility
  • 83e6ae3f - feat: Implement backfill joined/invited checks for private history
  • 59535e90 - fix: Add backfill ACL check
  • 0852b5c0 - fix: Proper S2S Backfill visibility handling
  • 99e6cae0 - fix: Default to Shared history visibility for s2s permissions, per spec
  • 3e6c6224 - refactor: Replace specialized interface for user's membership with more...
  • 80eebdaf - refactor: Replace re-serialization with plain coercion
  • cc6e06ee - refactor: Replace imperative style with short-circuit .any()
  • a35758ab - refactor: Do not extract members for room each time
  • 51a48fda - refactor: Use same order as in trait
  • 3818ef8d - refactor: Take away some methods from public
  • 3da37928 - refactor: Pull up invariants from the loop
  • a67075d0 - refactor: Rewrite backfill algorithm according to specification in more readable form
  • 97460823 - refactor: Added tests to backfill
  • 6f34bd6c - refactor: Fixed logical condition for evil events
  • d2c31c4f - chore: code cleanup

Compare with previous version

added 41 commits <ul><li>71ab22f6...7b987411 - 25 commits from branch <code>next</code></li><li>5805c909 - feat: Add federation backfill and event visibility</li><li>83e6ae3f - feat: Implement backfill joined/invited checks for private history</li><li>59535e90 - fix: Add backfill ACL check</li><li>0852b5c0 - fix: Proper S2S Backfill visibility handling</li><li>99e6cae0 - fix: Default to Shared history visibility for s2s permissions, per spec</li><li>3e6c6224 - refactor: Replace specialized interface for user&#39;s membership with more...</li><li>80eebdaf - refactor: Replace re-serialization with plain coercion</li><li>cc6e06ee - refactor: Replace imperative style with short-circuit .any()</li><li>a35758ab - refactor: Do not extract members for room each time</li><li>51a48fda - refactor: Use same order as in trait</li><li>3818ef8d - refactor: Take away some methods from public</li><li>3da37928 - refactor: Pull up invariants from the loop</li><li>a67075d0 - refactor: Rewrite backfill algorithm according to specification in more readable form</li><li>97460823 - refactor: Added tests to backfill</li><li>6f34bd6c - refactor: Fixed logical condition for evil events</li><li>d2c31c4f - chore: code cleanup</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=562441307&start_sha=71ab22f6bc467ddd8d370e38ef6a09361bf46916)
timokoesters commented 2022-12-21 09:26:34 +00:00 (Migrated from gitlab.com)
Copy link

marked this merge request as ready

marked this merge request as **ready**
Nyaaori commented 2022-12-21 09:46:42 +00:00 (Migrated from gitlab.com)
Copy link

added 17 commits

  • c86313d4 - chore: code cleanup
  • ed64b528 - feat: Add federation backfill and event visibility
  • 711e03b7 - feat: Implement backfill joined/invited checks for private history
  • c4bd0a9f - fix: Add backfill ACL check
  • 5d7f4602 - fix: Proper S2S Backfill visibility handling
  • 898e4d24 - fix: Default to Shared history visibility for s2s permissions, per spec
  • f814e8e5 - refactor: Replace specialized interface for user's membership with more...
  • e3dcb668 - refactor: Replace re-serialization with plain coercion
  • 5987452c - refactor: Replace imperative style with short-circuit .any()
  • e71ad56e - refactor: Do not extract members for room each time
  • 98e24722 - refactor: Use same order as in trait
  • 2717bdcf - refactor: Take away some methods from public
  • d8ee8cd0 - refactor: Pull up invariants from the loop
  • b9c2bb38 - refactor: Rewrite backfill algorithm according to specification in more readable form
  • 1fabc3cd - refactor: Added tests to backfill
  • 330e68eb - refactor: Fixed logical condition for evil events
  • c249fd7d - chore: code cleanup

Compare with previous version

added 17 commits <ul><li>c86313d4 - chore: code cleanup</li><li>ed64b528 - feat: Add federation backfill and event visibility</li><li>711e03b7 - feat: Implement backfill joined/invited checks for private history</li><li>c4bd0a9f - fix: Add backfill ACL check</li><li>5d7f4602 - fix: Proper S2S Backfill visibility handling</li><li>898e4d24 - fix: Default to Shared history visibility for s2s permissions, per spec</li><li>f814e8e5 - refactor: Replace specialized interface for user&#39;s membership with more...</li><li>e3dcb668 - refactor: Replace re-serialization with plain coercion</li><li>5987452c - refactor: Replace imperative style with short-circuit .any()</li><li>e71ad56e - refactor: Do not extract members for room each time</li><li>98e24722 - refactor: Use same order as in trait</li><li>2717bdcf - refactor: Take away some methods from public</li><li>d8ee8cd0 - refactor: Pull up invariants from the loop</li><li>b9c2bb38 - refactor: Rewrite backfill algorithm according to specification in more readable form</li><li>1fabc3cd - refactor: Added tests to backfill</li><li>330e68eb - refactor: Fixed logical condition for evil events</li><li>c249fd7d - chore: code cleanup</li></ul> [Compare with previous version](/famedly/conduit/-/merge_requests/421/diffs?diff_id=562464743&start_sha=d2c31c4ff38c0ccff6f0635787d5d1130093aeca)
timokoesters commented 2023-02-18 12:22:36 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit 6b8c3e0401648e27252e4e98f4df1be852b7f573

mentioned in commit 6b8c3e0401648e27252e4e98f4df1be852b7f573
timokoesters commented 2023-02-18 12:23:03 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit 81e34670053dcd5c378b708e88ecefc965e7f9f8

mentioned in commit 81e34670053dcd5c378b708e88ecefc965e7f9f8
timokoesters commented 2023-02-20 22:03:07 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in merge request !459

mentioned in merge request !459
timokoesters commented 2023-03-13 09:43:37 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit 23b18d71ee

mentioned in commit 23b18d71eef78544148746d30d8b9630998a3a22
timokoesters commented 2023-03-16 13:33:22 +00:00 (Migrated from gitlab.com)
Copy link

Implemented in !459

Implemented in !459
timokoesters commented 2023-03-25 19:01:39 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit yusdacra/conduit@0adb059ecc

mentioned in commit yusdacra/conduit@0adb059ecc200740636c73dc5b574b89292e2d7d

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
Android

This label indicates that the issue affects Android devices.

  
CS::needs customer feedback

Issue has been finished and needs feedback from the customer if everything is okay OR the customer needs to answer questions before issue can be worked on.

  
CS::needs follow up

We have received questions or new information from the customer that needs discussing in the meeting with Product and Sales

  
CS::needs on prem installation

This Issue needs to be installed on prem at the customer after closing

  
CS::waiting

This Issue is in progress in other teams (prod/tech)

  
Chrome

This label indicates that the issue affects the chrome browser. You should always combine it with other platforms like Android, if it only affects Android.

  
Design:: Ready

   
Design:: in progress

   
Design::UX

@Famedly: Do not use this label

  
E2EE

   
Edge

This label indicates that the issue affects Edge devices.

  
Firefox

This label indicates that the issue affects Firefox devices.

  
GDPR

   
Iteration 13 IM

   
Linux

This label indicates that the issue affects Linux devices.

  
MacOS

This label indicates that the issue affects MacOS devices.

  
Need::Discussion

Topic needs more discussion

  
Need::Steps to reproduce

   
Need::Upstream fix

   
Needs:: Planning

   
Needs::Dev-Team

This label indicates that the issue needs to be assigned to a dev team.

  
Needs::More information

   
Needs::Priority

This label should be set if there is no priority on feature or improvement requests.

  
Needs::Product

   
Needs::Refinement

the issue is triaged and needs to go to the refinement meeting to be able to set story points to the issue

  
Needs::Severity

This label should be set if bug reports need a severity.

  
Priority::1-Critical

The Priority 1 label indicates a critically dire issue such as a regression, or failure in existing features. We look at issues with this label frequently. If you find yourself assigning a Prio 1 label to an issue, please be sure that there's a positive handoff between filing and a prospective owner for the issue. Prio 1 issues should be rare. Normally there should be zero open P1 issues. "The world is on fire."

  
Priority::2-Max

The Priority 2 label indicates that the issue deserves immediate attention, such as affecting a top-tier customer. There are generally only one or two Prio 2 bugs at a time, and we aim for there to be none. "A customer is on fire."

  
Priority::3-Impending

A bug with Priority 3 flag indicates that a top-tier customer is about to encounter this bug. Generally, there are less than ten Priority 3 bugs. Issues may not be handled immediately (sometimes some Prio 4 issues are handled first), but are top-of-mind and we explicitly consider them weekly. "A customer is about to be on fire."

  
Priority::4-High

The Priority 4 label indicates high-priority issues that are at the top of the work list. This is the highest priority level an issue can have if it isn't affecting a top-tier customer or breaking the app. Bugs marked Priority 4 are generally actively being worked on unless the assignee is dealing with a P1-P3 bug(or another P4 issue).

  
Priority::5-Medium

The Priority 5 label indicates issues that we agree are important to work on, but not at the top of the work list. This is the default level for a bug. An issue at this priority level may not be worked on for a long time. Often an issue at this level will first migrate to Prio 4 before we work on them.

  
Priority::6-Low

The Priority 6 label indicates issues we think are valid but not important. This is the default level for new feature requests. We are unlikely to work on such issues unless they form part of a long-term strategic plan (see the Roadmap).

  
Priority::7-None

The Priority 7 label indicates valid issues that are unlikely to ever be worked on. We use "thumbs-up" on these issues to promote them to Priority 6 or higher based on demand.

  
Progress::Backlog

The Refinement of the issue is completed and DoR for the Squad is fulfilled

  
Progress::Review

Merge Request is ready for review. By definition MR review needs to be done by a second developer.

  
Progress::Started

The issue has been picked up for work by a developer in the team and the developer started to work on actively on the issue.

  
Progress::Testing

In testing

  
Progress::Triage

This is the first step of the process. Issue has been recently opened. Product team will identify/evaluate the following: - Clarify questions if required / verify DoR for Product is met. - It’s been identified if Design work is required or not. - Technical Feasibility - Components involved. - Team to work on that issue. - Severity (in case the issue refers to a bug)

  
Progress::Waiting

A blocker has been identified and work cannot continue.

  
Reporter::Sentry

   
Safari

This label indicates that the issue affects Safari devices.

  
Target::Community

   
Target::Customer

   
Target::Internal

   
Target::PoC

Proof of Concept - issues necessary for potential customer acquisition. Can be scoped by deadline for planned presentations

  
Target::Security

   
Team:Customer-Success

   
Team:Design

Issues which are in the competence area of the frontend chapter. It is not a scoped label anymore as issues can be part of different chapters. Before we can start implementing/changing this, we need a UI/UX design first.

  
Team:Infrastructure

Issues which are in the competence area of the infrastructure chapter. It is not a scoped label anymore as issues can be part of different chapters.

  
Team:Instant-Messaging

   
Team:Product

Issues which are in the responsibility of the product team.

  
Team:Workflows

   
Type::Bug

A software bug is an error, flaw or fault in a computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.

  
Type::Design

A task about creating or improving the UI/UX design

  
Type::Documentation

   
Type::Feature

Nothing broken; Request for a new feature.

  
Type::Improvement

An improvement or enhancement to an existing feature, technically solution or code. It makes a working functionality faster, more secure, add some additional value, refactors code etc. or helps to design a better UX and UI.

  
Type::Support

   
Type::Tests

A task about writing or improving automated or manual tests.

  
Windows

This label indicates that the issue affects Windows devices.

  
blocked

   
blocked-by-spec

   
cla-signed

   
conduit

   
contribution::advanced

   
contribution::easy

Easy task to start with a contribution

  
contribution::help needed

   
from::review

Reported by famedly review

  
iOS

This label indicates that the issue affects iOS devices.

  
p::ti-tenant

This label indicates that the issues is a requirement of the ti-tenant

  
performance

   
product::triage

   
proposal

A feature propsal.

  
refactor

   
release-blocker

This issue needs to be fixed before the next release.

  
s: dart_openapi_codegen

   
s::Famedly-Patient

Service: Famedly-Patient App

  
s::Org-Directory

For issues that relate to the organisation directory https://gitlab.com/famedly/company/backend/services/organisation-directory/

  
s::Passport-Generator

Service: PASSporT-Generator

  
s::Requeuest

For anything relevant to the requeuest library

  
s:CRM

Service: CRM

  
s:Famedly-App

Service: Famedly-App

  
s:Famedly-Web

Service: Famedly-Web

  
s:Fhiroxide

Service: Fhiroxide

  
s:Fhiroxide-cli

Fhir(oxide) maintenance and debug CLI

  
s:Fhiroxide-client

Fhiroxide client library

  
s:Fhirs

Service: FHIRS

  
s:Hedwig

Service: Hedwig

  
s:LISA

Service: LISA

  
s:Matrix-Dart-SDK

Service: Matrix-Dart-SDK

  
s:Role-Manager

Service: Role-Manager

  
s:Synapse

Service: Synapse

  
s:User-Directory

Service: User-Directory

  
s:WFS-Matrix

Service: Workflow-Service-Matrix

  
s:Workflow Engine

Service: Workflow-Engine

  
s:dtls

   
s:famedly-error

   
s:fcm-shared-isolate

   
s:matrix-api-lite

   
s:multiple-tab-detector

   
s:native-imaging

   
severity::1

Blocker: Broken feature with no workaround or any data-loss. It makes the feature unusable!

  
severity::2

Critical: Broken feature with an unacceptably complex workaround.

  
severity::3

Major: Broken feature with a workaround.

  
severity::4

Low: Functionality is inconvenient.

  
technical-debt

This Issue is a technical debt. Mark issues with this label to have an overview of the technical debts in a repository or group.

  
voip
No labels
Android
CS::needs customer feedback
CS::needs follow up
CS::needs on prem installation
CS::waiting
Chrome
Design:: Ready
Design:: in progress
Design::UX
E2EE
Edge
Firefox
GDPR
Iteration 13 IM
Linux
MacOS
Need::Discussion
Need::Steps to reproduce
Need::Upstream fix
Needs:: Planning
Needs::Dev-Team
Needs::More information
Needs::Priority
Needs::Product
Needs::Refinement
Needs::Severity
Priority::1-Critical
Priority::2-Max
Priority::3-Impending
Priority::4-High
Priority::5-Medium
Priority::6-Low
Priority::7-None
Progress::Backlog
Progress::Review
Progress::Started
Progress::Testing
Progress::Triage
Progress::Waiting
Reporter::Sentry
Safari
Target::Community
Target::Customer
Target::Internal
Target::PoC
Target::Security
Team:Customer-Success
Team:Design
Team:Infrastructure
Team:Instant-Messaging
Team:Product
Team:Workflows
Type::Bug
Type::Design
Type::Documentation
Type::Feature
Type::Improvement
Type::Support
Type::Tests
Windows
blocked
blocked-by-spec
cla-signed
conduit
contribution::advanced
contribution::easy
contribution::help needed
from::review
iOS
p::ti-tenant
performance
product::triage
proposal
refactor
release-blocker
s: dart_openapi_codegen
s::Famedly-Patient
s::Org-Directory
s::Passport-Generator
s::Requeuest
s:CRM
s:Famedly-App
s:Famedly-Web
s:Fhiroxide
s:Fhiroxide-cli
s:Fhiroxide-client
s:Fhirs
s:Hedwig
s:LISA
s:Matrix-Dart-SDK
s:Role-Manager
s:Synapse
s:User-Directory
s:WFS-Matrix
s:Workflow Engine
s:dtls
s:famedly-error
s:fcm-shared-isolate
s:matrix-api-lite
s:multiple-tab-detector
s:native-imaging
severity::1
severity::2
severity::3
severity::4
technical-debt
voip
Milestone
Clear milestone
No items
No milestone
Conduit 1.0
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Matthias/conduit#846
No description provided.
Delete branch "Nyaaori/federation-backfill"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?