forked from Silverfish/proton-bridge
a2ab5df7ce
Revise syncing work distribution. Sync time can be reduced by up to 50%. Rework the sync so that it pipelines better with bigger batch counts at each stage. We now use 3 separate stages: Download, Updates and Sync. The Download stage downloads messages in maxBatchSize intervals using 1.5x syncWorkers. Once the current batch has finished downloading it's forwarded to the Updates stage and we proceed to download the next batch. The Update stage converts everything into gluon updates and prepares a collection of noops that the sync stage can wait on for termination. Finally the sync stage waits until the updates have been applied in Gluon so that the vault information can be updated. We allow up to 4 pending wait operations to be queued currently to not block the pipeline.