GitLab GitLab 13.4 Release Product Kickoff, 13 Aug 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: GitLab 13.4 Kickoff - Create:Gitaly

Description

Planning issue: https://gitlab.com/gitlab-org/create-stage/-/issues/12708

A

Hi, this is derek ferguson, the new interim senior product manager for the gitlie group here at git lab, and today I'm going to be going over what we are working towards delivering in the 13.4 release of git lab. Our top priority is getting to a ga of strong consistency for goodly cluster by enabling quorum based transaction voting by default.

A

What this will do is allow for a quorum of getaly nodes to agree on a transaction before that right transaction succeeds. This is building on top of what we delivered in 13.3 to enable a version of this where the primary node can override the secondary nodes during the voting for a right transaction to succeed.

A

The second thing that we're working on is being able to override the replication factor for specific repositories within gita cluster.

A

Currently, the replication factor has to match the number of nodes within the cluster, however, for very large repositories that have large storage requirements enabling gitaly cluster with this replication factor can significantly increase the number uh or the amount of storage that's needed for that cluster.

A

By enabling the replication factor for specific repositories, we will allow this storage need to be reduced by only upping the replication factor for the most important repositories or the most active repositories.

A

So this will significantly reduce the storage needs for a gita leak cluster.

A

Another thing that we are working on and have been working on for quite a while is improving the backups for repositories within git lab, especially for large repositories. The backup solution right now is not very feasible and can run very slowly.

A

There are several workarounds that have been posted in the docs. However, we're working on improving this within git lab itself by enabling incremental repository backups the thing that we're working on within 13.4 is skipping the generation of a git bundle if that bundle already exists and has the same checksum as uh the bundle within a previous backup.

A

This will enable much quicker backups and allow for it to be much more efficient and incrementally back up the repository and, finally, a long-running project that we've been working on for a while is improving the native get support for large binary files.

A

What we are working on in order to support this within gitlab for 13.4 is delivering a http driver, an http protocol for partial clone for large binary blobs, since the git protocol delivers the entire data packed together by implementing an http protocol, it allows us to stream the data by breaking it up into multiple chunks that can be downloaded concurrently and allows for much quicker and more efficient delivery of these binary blobs, as opposed to the git protocol.

A

All right! So that's what we are delivering in 13.4. Thank you very much. We're very excited about what we're working on, and we hope that you find this useful.