Speed is one of our main priorities for GitLab this year. We've started Gitaly, a project dedicated to that: https://gitlab.com/gitlab-org/gitaly

We expect it to become a standard component of GitLab in Q1 2017 and to reach full scope in Q3 2017.