@khoi@slrpnk.net if you're okay with that I suggest you check out this https://gitolite.com/gitolite/overview.html.

In short "Gitolite allows you to setup git hosting on a central server, with fine-grained access control and many more powerful features.". It doesn't require some background daemon running, uses the server's SSH and it is a simple script that deals with access control so you can easily manage your users and repositories. The "cherry on top" is that you control your git "server" using a git repository :P