hn.today

Accelerating Development for Massive Git Repositories

developers.googleblog.com11 points2 comments
Screenshot of Accelerating Development for Massive Git Repositories

ABFS (Another Build File Service) is Google’s open-source system for speeding up development in enormous Git repositories, introduced to address Android’s slow checkouts and builds. Android 17 alone spans 1,084 repositories, 1.62 million files, and roughly 161 GB of source; a full build produces another 155 GB of output. Conventional workflows could take about 36 minutes to fetch the code and 80 minutes for a full build, leaving developers and coding agents waiting whenever they started a fresh workspace or changed branches. ABFS reduces these costs by combining a virtual filesystem, local and remote caches, and server infrastructure that stores Git content, workspace snapshots, and build results.

Its key mechanism is lazy loading: a checkout initially retrieves file and directory metadata, while file contents arrive only when accessed. For builds, Ninja-go first searches for results using a command, environment, and declared-input key, then checks the files actually read by the cached build step before reusing its output. This second verification catches undeclared dependencies that timestamp-based systems can miss, preserving correctness while avoiding redundant work. Reported Android results reduce checkout time to under eight seconds and full builds to just over two minutes; shared caching can reuse build actions across CI and developer machines. Persistent, synchronized workspaces also support multiple release branches and parallel agent workflows on one machine. The system is designed for other large Git projects and build systems, with Bazel integration demonstrated and Chromium and the Android Common Kernel exploring compatibility.

Read on developers.googleblog.com2 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Programming

Sarasa Gothic Mono

Sarasa Gothic Mono

Sarasa Gothic Mono is a free, open-source monospace typeface built for multilingual programming, combining Source Han Sans and Iosevka. It offers coding ligatures, pixel-friendly hinting, condensed characters, and support for Latin, Cyrillic, Greek, and East Asian scripts. (picaq.github.io)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.