Harnessing the Potential of Gen-AI Coding Assistants in Public Sector Software Development
Kevin KB Ng, Liyana Fauzi, Leon Leow, Jaren Ng
TL;DR
This paper evaluates Gen-AI coding assistants, focusing on GitHub Copilot within GovTech Singapore's SHIP-HATS DevSecOps context, to determine impact on public-sector software development. Using a four-month pilot with telemetry and SPACE-based surveys, the study finds coding speed improvements of 21–28% and an overall productivity uplift of about 12%, with pronounced benefits for junior and mid-level developers. It also uncovers concerns around learning curves, accuracy, and security, emphasizing that real-time security improvements from AI tools are limited and must be complemented by dedicated security testing. The authors propose an AI governance framework, discuss data-classification and hosting decisions (cloud SaaS vs self-hosted), and outline actions to optimize tooling, standardize tech stacks, and align with industry metrics (SPACE and DORA) to maximize benefits while maintaining security and compliance in the public sector.
Abstract
The study on GitHub Copilot by GovTech Singapore's Engineering Productivity Programme (EPP) reveals significant potential for AI Code Assistant tools to boost developer productivity and improve application quality in the public sector. Highlighting the substantial benefits for the public sector, the study observed an increased productivity (coding / tasks speed increased by 21-28%), which translates into accelerated development, and quicker go-to-market, with a notable consensus (95%) that the tool increases developer satisfaction. Particularly, junior developers experienced considerable efficiency gains and reduced coding times, illustrating Copilot's capability to enhance job satisfaction by easing routine tasks. This advancement allows for a sharper focus on complex projects, faster learning, and improved code quality. Recognising the strategic importance of these tools, the study recommends the development of an AI Framework to maximise such benefits while cautioning against potential over-reliance without solid foundational programming skills. It also advises public sector developers to classify their code as "Open" to use Gen-AI Coding Assistant tools on the Cloud like GitHub Copilot and to consider self-hosted tools like Codeium or Code Llama for confidential code to leverage technology efficiently within the public sector framework. With up to 8,000 developers, comprising both public officers and vendors developing applications for the public sector and its customers, there is significant potential to enhance productivity.