Thursday, September 25, 2025

Anchoring AI to a reference software

Service templates are a typical constructing block within the “golden paths” organisations construct for his or her engineering groups, to make it straightforward to do the correct factor. The templates are presupposed to be the position fashions for all of the companies within the organisation, all the time representing the hottest coding patterns and requirements.

One of many challenges with service templates although is that when a crew instantiated a service with one, it’s tedious to feed template updates again to these companies. Can GenAI assist with that?

Reference software as pattern supplier

As half of a bigger experiment that I lately wrote about right here, I created an MCP server that provides a coding assistant entry to coding samples for typical patterns. In my case, this was for a Spring Boot net software, the place the patterns had been repository, service and controller courses. It’s a nicely established prompting follow at this level that offering LLMs with examples of the outputs that we wish results in higher outcomes. To place “offering examples” into fancier phrases: That is additionally known as “few-shot prompting”, or “in-context studying”.

Once I began working with code samples in prompts, I shortly realised how tedious this was, as a result of I used to be working in a pure language markdown file. It felt a bit bit like writing my first Java exams at college, in pencil: You have got know thought if the code you’re writing truly compiles. And what’s extra, in case you’re creating prompts for a number of coding patterns, you need to preserve them according to one another. Sustaining code samples in a reference software venture that you could compile and run (like a service template) makes it lots simpler to supply AI with compilable, constant samples.

Anchoring AI to a reference software

Detect drift from the reference software

Now again to the issue assertion I discussed initially: As soon as code is generated (be that with AI, or with a service template), after which additional prolonged and maintained, codebases usually drift away from the position mannequin of the reference software.

So in a second step, I questioned how we’d use this method to do a “code sample drift detection” between the codebase and the reference software. I examined this with a comparatively easy instance, I added a logger and log.debug statements to the reference software’s controller courses:

Screenshot of a git commit diff in the reference application, showing a controller with an added @Slf4j annotation, and a log.debug statement in one of the endpoint mappings.

Then I expanded the MCP server to supply entry to the git commits within the reference software. Asking the agent to first search for the precise modifications within the reference offers me some management over the scope of the drift detection, I can use the commits to speak to AI precisely what sort of drift I’m taken with. Earlier than I launched this, after I simply requested AI to check the reference controllers with the present controllers, it went a bit overboard with a lot of irrelevant comparisons, and I noticed this commit-scoping method have a great impression.

An expanded version of the previous diagram, this time showing the setup for the drift detection. The prompt asks the agent to find latest changes, the agent gets the latest commit from the reference application, via MCP server. The agent then looks at the diff and uses it to analyse the target application, and to create a drift report. In a second step, the user can then ask the agent to write code that closes the gaps identified in the report.

In step one, I simply requested AI to generate a report for me that recognized all of the drift, so I might evaluation and edit that report, e.g. take away findings that had been irrelevant. Within the second step, I requested AI to take the report and write code that closes the gaps recognized.

When is AI bringing one thing new to the desk?

A factor so simple as including a logger, or altering a logging framework, may also be completed deterministically by codemod instruments like OpenRewrite. So bear that in thoughts earlier than you attain for AI.

The place AI can shine is at any time when we’ve drift that wants coding that’s extra dynamic than is feasible with regular-expression-based codemod recipes. In a complicated type of the logging instance, this could be turning non-standardised, wealthy log statements right into a structured format, the place an LLM could be higher at turning all kinds of current log messages into the respective construction.

The instance MCP server is included in the repository that accompanies the unique article.

Related Articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest Articles