Automatic testing of jury solutions

Hi,

I am planning to set up automatic testing of jury solutions using continuous integration.

From the admin manual (section 4.7), I've found that testing jury solutions

can be done by uploading the problems to the system, but I would like to circumvent this manual task. I already have a naive shell script set up that does some basic diffing, which works for simple problems. However, I thought there might be already some tool that automatically verifies solutions.

I've found that Kattis has a tool to verify problems: https://github.com/Kattis/problemtools However, I can imagine that this `verifyproblem` tool uses different settings than what would be used on a DomJudge instance.

Could I get some advice on how I could best set this up?

Kind regards, M.P. Sijm