Stream: dev

Topic: code coverage

Philip Durbin 🚀 (Oct 05 2026 at 14:06):

Let's talk about code coverage.

https://github.com/IQSS/dataverse-frontend shows 97%, which is awesome:

https://github.com/IQSS/dataverse shows 26% for unit tests and "inaccessible" for API tests:

Ash Manda (Oct 05 2026 at 14:11):

I have had trouble getting JaCoCo reports out of the Integration Test runners.

Ash Manda (Oct 05 2026 at 14:12):

At the time, it was turning into a blocker, so I put it aside, but let me take another crack at it

Ash Manda (Oct 05 2026 at 14:12):

Oliver said he was able to do it for some other workflows

Philip Durbin 🚀 (Oct 05 2026 at 14:14):

Right. We probably talked about it during the move from Jenkins to GitHub Actions. I'm glad we didn't let this be a blocker. But we should revisit some day, yes.

The backend README has those broken links to Jenkins. Do you think we should just remove them for now?

Ash Manda (Oct 05 2026 at 14:22):

Yep, we should. Jenkins has been turned off

Philip Durbin 🚀 (Oct 05 2026 at 14:26):

Ok. I created an issue: The README has broken links to Jenkins, now defunct #12784

Ash Manda (Oct 11 2026 at 01:05):

#12783 addresses code coverage now. I am looking into reactivating the badges

Ash Manda (Oct 11 2026 at 01:06):

Here's what it fixes:

• Containers built twice per commit. The JSF and API test workflows each did their own build. Now one build is handed off to all the test jobs.
• JSF browsers ran one after another, and a Chromium failure meant Firefox and WebKit never ran. Each browser now has its own job, and they run in parallel.
• Expensive re-runs. A flaky test meant re-running the whole ~50-minute workflow. Now you re-run just the failed job, on the saved build.
• CI failures couldn't be reproduced. The exact images a run tested against can now be downloaded and started locally.
• No code coverage since Jenkins. Every run now produces a JaCoCo report (HTML + XML) of what the API and JSF tests exercise on the server: about 51% of lines so far.

Each browser job also runs the full API test suite against the same installation, so every commit gets three independent runs of the API tests under real UI load, which is good for catching flaky tests.

Push to green: ~50 → ~42 min. The tests themselves are unchanged.

Ash Manda (Oct 16 2026 at 16:22):

Current code coverage after #12783 is looking at about 57% on Coveralls

Ash Manda (Oct 16 2026 at 16:22):

https://coveralls.io/jobs/189690986

Philip Durbin 🚀 (Oct 16 2026 at 16:23):

57%! That's what I'm talking about!

Philip Durbin 🚀 (Oct 16 2026 at 16:25):

And at https://coveralls.io/jobs/189690986/source_files/12682577818 for example I can see which lines in /src/main/java/edu/harvard/iq/dataverse/api/Datasets.java (part of the API) are green/covered or red/uncovered. Great!

Last updated: Nov 02 2026 at 07:01 UTC