Published matrix rows
22
Tests Matrix & Evidence
Tests at a Glance
Rows with completed runs
7
Rows waiting for results
15
Rows with history detail
7
Total matrix cells
22
suite/variant combinations
Lanes with results ✓
7
completed QA runs published
Awaiting execution —
15
runs pending/unexecuted
Global pass rate
69.1%
across all verified scenarios
Verified scenarios
301
behave assertions run
Charts
Reliability trends, failure concentration, and suite/variant views
Apache ECharts renders from published matrix rows plus linked result JSON. Unavailable cells stay gray and visible instead of dropping out.
Trend
Reliability trends
Published history for rows that already have completed runs.
Failure shape
Failure concentration
Top failed scenarios across published rows, ranked by repeated failures.
Coverage
Suite/variant view
Heatmap of latest pass rate by published suite and variant, with explicit unavailable cells.
Load
Scenario volume and failures
Latest published scenario counts, failed scenarios, and pass rate for rows with completed runs.
Matrix
Suite by variant matrix
Every published matrix cell stays visible. Available rows link to detail cards; unpublished or incomplete rows stay marked as unavailable with the collector reason.
| Variant | common | developer | flatcar | smoke | software | system |
|---|---|---|---|---|---|---|
| aurora | No published row | unavailable—0/0 failed | No published row | unavailable—0/0 failed | unavailable—0/0 failed | unavailable—0/0 failed |
| bazzite | No published row | unavailable—0/0 failed | No published row | unavailable—0/0 failed | unavailable—0/0 failed | unavailable—0/0 failed |
| bluefin | failed39.47%69/114 failed | passed100%0/21 failed | No published row | failed87.59%17/137 failed | passed100%0/5 failed | failed57.14%6/14 failed |
| bluefin-lts | No published row | unavailable—0/0 failed | No published row | unavailable—0/0 failed | passed100%0/5 failed | unavailable—0/0 failed |
| dakota | No published row | unavailable—0/0 failed | No published row | unavailable—0/0 failed | failed80%1/5 failed | unavailable—0/0 failed |
| flatcar | No published row | No published row | unavailable—0/0 failed | No published row | No published row | No published row |
Details
Per-row evidence and history
Detail cards join the matrix with linked result JSON so the page can show failed scenarios, run history, screenshots, and workflow identifiers when they exist.
aurora · developer
aurora-testing-developer
unavailableNo pass rate
aurora · developer
aurora-testing-developer
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
aurora · smoke
aurora-testing-smoke
unavailableNo pass rate
aurora · smoke
aurora-testing-smoke
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
aurora · software
aurora-testing-software
unavailableNo pass rate
aurora · software
aurora-testing-software
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
aurora · system
aurora-testing-system
unavailableNo pass rate
aurora · system
aurora-testing-system
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bazzite · developer
bazzite-testing-developer
unavailableNo pass rate
bazzite · developer
bazzite-testing-developer
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bazzite · smoke
bazzite-testing-smoke
unavailableNo pass rate
bazzite · smoke
bazzite-testing-smoke
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bazzite · software
bazzite-testing-software
unavailableNo pass rate
bazzite · software
bazzite-testing-software
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bazzite · system
bazzite-testing-system
unavailableNo pass rate
bazzite · system
bazzite-testing-system
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bluefin · common
bluefin-testing-common
failed39.47%
bluefin · common
bluefin-testing-common
Latest run
- Branch
- testing
- Last run
- 6/24/2026, 6:29:10 PM
- Scenarios
- 114
- Failed scenarios
- 69
- History points
- 2
Evidence links
Latest failure list
- Bazaar flatpak preinstall file is present
- Bluefin accent color is slate
- Bluefin-specific desktop entries are present
- Custom keybindings are configured
- Desktop app grid has Bluefin folder layout
- Document portal broker is running
- Document portal fuse filesystem is mounted
- Fedora Flatpak remote is absent
- Fedora flatpak repo unit is absent
- FileChooser portal interface is introspectable
- GNOME Files application desktop entry is present
- GNOME Settings application desktop entry is present
- GNOME font-name matches the shipped Bluefin default
- GNOME show-battery-percentage matches the shipped Bluefin default
- HTML MIME type has a default handler registered
- Installed desktop applications count is reasonable
- No Fedora system Flatpak remote is configured
- No graphical RPM desktop entries point to /usr/bin executables
- Notification portal interface is introspectable
- OpenURI portal can handle a URI without crashing
- OpenURI portal interface is introspectable
- PDF MIME type has a default handler registered
- Ptyxis terminal custom keybinding is set
- Sample of installed desktop files passes validation
- Screenshot portal interface is introspectable
- Searchlight extension is configured
- Settings portal exposes color scheme preference
- System environment file is present
- XDG icon theme directories are present
- bash login shell sources profile.d without errors
- bazaar user service is available
- bootc is on PATH and returns version
- bootc unified storage service completed successfully
- custom-command-list menu icon is configured
- dconf database is compiled
- dconf locked keys cannot be overridden
- dconf-update service ran successfully
- flatpak command is available
- flatpak user installations directory exists
- graphical-session.target is active in the user session
- just is available for ujust task runner
- legacy Logo Menu extension is not enabled
- pkcheck is available
- podman can pull and run a simple container
- podman info reports a working runtime
- podman info returns expected storage driver
- podman is available and returns version
- podman socket is available for rootless use
- polkit daemon is running
- rechunker-group-fix service completed successfully
- ublue image info prints image metadata
- ublue-system-setup is executable
- ublue-system-setup service completed
- ublue-system-setup service completed successfully
- ublue-update service unit exists
- ublue-user-setup is executable
- ublue-user-setup user service completed successfully
- ujust binary is installed
- ujust bios-info prints firmware metadata
- ujust check-local-overrides exits cleanly on a fresh system
- ujust check-local-overrides runs without error
- ujust lists available tasks
- ujust logs-this-boot prints the current boot journal
- ujust logs-this-boot shows journal output
- xdg-desktop-portal D-Bus interface is reachable
- xdg-desktop-portal did not fail due to missing session target
- xdg-desktop-portal user service is active
- xdg-desktop-portal-gnome user service is active
- xdg-terminal-exec launches a terminal
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/24/2026, 6:29:10 PM | testsuite-550-fix-smoke-use-ssh-aware-steps-vld65 | failed | 69/114 | 39.47% |
| 6/24/2026, 5:31:29 PM | testsuite-550-fix-smoke-use-ssh-aware-steps-9tvfp | failed | 69/114 | 39.47% |
bluefin · developer
bluefin-testing-developer
passed100%
bluefin · developer
bluefin-testing-developer
Latest run
- Branch
- testing
- Last run
- 6/25/2026, 2:04:33 AM
- Scenarios
- 21
- Failed scenarios
- 0
- History points
- 5
Evidence links
Latest failure list
No failed scenario names published for the latest run.
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/25/2026, 2:04:33 AM | nightly-smoke-1782352800 | passed | 0/21 | 100% |
| 6/25/2026, 1:30:50 AM | pack-testing-vs725 | passed | 0/21 | 100% |
| 6/24/2026, 11:23:24 PM | bluefin-qa-testing-xbv8k | passed | 0/21 | 100% |
| 6/24/2026, 12:58:45 PM | nightly-bluefin-testing-rerun-f9d7s | failed | 9/31 | 70.97% |
| Invalid Date | Unavailable | failed | 10/31 | 67.74% |
bluefin · smoke
bluefin-testing-smoke
failed87.59%
bluefin · smoke
bluefin-testing-smoke
Latest run
- Branch
- testing
- Last run
- 6/25/2026, 1:21:48 AM
- Scenarios
- 137
- Failed scenarios
- 17
- History points
- 10
Evidence links
Latest failure list
- AT-SPI registry daemon is running
- Caffeine extension is enabled
- Clicking System menu opens Quick Settings
- Clicking clock opens calendar popup
- Dash to Dock is visible in the shell
- Do-Not-Disturb can be toggled via Quick Settings
- Escape closes Quick Settings
- Escape closes calendar popup
- Night Light can be enabled and disabled
- No accessibility-related journal errors after session start
- No software rendering fallback (LLVMpipe)
- Notification history is accessible from Quick Settings
- Search Light extension is enabled
- Session is running under Wayland
- Switching workspace changes the active workspace index
- System tray indicators are available
- Writable system storage has more than 15 percent free space
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/25/2026, 1:21:48 AM | common-767-fix-flatpak-refresh-appstream-crh7k | failed | 17/137 | 87.59% |
| 6/25/2026, 1:21:25 AM | common-768-feat-uupd-smart-ac-aware-updat-knc97 | failed | 18/137 | 86.86% |
| 6/25/2026, 12:50:33 AM | common-767-fix-flatpak-refresh-appstream-9g4v4 | failed | 17/137 | 87.59% |
| 6/25/2026, 12:26:34 AM | common-768-feat-uupd-smart-ac-aware-updat-zb86j | failed | 18/137 | 86.86% |
| 6/25/2026, 12:22:08 AM | blu-714-test-consumer-validation-for-d-g84tz | failed | 17/137 | 87.59% |
| 6/25/2026, 12:21:06 AM | blu-734-ci-promote-bluefin-testing-mai-nl4wl | failed | 17/137 | 87.59% |
| 6/24/2026, 11:10:05 PM | pr-review-smoke-qfccc | failed | 18/137 | 86.86% |
| 6/24/2026, 10:22:11 PM | blu-734-ci-promote-bluefin-testing-mai-fsrp4 | failed | 18/137 | 86.86% |
| 6/24/2026, 9:26:11 PM | blu-714-retest2-84jgs | failed | 17/137 | 87.59% |
| 6/24/2026, 9:21:28 PM | blu-714-test-consumer-validation-for-d-87k7r | failed | 17/137 | 87.59% |
bluefin · software
bluefin-testing-software
passed100%
bluefin · software
bluefin-testing-software
Latest run
- Branch
- testing
- Last run
- 6/29/2026, 12:00:00 PM
- Scenarios
- 5
- Failed scenarios
- 0
- History points
- 3
Evidence links
Latest failure list
No failed scenario names published for the latest run.
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/29/2026, 12:00:00 PM | nightly-bluefin-testing-software-ab12c | passed | 0/5 | 100% |
| 6/28/2026, 12:00:00 PM | nightly-bluefin-testing-software-xy789 | passed | 0/5 | 100% |
| 6/27/2026, 12:00:00 PM | nightly-bluefin-testing-software-pq456 | failed | 1/5 | 80% |
bluefin · system
bluefin-testing-system
failed57.14%
bluefin · system
bluefin-testing-system
Latest run
- Branch
- testing
- Last run
- 6/24/2026, 3:56:24 AM
- Scenarios
- 14
- Failed scenarios
- 6
- History points
- 1
Evidence links
Latest failure list
No failed scenario names published for the latest run.
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| Invalid Date | Unavailable | failed | 6/14 | 57.14% |
bluefin-lts · developer
bluefin-lts-testing-developer
unavailableNo pass rate
bluefin-lts · developer
bluefin-lts-testing-developer
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bluefin-lts · smoke
bluefin-lts-testing-smoke
unavailableNo pass rate
bluefin-lts · smoke
bluefin-lts-testing-smoke
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
bluefin-lts · software
bluefin-lts-testing-software
passed100%
bluefin-lts · software
bluefin-lts-testing-software
Latest run
- Branch
- testing
- Last run
- 6/29/2026, 12:30:00 PM
- Scenarios
- 5
- Failed scenarios
- 0
- History points
- 2
Evidence links
Latest failure list
No failed scenario names published for the latest run.
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/29/2026, 12:30:00 PM | nightly-lts-testing-software-de34f | passed | 0/5 | 100% |
| 6/28/2026, 12:30:00 PM | nightly-lts-testing-software-jk567 | passed | 0/5 | 100% |
bluefin-lts · system
bluefin-lts-testing-system
unavailableNo pass rate
bluefin-lts · system
bluefin-lts-testing-system
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
dakota · developer
dakota-testing-developer
unavailableNo pass rate
dakota · developer
dakota-testing-developer
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
dakota · smoke
dakota-testing-smoke
unavailableNo pass rate
dakota · smoke
dakota-testing-smoke
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
dakota · software
dakota-testing-software
failed80%
dakota · software
dakota-testing-software
Latest run
- Branch
- testing
- Last run
- 6/29/2026, 1:00:00 PM
- Scenarios
- 5
- Failed scenarios
- 1
- History points
- 2
Evidence links
Latest failure list
- Bazaar flatpak preferences can be saved
History
| Run date | Workflow | Status | Failed | Pass rate |
|---|---|---|---|---|
| 6/29/2026, 1:00:00 PM | nightly-dakota-testing-software-gh56i | failed | 1/5 | 80% |
| 6/28/2026, 1:00:00 PM | nightly-dakota-testing-software-mn890 | passed | 0/5 | 100% |
dakota · system
dakota-testing-system
unavailableNo pass rate
dakota · system
dakota-testing-system
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
flatcar · flatcar
flatcar-testing-flatcar
unavailableNo pass rate
flatcar · flatcar
flatcar-testing-flatcar
Latest run
- Branch
- testing
- Last run
- Unavailable
- Scenarios
- 0
- Failed scenarios
- 0
- History points
- 0
Evidence links
Unavailable state
Result file exists, but no completed run is published for this matrix cell yet.
Data Integrity Posture
Collector-derived contract · v1
- Evidence-backed authenticity: Every pass rate, scenario count, and failure name is collected from real BDD test execution logs in the homelab and written into
docs/results/. - No synthetic data: Gaps and pending/missing runs stay explicitly labeled as
unavailablewith their exact collector reason instead of being filled with mock or interpolated statistics. - Lanes and Suites: Out of 22 total matrix cells (covering 6 variants across 6 test suites), 7 are available with completed runs, and 15 stay marked as awaiting results.
- History tracking: Historical trend lines show up to 10 previous runs per cell, allowing change-point and regression detection across active development branches.