AI Readiness Dashboard

In the AI Readiness dashboard, you follow the AI Readiness history of your semantic models and data agents together, in one Power BI report. With the dashboard, you can:

Follow the average AI Readiness score of your semantic models month by month.
See which findings affect the most semantic models, and which of them you have resolved.
See which optimizations you applied, and how much each one raised the score at the next assessment.
Compare benchmark accuracy across runs, and read the outcome of every A/B test.
Share the history with people who use Power BI but not BI Pixie.

The report is named BI Pixie AI Readiness Dashboard. It sits next to the BI Pixie Dashboard report in the Fabric workspace that BI Pixie delivers your dashboard to, uses the same semantic model, and is filled by the same data refresh.

Prerequisites

The BI Pixie Dashboard, installed in a Fabric workspace. See Set up the dashboard. The AI Readiness dashboard is part of the dashboard installed in your own Fabric workspace, and is not part of the template app.
A dashboard installed before the AI Readiness report existed needs an update first. You find the update on the BI Pixie Dashboard card on the Overview page, with a notice that the update adds an AI Readiness report.
At least one AI Readiness assessment. See Semantic model assessments.

Open the AI Readiness dashboard

Sign in to the BI Pixie Portal.
Select Open AI Readiness dashboard. The button is in two places: the header of the AI Readiness page, and the AI Readiness card on the Overview page, after Open AI Readiness.

The dashboard opens on its Overview page in a new browser tab. You can also open the BI Pixie AI Readiness Dashboard report directly from your Fabric workspace.

BI Pixie shows the button once your dashboard holds the AI Readiness report and a data refresh has finished since the report was added.

Filter by workspace and date

Two filters sit at the top right of every page, and both carry across pages:

With Workspace, you see only the semantic models and data agents in the workspaces you choose.
With Dates (UTC), you see only the data in the date range you choose. It starts at the last 12 months.

Explore the pages

Select a tab at the top of the report to move between its six pages.

Overview

The Overview page opens with four headline cards: Semantic models ready for AI, Average AI Readiness Score, Optimizations applied and Benchmark accuracy. The charts show the average AI Readiness score by month, with lines at the band thresholds, the number of semantic models in each band, and the optimizations applied by type. The Semantic models table lists each semantic model with its latest score.

The bands are the same as in BI Pixie: Ready for AI at 80 and above, Needs curation from 50 to 79, and Not ready for AI below 50.

The Overview page of the AI Readiness dashboard, with the estate's headline numbers, the average AI Readiness score by month, the semantic models in each band, the optimizations applied by type, and the Semantic models table

To see one semantic model's history, select its row in the Semantic models table and choose Details. The details page shows that semantic model's score, its change since the first assessment, its benchmark accuracy, and a chart of its score over time with each optimization marked on it. The page also compares each dimension's score at the first and latest assessment, and lists the data agents grounded on the semantic model, its open findings and its benchmark runs. Select Back to return to Overview.

The semantic model details page of the AI Readiness dashboard for one semantic model, with its score over time and each optimization, its dimension scores at the first and latest assessment, the data agents grounded on it, its open findings and its benchmark runs

Findings

The Findings page shows what your assessments found: Open findings, High severity, Resolved since the first assessment, and Findings on fields used in reports. The charts break the open findings down by dimension and severity, and list the findings that affect the most semantic models.

Optimizations

The Optimizations page counts the optimizations you applied by month, and lists each optimization beside the score change measured at the next assessment. An optimization whose semantic model has not been assessed since reads Not assessed again yet.

Benchmarks

The Benchmarks page shows your benchmark runs: the latest accuracy with its fraction, for example 71% (213 of 300 correct), the unstable and not scored questions, and the median answer time. One chart shows accuracy by run, with one line for each kind of AI tested, and another shows why questions were not scored. The Runs table lists every run.

A/B tests

The A/B tests page lists each A/B test with its hypothesis, its latest result, for example 58% to 83% (+25 points), and its outcome: Your hypothesis is confirmed., Your hypothesis is rejected., The result is inconclusive., or Not judged.

Data agents

The Data agents page lists each data agent you assessed, with its score, band, change since the previous assessment and sources, and the checks that data agents fail most often.

Keep the dashboard up to date

The AI Readiness dashboard is filled by the same refresh as the BI Pixie Dashboard. New assessments, optimizations, benchmarks and A/B tests appear after the next refresh:

Select Refresh data on the BI Pixie Dashboard card of the Overview page.
You can also schedule the BI Pixie ETL notebook in your Fabric workspace. See Set up the dashboard.

When an update adds the AI Readiness report to your dashboard, BI Pixie starts one refresh for you if it has the permission to.

Until the first refresh after an assessment, every page shows No AI Readiness data has been loaded yet. To fill the report:

Assess a semantic model in BI Pixie.
Select Refresh data on the BI Pixie Dashboard card of the Overview page. The report fills in when the refresh finishes.

Read dates in UTC

Every date in the AI Readiness dashboard is in UTC, and each date label says so, for example Dates (UTC), Last assessed (UTC) and Run date (UTC). The report is shared by everyone who opens it, wherever they are, so it uses one time zone for all of them. The pages in the BI Pixie Portal show your local time, so a date near midnight can fall on a different day in the two places.

Who sees what

Anyone with access to the report in your Fabric workspace can open the AI Readiness dashboard. Share it the way you share any Power BI report.
When your account has more than one license, each license's dashboard shows the work done by the people on that license. Work done by an admin, and work done before your account had more than one license, appears on the main license's dashboard.
A scheduled assessment appears on the dashboard of the license that owns its schedule.
The report holds scores, counts and outcomes. It holds no AI answer text, correct values or DAX queries, and it does not name the person who ran each assessment or benchmark.

Ask questions about your AI Readiness history

The BI Pixie data agent and the BI Pixie MCP server read the same tables as the dashboard, so you can ask them questions such as which semantic models improved most this quarter. See AI Assistants.