Fabric Data Agent Accuracy Is a Distribution, Not a Number
I asked a Fabric data agent 24 questions in three wordings, ten times each, on real AEMO data. It scored 82%, but only 39% of wordings were always right.
Ang Kalawakan ni
Filipino-Australian technologist sa Melbourne
Bawat bituin ay isang post. Every star here is a post I've written: 2,213 since 2020. The middle is 2020; the edge is this week. Drag to spin it, hover a star to read it.Swipe to spin, tap a star.
1.Noong bata pa ako… komiks muna. When I was a kid, komiks came first.
2.Tapos, computer na! Then came the computer.
3.Ngayon, Melbourne. Flat white in hand.
4.Data, AI, at kuwentuhan. Building it, then sharing what I learn.
Specialized in the Microsoft data ecosystem. From Fabric lakehouses to real-time analytics, I help teams build modern data platforms.
End-to-end analytics platform expertise including Lakehouses, Data Factory, Real-Time Intelligence, and OneLake architecture.
Designing and implementing enterprise data solutions on Azure including Synapse, Databricks, Data Factory, and Cosmos DB.
Integrating AI/ML capabilities with Azure OpenAI, building analytics solutions with Power BI, and implementing MLOps best practices.
Thoughts on data engineering, Azure, and technology
I asked a Fabric data agent 24 questions in three wordings, ten times each, on real AEMO data. It scored 82%, but only 39% of wordings were always right.
I gave Opus 5.5 a build to watch and a dev server to start, with and without the Monitor tool. It used Monitor inconsistently, and headless runs hid the answer.
ultrathink now runs at xhigh effort in Claude Code. I ran six exact-answer tasks 96 times from low to max: every level got them right; higher just cost more.
I had Haiku 5.5 audit 30 of my posts twice: once with --json-schema, once asking nicely for JSON. The shape held. The judgement moved, and that's the lesson.
I hid five bugs in a real change and ran /code-review at low, medium, high and xhigh. Medium found all five for 15 cents. Here's what each level adds.
Slides is out of beta. I had Claude Code turn one of my posts into a nine-slide deck, then checked every claim against the source. Here's what held up.
Looking for Fabric expertise or Azure data architecture guidance? I'm available for consulting, training, and speaking engagements.