Practical knowledge about the Microsoft Data Platform, AI and cloud engineering — articles, projects, talks and community work by Javi.http://localhost:4321/enhttp://localhost:4321/articles/designing-report-engine-ui-api-consumers/http://localhost:4321/articles/designing-report-engine-ui-api-consumers/Design one governed report backend for interactive UI pages, external APIs, downloads and large asynchronous exports.Sat, 03 Oct 2026 00:00:00 GMTCloud & AutomationData ArchitectureAPIReportingCSVCachingMulti-TenancyJavihttp://localhost:4321/articles/pre-rendered-reports-vs-live-queries/http://localhost:4321/articles/pre-rendered-reports-vs-live-queries/Choose pre-rendered, live, or hybrid report execution using freshness, repetition, variability, cost and security constraints.Sat, 03 Oct 2026 00:00:00 GMTCloud & AutomationData ArchitectureAPIReportingCachingPerformanceMulti-TenancyJavihttp://localhost:4321/articles/report-engine-request-to-result/http://localhost:4321/articles/report-engine-request-to-result/Trace a report request through gateway, security, validation, cache, Fabric query, result construction and monitoring.Sat, 03 Oct 2026 00:00:00 GMTCloud & AutomationData ArchitectureAPIReportingMicrosoft FabricCachingMulti-TenancyObservabilityJavihttp://localhost:4321/articles/what-is-a-report-engine/http://localhost:4321/articles/what-is-a-report-engine/Define the report engine as a secure service between UI or API consumers and analytical data.Sat, 03 Oct 2026 00:00:00 GMTCloud & AutomationData ArchitectureAPIReportingMicrosoft FabricCachingMulti-TenancyJavihttp://localhost:4321/articles/make-fabric-notebooks-faster/http://localhost:4321/articles/make-fabric-notebooks-faster/A practical workflow for reducing Fabric notebook startup, read, shuffle, transformation and Delta write time without guessing.Sat, 03 Oct 2026 00:00:00 GMTMicrosoft FabricMicrosoft FabricFabric NotebookPerformancePySparkDelta LakeTroubleshootingJavihttp://localhost:4321/articles/reduce-fabric-notebook-startup-time/http://localhost:4321/articles/reduce-fabric-notebook-startup-time/Diagnose Microsoft Fabric Spark session acquisition and reduce avoidable notebook startup overhead through compatible pools, environments and reuse.Sat, 03 Oct 2026 00:00:00 GMTMicrosoft FabricMicrosoft FabricFabric NotebookPerformancePySparkTroubleshootingJavihttp://localhost:4321/articles/using-session-tags-fabric-pipelines/http://localhost:4321/articles/using-session-tags-fabric-pipelines/Use Microsoft Fabric pipeline session tags to group compatible notebook activities for Spark session reuse while preserving workload boundaries.Sat, 03 Oct 2026 00:00:00 GMTMicrosoft FabricMicrosoft FabricFabric NotebookData PipelinesPerformancePySparkJavihttp://localhost:4321/articles/designing-execution-log-data-pipelines/http://localhost:4321/articles/designing-execution-log-data-pipelines/Design a durable pipeline execution log with run identity, parent-child relationships, transitions, retries and correlation.Sat, 03 Oct 2026 00:00:00 GMTDevOps & ObservabilityObservabilityMonitoringLoggingData PipelinesMicrosoft FabricPySparkJavihttp://localhost:4321/articles/measuring-api-report-request-volume/http://localhost:4321/articles/measuring-api-report-request-volume/Measure API and report demand by client, tenant, report type, latency, concurrency, payload and request cost.Sat, 03 Oct 2026 00:00:00 GMTDevOps & ObservabilityAPIReportingMonitoringObservabilityPerformanceMulti-TenancyCachingJavihttp://localhost:4321/articles/monitoring-data-platform-what-to-measure/http://localhost:4321/articles/monitoring-data-platform-what-to-measure/A practical monitoring model connecting clients, applications, APIs, report engines, data platforms, compute and storage.Sat, 03 Oct 2026 00:00:00 GMTDevOps & ObservabilityObservabilityMonitoringData ArchitecturePerformanceAPILoggingJavihttp://localhost:4321/articles/monitoring-fabric-pipelines-notebooks/http://localhost:4321/articles/monitoring-fabric-pipelines-notebooks/Separate Fabric orchestration, session startup, Spark compute, data read, shuffle and write time with connected telemetry.Sat, 03 Oct 2026 00:00:00 GMTDevOps & ObservabilityMicrosoft FabricFabric NotebookData PipelinesObservabilityMonitoringPerformanceJavihttp://localhost:4321/articles/monitoring-sql-server-workloads-real-time/http://localhost:4321/articles/monitoring-sql-server-workloads-real-time/Inspect active SQL Server requests, sessions and connections, then connect current state to retained Query Store history.Sat, 03 Oct 2026 00:00:00 GMTDevOps & ObservabilitySQL ServerDMVMonitoringObservabilityPerformanceBlockingQuery StoreJavihttp://localhost:4321/articles/filtering-rows-pandas/http://localhost:4321/articles/filtering-rows-pandas/Build readable, null-safe pandas filters for realistic order questions and validate the result instead of relying on fragile expressions.Sat, 03 Oct 2026 00:00:00 GMTPythonPythonpandasDataFramesCSVDatasetJavihttp://localhost:4321/articles/groupby-aggregations-pandas/http://localhost:4321/articles/groupby-aggregations-pandas/Build trustworthy pandas summaries by defining grain, revenue rules, null behavior and joins before grouping real order data.Sat, 03 Oct 2026 00:00:00 GMTPythonPythonpandasDataFramesCSVDatasetJavihttp://localhost:4321/articles/inspecting-a-dataframe/http://localhost:4321/articles/inspecting-a-dataframe/Profile a pandas DataFrame systematically with shape, schema, samples, null counts, uniqueness and distribution checks before transforming it.Sat, 03 Oct 2026 00:00:00 GMTPythonPythonpandasDataFramesCSVDatasetJavihttp://localhost:4321/articles/joining-merging-dataframes/http://localhost:4321/articles/joining-merging-dataframes/Join pandas DataFrames safely with explicit cardinality, unmatched-key checks, indicators and row-count reconciliation.Sat, 03 Oct 2026 00:00:00 GMTPythonPythonpandasDataFramesCSVDatasetJavihttp://localhost:4321/articles/reading-csv-files-pandas/http://localhost:4321/articles/reading-csv-files-pandas/Load a real CSV into pandas deliberately, validate its shape and types, and avoid the ingestion assumptions that cause downstream data problems.Sat, 03 Oct 2026 00:00:00 GMTPythonPythonpandasDataFramesCSVDatasetJavihttp://localhost:4321/articles/find-blocking-sql-server/http://localhost:4321/articles/find-blocking-sql-server/Find blocked requests, trace blocking chains to the head blocker, and inspect the responsible session and transaction safely.Sat, 03 Oct 2026 00:00:00 GMTSQL ServerSQL ServerPerformanceTroubleshootingDMVBlockingConcurrencyJavihttp://localhost:4321/articles/find-running-queries-sql-server/http://localhost:4321/articles/find-running-queries-sql-server/A production-safe DMV query for active SQL Server requests, including statement text, identity, resource use, waits and blocking.Sat, 03 Oct 2026 00:00:00 GMTSQL ServerSQL ServerPerformanceTroubleshootingDMVBlockingJavihttp://localhost:4321/articles/get-sql-server-session-id/http://localhost:4321/articles/get-sql-server-session-id/Find your SQL Server session ID, investigate another session, and inspect its request, SQL text, waits, blocking and open transaction state.Sat, 03 Oct 2026 00:00:00 GMTSQL ServerSQL ServerTroubleshootingDMVBlockingJavihttp://localhost:4321/articles/sql-server-is-slow-troubleshooting-workflow/http://localhost:4321/articles/sql-server-is-slow-troubleshooting-workflow/A production-first workflow for turning a vague SQL Server slowdown into evidence, a likely cause, and a safe next step.Sat, 03 Oct 2026 00:00:00 GMTSQL ServerSQL ServerPerformanceTroubleshootingDMVBlockingQuery StoreJavihttp://localhost:4321/articles/sql-server-table-sizes/http://localhost:4321/articles/sql-server-table-sizes/Measure SQL Server row counts, reserved space, data, indexes and unused allocation without double-counting partitions or allocation units.Sat, 03 Oct 2026 00:00:00 GMTSQL ServerSQL ServerPerformanceTroubleshootingDMVIndexingLarge Scale DataJavihttp://localhost:4321/articles/using-llms-with-your-data/http://localhost:4321/articles/using-llms-with-your-data/Engineering patterns for connecting LLM applications to enterprise data with controlled retrieval, tools and authorization.Fri, 02 Oct 2026 00:00:00 GMTAI & DataAILLMPythonAzureJavihttp://localhost:4321/articles/designing-scalable-microsoft-fabric-architecture/http://localhost:4321/articles/designing-scalable-microsoft-fabric-architecture/A practical guide to workload boundaries, storage, capacity, deployment and operations in Microsoft Fabric.Fri, 02 Oct 2026 00:00:00 GMTMicrosoft FabricMicrosoft FabricData ArchitectureFabric LakehousePerformanceJavihttp://localhost:4321/articles/medallion-architecture-explained-bronze-silver-gold/http://localhost:4321/articles/medallion-architecture-explained-bronze-silver-gold/What the Bronze, Silver and Gold layers are for, how data quality and incremental processing work across them in Microsoft Fabric, and when fewer layers are the better design.Fri, 02 Oct 2026 00:00:00 GMTMicrosoft FabricMedallion ArchitectureMicrosoft FabricDelta LakeBronzeSilverGoldJavihttp://localhost:4321/articles/sql-server-performance-tuning-checklist/http://localhost:4321/articles/sql-server-performance-tuning-checklist/A production-oriented checklist for investigating SQL Server performance with evidence instead of guesses.Fri, 02 Oct 2026 00:00:00 GMTSQL ServerSQL ServerPerformanceQuery StoreIndexingJavi