Wow, KubeCon + CloudNativeCon Europe 2025 in London was a improbable time! Our Azure Storage group was thrilled to trade insights and success tales at this vibrant group occasion. In the event you missed it, don’t fear! We’re right here to share what we confirmed off on the con: how we’re enhancing efficiency, cost-efficiency, and AI
Wow, KubeCon + CloudNativeCon Europe 2025 in London was a improbable time! Our Azure Storage group was thrilled to trade insights and success tales at this vibrant group occasion. In the event you missed it, don’t fear! We’re right here to share what we confirmed off on the con: how we’re enhancing efficiency, cost-efficiency, and AI capabilities for your workloads on Azure.
Optimize your open-source databases with Azure Disks
Open-source databases akin to PostgreSQL, MariaDB, and MySQL are among the many mostly deployed stateful workloads on Kubernetes. For eventualities that demand extraordinarily low latency and excessive enter/output operations per second (IOPS)—akin to operating these databases for transactional workloads—Azure Container Storage lets you faucet into native ephemeral non-volative reminiscence specific (NVMe) drives inside your node pool. This offers sub-millisecond latency and as much as half 1,000,000 IOPS, making it a robust match for performance-critical use instances. In our upcoming v1.3.0 replace, we have now made important optimizations particularly for databases.
In comparison with the earlier v1.2.0 model, you may count on as much as a 5 instances improve in transactions per second (TPS) for PostgreSQL and MySQL deployments. In the event you’re searching for one of the best stability of sturdiness, efficiency, and price for storage, Premium SSD v2 disks stays our advisable default for database workloads. Premium SSD v2 provides a versatile pricing mannequin that expenses per gigabyte and contains beneficiant baseline IOPS and throughput totally free out of the field. You’ll be able to dynamically scale IOPS and throughput as wanted, permitting you to fine-tune efficiency whereas optimizing for price-efficiency.
At KubeCon, we demonstrated how builders may readily benefit from native NVMe and Premium SSD v2 Disks to construct their extremely out there and performant PostgreSQL deployments. If you wish to observe alongside your self, try the newly republished PostgreSQL on AKS documentation beneath!
Speed up your AI workflows with Azure Blob Storage
Constructing an AI workflow calls for scalable storage to host huge quantities of information—whether or not it’s uncooked sensor logs, high-resolution photographs, or multi-terabyte mannequin checkpoints. Azure Blob Storage and BlobFuse2 with the Container Storage Interface (CSI) driver present a seamless strategy to retailer and retrieve this information at scale. With BlobFuse2, you entry blob storage simply as a persistent quantity, treating it like an area file system. With the newest model of Blobfuse2 – 2.4.1, you may:
- Velocity up mannequin coaching and inference: BlobFuse2’s enhanced streaming help reduces latency for preliminary and repeated reads. Utilizing BlobFuse2 to load massive datasets or fine-tuned mannequin weights instantly from blob storage into native NVMe drives on GPU SKUs successfully optimizes the effectivity of your AI workflow.
- Simplify information preprocessing: AI workflows usually require frequent transformations—akin to normalizing photographs or tokenizing textual content. By utilizing BlobFuse2’s file-based entry, information scientists can preprocess and retailer outcomes instantly in blob storage, preserving pipelines environment friendly.
- Guarantee information integrity at scale: When dealing with petabytes of streaming information, integrity checks matter. BlobFuse2 now contains improved CRC64 validation for information saved on native disk, guaranteeing dependable reads and writes, even when working with distributed AI clusters.
- Parallel entry of huge datasets: Applied parallel downloads and uploads to considerably lower the time required for accessing massive datasets saved in blobs. This enhancement permits for sooner information processing and elevated effectivity, guaranteeing optimum utilization of GPU sources and bettering coaching effectivity.
Scale your stateful workloads with Azure Recordsdata
Steady Integration and Steady Supply/Deployment (CI/CD) pipelines, one of many well-liked stateful workloads, want shared persistent volumes to host artifacts within the repository, the place Azure Premium Recordsdata is the storage of alternative on Azure. These artifacts are saved in small information that incur heavy metadata operations on a file share. To hurry up CI/CD workflows, the Azure Recordsdata group lately introduced the final availability of metadata caching for premium SMB file shares. This new functionality reduces metadata latency by as much as 50 p.c, benefiting metadata-intensive workloads that sometimes host many small information in a single share. At KubeCon, we showcased how metadata caching can speed up repetitive construct processes on GitHub, check with the repo and check out it out your self.
For much less performance-demanding stateful workloads, Normal Recordsdata with the brand new Provisioned v2 billing mannequin provides higher value predictability and management as shared persistent volumes. The Provisioned v2 mannequin shifts from usage-based to provisioned billing, permitting you to specify required storage, IOPS, and throughput with better scale. Now you can increase your file share from 32 GiB to 256 TiB, 50,000 IOPS, and 5 GiB/sec throughput as your purposes demand.
KubeCon + CloudNativeCon was a beautiful alternative to instantly work together with builders and be taught from our prospects. As all the time, due to our prospects and companions for contributing to the occasion’s worth and significance, and we sit up for seeing you once more in November for KubeCon North America!
