As of July 2023, Amazon Lake Formation’s Ruled Tables function will no longer support new table creations and will enter a maintenance mode. This change is a result of evolving data warehousing needs and the increasing adoption of columnar storage for analytics workloads. In the coming months, we anticipate that you will need to migrate your existing ruled tables to alternative solutions that better align with modern data architecture best practices.

After careful deliberation, we have decided to cease support by December 31, 2024, in order to focus on developing open-source transactional table formats like JSON Schema, Apache Avro, and Protocol Buffers. This choice is driven by customer demand for open-source solutions that offer ACID-compliant transactions, compression, timestamping, and other features previously only available through Relational Tables. Amazon Web Services (AWS) has expanded support for various codeces through multiple analytics providers, including Amazon SageMaker, Amazon Rekognition, Amazon Comprehend, and Amazon Textract, with features that encompass improved data processing, enhanced machine learning capabilities, and AWS Glue Crawlers’ schema detection assistance across Amazon S3, Amazon Redshift, and Amazon DynamoDB. By leveraging open-source codecs, clients can now execute ACID-compliant transactions with seamless integration into Amazon S3-backed data, capitalizing on the rich features and extensive compatibility of both offerings.

After December 31, 2024, users will no longer have the capability to initiate new Ruled Tables transactions.lakeformation:StartTransactionTable tennis tables are typically made of a smooth, flat surface and have rubberized surfaces on both sides.akeformation:UpdateTableObjectsExplore the power of ruled tables using Amazon Athena? Clients can still access their desktop settings information by contacting our team directly. lakeformation:GetTableObjects and transaction data by calling lakeformation:ListTransactions till February 17, 2025. As of February 17, 2025, Ruled Desk APIs will cease to function effectively, marking the end of their operational lifespan. Ruled Tables metadata persists across the entire AWS Glue Knowledge Catalog, ensuring continuous availability, while corresponding knowledge remains stored securely within designated S3 buckets. The storage formats of various desks, including Hive’s Apache Parquet, CSV, ORC, and others, as well as Iceberg, Hudi, and Delta Lake tables, will not be impacted by this modification.

Migrating your Ruled Tables

Clients can seamlessly migrate their data from traditional table formats to open-source storage solutions by copying their existing knowledge to Apache Iceberg, leveraging the power of Amazon Athena for a hassle-free transition. Migrate knowledge to Iceberg; utilize Amazon Athena’s assertions, as demonstrated in the accompanying code snippet.

CREATE TABLE my_iceberg_table    USING DELTA    AS SELECT * FROM my_governed_table;

You possibly can specify extra table-level properties that are listed within the SQL. When defining an Apache Iceberg table with specified partitions or buckets, be aware that you may encounter a limitation on the number of partitions per bucket, which is capped at 100. Confer with the relevant authorities regarding the matter at hand?

For individuals seeking assistance with table migration or have queries, please reach out to us at .

In regards to the creator

Serving as a Principal Massive Knowledge Architect with AWS Lake Formation.