Skip to content

settings/default values: 26.1_antalya vs 25.8_antalya snapshot drift (upstream vs Antalya-exclusive) #115

@CarlosFelipeOR

Description

@CarlosFelipeOR

Context

Comparison of settings/default values snapshots:

  • default_values.py.default values>=26.1_antalya.snapshot — added in 56a9af0
  • default_values.py.default values>=25.8_antalya.snapshot

Snapshot comparison summary

  • Total settings in 26.1_antalya: 1518
  • Total settings in 25.8_antalya: 1389
  • Overlap: 1389
  • Different values: 24
  • Only in 26.1_antalya: 129
  • Only in 25.8_antalya: 0

Antalya-exclusive diff (non-upstream explained)

Changed

  • allow_database_glue_catalog: 1 → 0
  • allow_database_iceberg: 1 → 0
  • allow_database_unity_catalog: 1 → 0
  • allow_experimental_database_glue_catalog: 1 → 0
  • allow_experimental_database_iceberg: 1 → 0
  • allow_experimental_database_unity_catalog: 1 → 0

PR #1084 (antalya-25.8) set these defaults to true. This override was not forward-ported to antalya-26.1, so they reverted to the upstream default (false).

Action required: forward-port PR #1084 to antalya-26.1 to restore datalake catalog defaults to true.

Added

  • export_merge_tree_partition_lock_inside_the_task (default 0) — PR #1402
  • export_merge_tree_partition_system_table_prefer_remote_information (default 1) — PR #1402
  • iceberg_partition_timezone (default "") — PR #1453
  • s3_propagate_credentials_to_other_storages (default 0) — PR #1490

Removed

  • none

Full diff (with justification)

Most of the full diff is from upstream changes (new settings in 25.9–26.1 and official default flips). The Antalya-exclusive subset is listed above.

Justification legend

Code Meaning
U-CHG Upstream default changed after 25.8
U-NEW Setting introduced upstream in 26.1
U-ADD Setting added upstream before 26.1 (25.9–25.12), not in 25.8 snapshot
A-CHG Antalya-specific default changed (25.8 override not forward-ported to 26.1)
A-NEW New Antalya-specific setting in 26.1
A-SNP Present in Antalya 25.8 but missing from snapshot (outdated snapshot)

A) Different values (24)

Setting 25.8 26.1 Justification
allow_database_glue_catalog 1 0 A-CHG — #1084 override not forward-ported
allow_database_iceberg 1 0 A-CHG — #1084 override not forward-ported
allow_database_unity_catalog 1 0 A-CHG — #1084 override not forward-ported
allow_experimental_database_glue_catalog 1 0 A-CHG — #1084 override not forward-ported
allow_experimental_database_iceberg 1 0 A-CHG — #1084 override not forward-ported
allow_experimental_database_unity_catalog 1 0 A-CHG — #1084 override not forward-ported
allow_experimental_time_time64_type 0 1 U-CHG
allow_statistic_optimize 0 1 U-CHG
allow_statistics_optimize 0 1 U-CHG
check_query_single_value_result 1 0 U-CHG
create_table_empty_primary_key_by_default 0 1 U-CHG
delta_lake_insert_max_rows_in_data_file 100000 1000000 U-CHG
enable_http_compression 0 1 U-CHG
enable_shared_storage_snapshot_in_query 0 1 U-CHG
enable_time_time64_type 0 1 U-CHG
http_write_exception_in_output_format 1 0 U-CHG
optimize_read_in_window_order 1 0 U-CHG
query_plan_max_limit_for_lazy_materialization 10 10000 U-CHG
query_plan_reuse_storage_ordering_for_window_functions 1 0 U-CHG
s3_retry_attempts 100 500 U-CHG
schema_inference_make_columns_nullable 1 3 U-CHG
show_data_lake_catalogs_in_system_tables 1 0 U-CHG
throw_if_deduplication_in_dependent_materialized_views_enabled_with_async_insert 1 0 U-CHG
use_variant_as_common_type 0 1 U-CHG

B) Only in 26.1_antalya (129)

B1) U-NEW (32): allow_experimental_database_paimon_rest_catalog, allow_experimental_nullable_tuple_type, allow_experimental_object_storage_queue_hive_partitioning, allow_experimental_qbit_type, archive_adaptive_buffer_max_size_bytes, automatic_parallel_replicas_min_bytes_per_replica, check_conversion_from_numbers_to_enum, correlated_subqueries_use_in_memory_buffer, database_datalake_require_metadata_access, deduplicate_insert_select, distributed_cache_file_cache_name, distributed_index_analysis, distributed_index_analysis_for_non_shared_merge_tree, enable_qbit_type, ignore_on_cluster_for_replicated_database, input_format_binary_max_type_complexity, join_runtime_bloom_filter_max_ratio_of_set_bits, join_runtime_filter_blocks_to_skip_before_reenabling, join_runtime_filter_pass_ratio_threshold_for_disabling, max_dynamic_subcolumns_in_json_type_parsing, max_insert_block_size_bytes, max_insert_block_size_rows, parallel_replicas_filter_pushdown, trace_profile_events_list, type_json_allow_duplicated_key_with_literal_and_nested_object, type_json_use_partial_match_to_skip_paths_by_regexp, use_hash_table_stats_for_join_reordering, use_join_disjunctions_push_down, use_primary_key, use_skip_indexes_on_data_read, use_statistics, use_variant_default_implementation_for_comparisons

B2) U-ADD (90): aggregate_function_input_format, allow_dynamic_type_in_join_keys, allow_experimental_alias_table_engine, allow_special_serialization_kinds_in_output_formats, apply_prewhere_after_final, apply_row_policy_after_final, arrow_flight_request_descriptor_type, automatic_parallel_replicas_mode, compatibility_s3_presigned_url_query_in_path, correlated_subqueries_default_join_kind, database_shared_drop_table_delay_seconds, delta_lake_log_metadata, delta_lake_snapshot_end_version, delta_lake_snapshot_start_version, distributed_cache_connect_timeout_ms, distributed_cache_prefer_bigger_buffer_size, distributed_cache_receive_timeout_ms, distributed_cache_send_timeout_ms, distributed_cache_tcp_keep_alive_timeout_ms, distributed_cache_use_clients_cache_for_read, distributed_cache_use_clients_cache_for_write, enable_full_text_index, enable_join_runtime_filters, enable_lazy_columns_replication, enable_positional_arguments_for_projections, enable_producing_buckets_out_of_order_in_aggregation, exclude_materialize_skip_indexes_on_insert, filesystem_cache_allow_background_download, format_binary_max_object_size, format_capn_proto_max_message_size, iceberg_delete_data_on_drop, iceberg_insert_max_bytes_in_data_file, iceberg_insert_max_partitions, iceberg_insert_max_rows_in_data_file, inject_random_order_for_select_without_order_by, input_format_parquet_local_time_as_utc, input_format_protobuf_oneof_presence, insert_select_deduplicate, into_outfile_create_parent_directories, jemalloc_collect_profile_samples_in_trace_log, jemalloc_enable_profiler, join_runtime_bloom_filter_bytes, join_runtime_bloom_filter_hash_functions, join_runtime_filter_exact_values_limit, joined_block_split_single_row, materialized_views_squash_parallel_inserts, max_projection_rows_to_use_projection_index, max_reverse_dictionary_lookup_cache_size_bytes, max_streams_for_files_processing_in_cluster_functions, min_table_rows_to_use_projection_index, optimize_const_name_size, optimize_empty_string_comparisons, optimize_inverse_dictionary_lookup, optimize_qbit_distance_function_reads, optimize_rewrite_like_perfect_affix, os_threads_nice_value_materialized_view, os_threads_nice_value_query, output_format_pretty_named_tuples_as_json, parallel_replicas_allow_materialized_views, promql_evaluation_time, query_plan_convert_any_join_to_semi_or_anti_join, query_plan_direct_read_from_text_index, query_plan_display_internal_aliases, query_plan_max_limit_for_top_k_optimization, query_plan_max_step_description_length, query_plan_optimize_join_order_algorithm, query_plan_optimize_join_order_limit, query_plan_read_in_order_through_join, query_plan_remove_unused_columns, query_plan_text_index_add_hint, query_plan_use_logical_join_step, read_from_distributed_cache_if_exists_otherwise_bypass_cache, rewrite_in_to_join, s3_path_filter_limit, s3queue_keeper_fault_injection_probability, send_profile_events, serialize_string_in_memory_with_zero_byte, show_processlist_include_internal, temporary_files_buffer_size, text_index_hint_max_selectivity, text_index_use_bloom_filter, type_json_skip_invalid_typed_paths, use_paimon_partition_pruning, use_skip_indexes_for_disjunctions, use_skip_indexes_for_top_k, use_statistics_cache, use_text_index_dictionary_cache, use_text_index_header_cache, use_text_index_postings_cache, use_top_k_dynamic_filtering

B3) A-SNP (3): enable_alias_marker, export_merge_tree_part_throw_on_pending_mutations, export_merge_tree_part_throw_on_pending_patch_parts — present in Antalya 25.8 but missing from the outdated snapshot; values unchanged in 26.1

B4) A-NEW (4): export_merge_tree_partition_lock_inside_the_task (#1402), export_merge_tree_partition_system_table_prefer_remote_information (#1402), iceberg_partition_timezone (#1453), s3_propagate_credentials_to_other_storages (#1490)


Follow-up

All items are now accounted for:

  • 6 datalake allow_* settings (A-CHG): PR #1084 override was not forward-ported to antalya-26.1. Action required: forward-port PR #1084 to antalya-26.1 to restore datalake catalog defaults to true.
  • 4 new Antalya settings (A-NEW): expected additions from PRs #1402, #1453, and #1490. No action needed.
  • 3 outdated-snapshot settings (A-SNP): already present in Antalya 25.8 but missing from the snapshot. Values unchanged in 26.1. No action needed.
  • All other diffs: upstream changes (U-CHG, U-NEW, U-ADD). No action needed.

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions