Pith. sign in

REVIEW 4 major objections 5 minor 106 references

Learned Offline Query Planning via Bayesian Optimization

T0 review · 4 major / 5 minor · reviewed 2026-08-08 · deepseek-v4-flash

Pith's one-line read Offline query planning is best posed as Bayesian optimization over a learned plan space, and this finds faster plans than hint-based or reinforcement-learning optimizers.

desk verdict Clever and credible application of latent-space Bayesian optimization to offline join-order planning, but the headline latency claims are not actually demonstrated because the main evaluation fixes plan-execution count, not wall-clock time. read the letter →

arxiv 2502.05256 v1 pith:5IAJHTQJ submitted 2025-02-07 cs.DB

classification cs.DB
keywords Bayesianoptimizationqueryofflinevariationalautoencoderjoinorderlearnedright-censoredobservations
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Most analytics workloads run the same query thousands of times, so spending seconds or hours of offline compute to find a faster plan can pay off many times over. This paper claims that the right way to run that offline search is Bayesian optimization over a learned continuous encoding of join-order plans, with actual query execution as the reward signal. BayesQO trains a variational autoencoder on plan strings, then searches the resulting latent space with a trust-region Bayesian optimizer, treating query timeouts as censored observations. In experiments on four benchmarks, it finds faster plans than the best plan obtainable from a hint-based optimizer or from a reinforcement-learning optimizer, with 10-100x improvements over prior learned optimizers on some queries. Because the best plan found is at least as good as the initialization set, BayesQO never does worse than the hint-based baseline.

What carries the argument

The key machinery is the combination of a string language for join trees, a variational autoencoder that embeds those strings in a continuous latent space, and trust-region Bayesian optimization over that space. The string language is complete, meaning every join tree is representable, and decode-valid, meaning every string decodes to a syntactically valid plan, so the optimizer can explore the whole plan space without feasibility constraints. The VAE's latent vector is the search domain; a scalable Gaussian-process surrogate estimates latency as a function of latent position; Thompson sampling with a dynamically sized trust region guides proposals; and right-censored observations from timeouts are incorporated into the surrogate through a Tobit likelihood, with each timeout chosen so that the incumbent plan is confidently better than the candidate.

What would settle it

Execute a diverse set of plans, record their latent-space coordinates and their runtimes, and check whether latent distance predicts runtime difference: if plans closer in latent space are not significantly more likely to have similar latencies than random pairs, the smoothness assumption fails and BayesQO's search is guided by a proxy unrelated to plan quality.

Watch

Extended reading notes

Core claim

The paper's central claim is that offline query planning is better posed as a Bayesian optimization problem than as an online, regret-minimizing problem. For a given query, BayesQO encodes possible join orders and physical operators as strings, maps those strings into a 64-dimensional latent space with a variational autoencoder, and runs local Bayesian optimization over that space, executing each decoded plan on a read-only snapshot and observing its latency or timeout. The paper demonstrates that this procedure finds plans that beat the best of 49 hint-based alternatives on nearly every query in the JOB, CEB, Stack, and DSB benchmarks, with the largest gains on JOB and Stack, and that reusing an old optimized plan as an initialization point makes re-optimization after data drift several times cheaper.

Load-bearing premise

The load-bearing premise is that the VAE's latent space is smooth with respect to query-plan latency, so nearby latent vectors decode to plans with similar runtimes; if that fails, the Gaussian-process surrogate is not optimizing plan quality.

Editorial extensions

If this is right

  • For a workload where a query runs thousands of times, even a small per-query improvement is multiplied, so paying hours of offline compute is worthwhile.
  • The best final plan is guaranteed to be at least as good as the best plan in the initialization set, so the approach never regresses below the hint-based baseline.
  • Across the evaluated benchmarks, BayesQO finds improvements over the best hint plan on nearly every query, and on the Stack benchmark it finds more than a 2x improvement on half the queries.
  • Previously optimized plans remain competitive after a simulated two-year data drift, and re-optimization initialized with the old plan converges in about 1.5 hours versus 8.2 hours from scratch.
  • A language model fine-tuned on past optimization traces can generate strong starting plans for unseen queries, though its advantage largely disappears when the query template is absent from its training data.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension the paper leaves open: measure whether plans close in the VAE latent space have similar runtimes; if latent distance and latency are uncorrelated, the Bayesian surrogate would be optimizing a proxy rather than plan quality.
  • The string format encodes join orders and physical operators but not predicates, selections, or subqueries, so extending it to richer plan features would be needed for workloads where join order is not the dominant cost.
  • The paper's loop of using execution traces to fine-tune a language model suggests a general recipe for other database design choices, such as index selection and data layout, where each offline run generates training data for the next decision.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes BayesQO, an offline query optimizer that uses latent-space Bayesian optimization to search for fast join-order plans for repeated analytic queries. The system encodes query plans as strings, trains a variational autoencoder over those strings, and then performs BO with a Tobit-like censored likelihood, trust regions, and learned timeouts to minimize the best observed plan latency within a budget. Experiments compare BayesQO against exhaustive Bao hint-set execution, Balsa, and random plan search on four workloads (JOB, CEB, Stack, DSB), with additional studies on timeouts, trust regions, data drift, and LLM-based initialization. The paper reports that BayesQO finds faster plans than the baselines for many queries and that it can produce order-of-magnitude improvements on some queries.

Significance. The paper addresses a timely and practical problem: most learned query optimizers are online and must limit optimization overhead, whereas many real analytics workloads consist of repeated queries that justify longer offline optimization. Formalizing offline query optimization and proposing a BO-based alternative to RL is a valuable conceptual contribution, and the idea of using censored observations for timeouts is well motivated. The experimental effort is substantial: three large workloads, multiple baselines, ablations, a data-drift study, and an LLM-initialization experiment. If the empirical claims were established under the stated objective, the paper would make a useful contribution to the learned query optimization literature. However, the current evaluation does not fully support the headline conclusions because the main comparison uses a fixed number of plan executions rather than a time budget, and several supporting experiments suffer from selection bias or circular evaluation.

major comments (4)
  1. [Section 5.2 and Eq. (1)] The main comparison fixes the number of plan executions at 4000 per query rather than a wall-clock budget, which does not match the formal objective in Eq. (1) of minimizing best latency subject to a time budget B. Since query latencies span orders of magnitude, 4000 executions corresponds to vastly different cumulative execution times across techniques and queries, so the CDFs in Figure 3 do not demonstrate the claimed time-budgeted improvements. Please report results as a function of cumulative execution time (as in Figure 4) or fix a time budget and measure the achieved latency.
  2. [Section 5.6 and Figure 8] The LLM initialization experiment fine-tunes GPT-4o mini on the fastest optimized plans for the same CEB queries on which it is then evaluated; the text states that the training set included queries from all query templates present in the workload. The top plot of Figure 8 therefore measures in-sample performance and cannot support the claim that fine-tuned LLMs produce good initialization plans for unseen queries. Only the held-out-template experiment (bottom plot) supports cross-query generalization, and even there the queries from the held-out templates were presumably not in the fine-tuning set. Please report results on queries entirely withheld from fine-tuning, and separate in-sample from out-of-sample results clearly.
  3. [Section 4.2 and Table 2] The paper's core mechanism assumes that the VAE latent space is smooth with respect to plan latency: nearby latent vectors decode to plans with similar execution times. The only validation offered is reconstruction accuracy (Table 2), which does not measure this property. Without evidence that latent distance correlates with latency difference, the BO surrogate may optimize over a distorted proxy of plan quality. Please provide a direct check, e.g., the correlation between latent-space distance and absolute or relative latency difference on a held-out set of plans, or a comparison of BO on the latent space against a surrogate defined on the original string space.
  4. [Section 5.1 and Figure 3] The CEB and Stack workloads are selected subsets rather than the full benchmarks: CEB is filtered to queries with high improvement headroom (top and bottom 100 by hint-set improvement and longest-running), and Stack selects the longest-running queries per template. This selection biases the aggregate CDFs and undermines the conclusion that BayesQO improves 'nearly every query in several benchmarks.' Please report results on the full benchmarks or clearly label the plots as applicable only to the selected subsets.
minor comments (5)
  1. [Section 3] The join ordering count 'n!·Cn = 2n!' appears mathematically incorrect; the number of binary join trees without physical operators is n! times the (n-1)-th Catalan number. Please correct the formula.
  2. [Section 5.2] The paragraph states that each technique 'was executed for several hours' and then says 'Each optimization technique was executed for 4000 plan executions'; these two criteria are inconsistent. Please clarify the actual stopping rule and, if possible, report the wall-clock times corresponding to the 4000-execution runs.
  3. [Figure 3] The CDF plots lack a clear description of the axes; please state explicitly that the y-axis is the fraction of queries and explain what the x-axis values represent (e.g., percentage improvement over the best Bao plan).
  4. [Section 4.1] The example encodings '(B,C,⊲⊳m,A,B,⊲⊳h)' are written in a tuple-like notation that is not formally defined. A grammar or BNF for the string language would improve reproducibility and precision.
  5. [References] References [17] and [18] appear to describe the same paper (arXiv:2009.13828); please de-duplicate.

Circularity Check

1 steps flagged · score 4.0 of 10

Same-template LLM evaluation trains on the optimized plans it later 'predicts'; core BO comparison is not circular.

  1. fitted input called prediction [Section 5.6 (Few-Shot LLM from BO Results), first experiment; training data defined in Section 4.4]
    "we fine-tuned GPT-4o mini on the fastest 10 optimized plans for each query from running BO on the CEB workload as described in Section 4.4. This training set included queries from all query templates present in the workload. We then compared the best runtime out of 50 plans (giving it as many plans as Bao) per-query generated by the LLM for a particular query against the runtime of the optimal Bao plan."

    Section 4.4 says the fine-tuning dataset is built by 'collecting trajectories from 606 BayesQO runs, selecting the top-1 and top-5 query plans for each query.' In the first experiment of Section 5.6, no queries or templates are withheld: the LLM is fine-tuned on the fastest optimized plans for the CEB workload, then evaluated by asking it to generate plans for 'a particular query' from that same workload. The target output for each evaluated query is thus present in the training set, so a low-latency generated plan can be a memorized or near-memorized copy of the known optimized plan rather than a genuine few-shot prediction.

full rationale

The central BayesQO claim is not circular. The main optimization loop evaluates actual query latencies against a real DBMS; the VAE is trained on planner-generated plan strings without using the target query latencies, and the GP surrogate is fitted online to the externally measured latencies of evaluated plans. The comparison against Bao, Balsa, and Random is an external benchmark, and the fact that BayesQO is initialized with all Bao hint sets transparently guarantees that it can match, not exceed, that baseline by construction; any improvement beyond Bao is an empirical result. No load-bearing self-citation chain or imported uniqueness theorem is present; the heavy use of Maus et al. is method reuse, not a circular justification. The one clear circular step is the same-template LLM evaluation in Section 5.6, where the fine-tuning data includes the optimized plans for the very queries being evaluated, so the reported per-query improvements are at least partly retrieval from training data rather than prediction. The withheld-template experiment is the non-circular control and shows the limitation. The 4 score reflects this partial circularity in a secondary contribution while the core offline-optimization result remains independently supported by external query executions.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The system rests on fitted machine-learning components (VAE, GP surrogate, optional LLM) and on domain assumptions about a hint-able, read-only DBMS. The key unvalidated modeling assumption is smoothness of the latent space with respect to plan latency.

free parameters (4)
  • VAE latent dimension = 64
    Selected from Table 2 as a tradeoff between reconstruction accuracy and dimensionality; not derived from query latency or the optimization objective.
  • Timeout confidence margin kappa = not reported
    Appears in the uncertainty-based timeout constraint in Section 4.3.1 (y*_t <= mu'_t(tau) - kappa * sigma'_t(tau)); no value or tuning procedure is given, so it is a free parameter of the acquisition rule.
  • Number of BO initialization plans = 49
    Fixed by exhaustive enumeration of the Bao hint set; the paper relies on this set to guarantee BO starts at least as well as Bao.
  • Number of LLM initialization samples = 50
    Chosen to match the number of Bao plans for comparison; no sensitivity analysis is provided.
assumptions (6)
  • standard math Bayesian optimization and Gaussian process surrogate assumptions: the objective function is modeled as a sample from a GP with a chosen kernel and likelihood.
    Section 4.3 builds the BO loop on GP surrogates and Thompson sampling; no kernel or hyperparameter details are given, but BO theory is standard.
  • standard math Variational inference ELBO derivations for VAE and SVGP are correct as used.
    Section 4.2 and 4.3.1 use standard ELBO and Tobit likelihood manipulations; we do not verify the algebra, but no nonstandard step beyond Gauss-Hermite quadrature is introduced.
  • domain assumption The DBMS executes hinted plans and respects join order and join operator specifications.
    Assumption 3 in Section 3: 'The execution engine can accept physical plans/hints that specify join orders and physical join operators.'
  • domain assumption Queries can be executed against read-only snapshots without side effects.
    Assumption 2 in Section 3; the entire method relies on repeated execution against a stable database state.
  • domain assumption The VAE latent space provides a smooth proxy for query plan performance.
    Section 4.2 states the goal of the DAE is to map similar plans to similar vectors, but this is asserted, not validated; the whole BO search depends on it.
  • ad hoc to paper Decoding invalid strings by index-based replacement yields a useful, locally consistent mapping from latent space to valid plans.
    Section 4.1 introduces this scheme with no evidence that similar invalid strings map to nearby valid plans.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Learned Offline Query Planning via Bayesian Optimization." pith.science (2026). https://pith.science/paper/5IAJHTQJ

@misc{pith2026250205256,
  author       = {Pith},
  title        = {Pith review of: Learned Offline Query Planning via Bayesian Optimization},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5IAJHTQJ}},
  note         = {Machine review of arXiv:2502.05256}
}
read the original abstract

Analytics database workloads often contain queries that are executed repeatedly. Existing optimization techniques generally prioritize keeping optimization cost low, normally well below the time it takes to execute a single instance of a query. If a given query is going to be executed thousands of times, could it be worth investing significantly more optimization time? In contrast to traditional online query optimizers, we propose an offline query optimizer that searches a wide variety of plans and incorporates query execution as a primitive. Our offline query optimizer combines variational auto-encoders with Bayesian optimization to find optimized plans for a given query. We compare our technique to the optimal plans possible with PostgreSQL and recent RL-based systems over several datasets, and show that our technique finds faster query plans.

Figures

Figures reproduced from arXiv: 2502.05256 by the authors.

Figure 1
Figure 1. A comparison of reinforcement learning (RL, left) [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. BayesQO workflow because it was optimized offline, the cached plan is used. Otherwise, the DBMS’ optimizer is used. ❸ Looking at the runtime statistics of the executed plan, BayesQO decides whether the query should be re-optimized. Problem definition Our goal is to find a query plan 𝑃 with low latency for a query 𝑄 using as few additional resources as possible (i.e., as quickly as possible).2 Unlike traditional quer… view at source ↗
Figure 3
Figure 3. Best plans found at the end of optimization with each technique for each workload. Towards the top right corner is [PITH_FULL_IMAGE:figures/full_fig_p011_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: Case studies showing optimization time vs. plan performance for individual queries. Lower is better. [PITH_FULL_IMAGE:figures/full_fig_p011_4.png]
Figure 5
Figure 5. Figure 5: Ablation study of our novel BO scheme. plans, discussed further below. Despite the substantial data drift, past plans perform about as well as if we had performed BO for the first time on the future dataset and continue to perform much better than the best Bao hint. Th…
Figure 9
Figure 9. Figure 9: We find that with only one BO run, while overhead on a [PITH_FULL_IMAGE:figures/full_fig_p012_9.png]
Figure 6
Figure 6. Figure 6: Left: Plans from the past vs. plans optimized in the future. Middle: BO run results when using the VAE from the past [PITH_FULL_IMAGE:figures/full_fig_p013_6.png]
Figure 7
Figure 7. Figure 7: Left: Performance of plans optimized in the past vs. [PITH_FULL_IMAGE:figures/full_fig_p013_7.png]
Figure 8
Figure 8. Figure 8: Top: LLM trained on plans of the same template. Bot [PITH_FULL_IMAGE:figures/full_fig_p013_8.png]
Figure 10
Figure 10. Figure 10: Optimization using BayesQO vs. LimeQO across [PITH_FULL_IMAGE:figures/full_fig_p014_10.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

106 extracted references · 26 canonical work pages

  1. [1]

    Christoph Anneser, Nesime Tatbul, David Cohen, Zhenggang Xu, Prithvi Pan- dian, Nikolay Leptev, and Ryan Marcus. 2023. AutoSteer: Learned Query Optimization for Any SQL Database. PVLDB 14, 1 (Aug. 2023). https: //doi.org/10.14778/3611540.3611544

  2. [2]

    M. M. Astrahan, M. W. Blasgen, D. D. Chamberlin, K. P. Eswaran, J. N. Gray, P. P. Griffiths, W. F. King, R. A. Lorie, P. R. McJones, J. W. Mehl, G. R. Putzolu, I. L. Traiger, B. W. Wade, and V. Watson. 1976. System R: relational approach to database management. ACM Trans. Database Syst. 1, 2 (jun 1976), 97–137. https://doi.org/10.1145/320455.320457

  3. [3]

    Shivnath Babu, Pedro Bizarro, and David DeWitt. 2005. Proactive re- optimization with Rio. In Proceedings of the 2005 ACM SIGMOD international conference on Management of data (SIGMOD ’05). Association for Computing Ma- chinery, New York, NY, USA, 936–938. https://doi.org/10.1145/1066157.1066294

  4. [4]

    Henriette Behr, Volker Markl, and Zoi Kaoudi. 2023. Learn What Really Matters: A Learning-to-Rank Approach for ML-based Query Optimization. In Data- base Systems for Business, Technology, and the Web 2023 (BTW ’23) , Birgitta König-Ries, Stefanie Scherzinger, Wolfgang Lehner, and Gottfried Vossen (Eds.). Tao et al. 1.00s 10.00s 1m 16m 2h46m Optimization t...

  5. [5]

    Stefano Cereda, Stefano Valladares, Paolo Cremonesi, and Stefano Doni. 2021. CGPTuner: a contextual gaussian process bandit approach for the automatic tuning of IT configurations under varying workload conditions. Proc. VLDB Endow. 14, 8 (apr 2021), 1401–1413. https://doi.org/10.14778/3457390.3457404

  6. [6]

    Surajit Chaudhuri. 2009. Query optimizers: time to rethink the contract?. In Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data (Providence, Rhode Island, USA)(SIGMOD ’09). Association for Computing Machinery, New York, NY, USA, 961–968. https://doi.org/10.1145/1559845. 1559955

  7. [7]

    Tianyi Chen, Jun Gao, Hedui Chen, and Yaofeng Tu. 2023. LOGER: A Learned Optimizer Towards Generating Efficient and Robust Query Execution Plans. Proceedings of the VLDB Endowment 16, 7 (March 2023), 1777–1789. https: //doi.org/10.14778/3587136.3587150

  8. [8]

    Xu Chen, Haitian Chen, Zibo Liang, Shuncheng Liu, Jinghong Wang, Kai Zeng, Han Su, and Kai Zheng. 2023. LEON: A New Framework for ML-Aided Query Optimization. Proc. VLDB Endow. 16, 9 (May 2023), 2261–2273. https://doi.org/ 10.14778/3598581.3598597

Show all 106 references
  1. [9]

    Guilherme Damasio, Vincent Corvinelli, Parke Godfrey, Piotr Mierzejewski, Alex Mihaylov, Jaroslaw Szlichta, and Calisto Zuzarte. 2019. Guided automated learning for query workload re-optimization. Proceedings of the VLDB Endow- ment 12, 12 (Aug. 2019), 2010–2021. https://doi.o...

  2. [10]

    Fu, Stefano Ermon, Atri Rudra, and Christopher Ré

    Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. 2022. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. arXiv:2205.14135 [cs.LG] https://arxiv.org/abs/2205.14135

  3. [11]

    Aryan Deshwal and Janardhan Rao Doppa. 2021. Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces.CoRR abs/2111.01186 (2021). arXiv:2111.01186 https://arxiv.org/abs/2111.01186

  4. [12]

    Bailu Ding, Surajit Chaudhuri, Johannes Gehrke, and Vivek Narasayya. 2021. DSB: a decision support benchmark for workload-driven and traditional data- base systems. Proc. VLDB Endow. 14, 13 (Sept. 2021), 3376–3388. https: //doi.org/10.14778/3484224.3484234

  5. [14]

    Lyric Doshi, Vincent Zhuang, Gaurav Jain, Ryan Marcus, Haoyu Huang, Deniz Altinbuken, Eugene Brevdo, and Campbell Fraser. 2023. Kepler: Robust Learning for Faster Parametric Query Optimization.Proceedings of the 2023 ACM SIGMOD Conference 1, 1 (May 2023), 109. https://doi.org/...

  6. [15]

    Jennie Duggan, Ugur Cetintemel, Olga Papaemmanouil, and Eli Upfal. 2011. Performance Prediction for Concurrent Database Workloads. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data (SIGMOD ’11). ACM, Athens, Greece, 337–348. https://doi.org/1...

  7. [16]

    Jennie Duggan, Olga Papaemmanouil, Ugur Cetintemel, and Eli Upfal. 2014. Contender: A Resource Modeling Approach for Concurrent Query Performance Prediction. In Proceedings of the 14th International Conference on Extending Database Technology (EDBT ’14) . 109–120

  8. [18]

    Katharina Eggensperger, Kai Haase, Philipp Müller, Marius Lindauer, and Frank Hutter. 2020. Neural Model-based Optimization with Right-Censored Observa- tions. arXiv:2009.13828 [cs.AI] https://arxiv.org/abs/2009.13828

  9. [19]

    Stephan Eissman, Daniel Levy, Rui Shu, Stefan Bartzsch, and Stefano Ermon

  10. [20]

    David Eriksson and Martin Jankowiak. 2021. High-dimensional Bayesian op- timization with sparse axis-aligned subspaces. In Proceedings of the Thirty- Seventh Conference on Uncertainty in Artificial Intelligence . PMLR, 493–503. https://proceedings.mlr.press/v161/eriksson21a.ht...

  11. [21]

    David Eriksson, Michael Pearce, Jacob Gardner, Ryan D Turner, and Matthias Poloczek. 2019. Scalable Global Optimization via Local Bayesian Op- timization. In Advances in Neural Information Processing Systems . 5496–

  12. [22]

    David Eriksson, Michael Pearce, Jacob R Gardner, Ryan Turner, and Matthias Poloczek. 2019. Scalable global optimization via local Bayesian optimization. In Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS ’19) . Curran Associat...

  13. [23]

    Peter Frazier, Warren Powell, and Savas Dayanik. 2009. The knowledge-gradient policy for correlated normal beliefs. INFORMS journal on Computing 21, 4 (2009), 599–613

  14. [24]

    Roman Garnett. 2023. Bayesian Optimization. Cambridge University Press

  15. [25]

    Damjan Gjurovski, Angjela Davitkova, and Sebastian Michel. 2024. Grid-AR: A Grid-based Booster for Learned Cardinality Estimation and Range Joins. https://doi.org/10.48550/arXiv.2410.07895 arXiv:2410.07895 [cs]

  16. [26]

    Rafael Gómez-Bombarelli, Jennifer N Wei, David Duvenaud, José Miguel Hernández-Lobato, Benjamín Sánchez-Lengeling, Dennis Sheberla, Jorge Aguilera-Iparraguirre, Timothy D Hirzel, Ryan P Adams, and Alán Aspuru- Guzik. 2018. Automatic chemical design using a data-driven continuo...

  17. [27]

    Goetz Graefe. 1995. The Cascades Framework for Query Optimization. IEEE Data Eng. Bull. 18, 3 (1995), 19–29

  18. [28]

    Antoine Grosnit, Rasul Tutunov, Alexandre Max Maraval, Ryan-Rhys Grif- fiths, Alexander Imani Cowen-Rivers, Lin Yang, Lin Zhu, Wenlong Lyu, Zhitang Chen, Jun Wang, Jan Peters, and Haitham Bou-Ammar. 2021. High-Dimensional Bayesian Optimisation with Variational Autoencoders and...

  19. [29]

    Lawrence

    James Hensman, Nicolò Fusi, and Neil D. Lawrence. 2013. Gaussian processes for Big data. In Proceedings of the Twenty-Ninth Conference on Uncertainty in Artificial Intelligence (Bellevue, WA) (UAI’13). AUAI Press, Arlington, Virginia, USA, 282–290

  20. [30]

    James Hensman, Alex Matthews, and Zoubin Ghahramani. 2014. Scalable Variational Gaussian Process Classification. arXiv:1411.2005 [stat.ML]

  21. [31]

    Benjamin Hilprecht and Carsten Binnig. 2022. Zero-shot cost models for out- of-the-box learned cost prediction. Proceedings of the VLDB Endowment 15, 11 (July 2022), 2361–2374. https://doi.org/10.14778/3551793.3551799

  22. [33]

    Hoos, and Kevin Leyton-Brown

    Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. 2013. Bayesian Optimization With Censored Response Data. CoRR abs/1310.1947 (2013). arXiv:1310.1947 http://arxiv.org/abs/1310.1947

  23. [34]

    Immanuel Trummer. 2022. GenesisDB: Synthesizing Customized SQL Execution Engines from Natural Language Instructions Using GPT-3 Codex . Technical Report. Cornell, Ithaca. NY. https://rm.cab/genesisdb

  24. [35]

    Jaakkola

    Wengong Jin, Regina Barzilay, and Tommi S. Jaakkola. 2018. Junction Tree Variational Autoencoder for Molecular Graph Generation. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmäs- san, Stockholm, Sweden, July 10-15, 2018 (Proceed...

  25. [36]

    Hiroshi Kajino. 2019. Molecular hypergraph grammar with its application to molecular optimization. In International Conference on Machine Learning. PMLR, 3183–3191

  26. [37]

    Amin Kamali, Verena Kantere, Calisto Zuzarte, and Vincent Corvinelli. 2024. RobOpt: A Tool for Robust Workload Optimization Based on Uncertainty- Aware Machine Learning. In Companion of the 2024 International Conference on Management of Data (SIGMOD ’24) . Association for Comp...

  27. [38]

    Amin Kamali, Verena Kantere, Calisto Zuzarte, and Vincent Corvinelli. 2024. Roq: Robust Query Optimization Based on a Risk-aware Learned Cost Model. (2024). https://doi.org/10.48550/ARXIV.2401.15210

  28. [39]

    Konstantinos Kanellis, Cong Ding, Brian Kroth, Andreas Müller, Carlo Curino, and Shivaram Venkataraman. 2022. LlamaTune: sample-efficient DBMS con- figuration tuning. Proc. VLDB Endow. 15, 11 (July 2022), 2953–2965. https: //doi.org/10.14778/3551793.3551844

  29. [40]

    Kyoungmin Kim, Sangoh Lee, Injung Kim, and Wook-Shin Han. 2024. ASM: Harmonizing Autoregressive Model, Sampling, and Multi-dimensional Statistics Merging for Cardinality Estimation. Proceedings of the ACM on Management of Data 2, 1 (March 2024), 1–27. https://doi.org/10.1145/3639300

  30. [41]

    Kingma and Max Welling

    Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. In 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1312.6114

  31. [42]

    Andreas Kipf, Thomas Kipf, Bernhard Radke, Viktor Leis, Peter Boncz, and Alfons Kemper. 2019. Learned Cardinalities: Estimating Correlated Joins with Deep Learning. In 9th Biennial Conference on Innovative Data Systems Research (CIDR ’19). http://arxiv.org/abs/1809.00677

  32. [43]

    Mario Krenn, Florian Häse, AkshatKumar Nigam, Pascal Friederich, and Alán Aspuru-Guzik. 2020. Self-Referencing Embedded Strings (SELFIES): A 100% robust molecular string representation. Machine Learning: Science and Tech- nology 1, 4 (Dec. 2020), 045024. https://doi.org/10.108...

  33. [44]

    Jiale Lao, Yibo Wang, Yufei Li, Jianping Wang, Yunjia Zhang, Zhiyuan Cheng, Wanghu Chen, Mingjie Tang, and Jianguo Wang. 2024. GPTuner: A Manual- Reading Database Tuning System via GPT-Guided Bayesian Optimization. Proc. VLDB Endow. 17, 8 (may 2024), 1939–1952. https://doi.org...

  34. [46]

    Viktor Leis, Andrey Gubichev, Atanas Mirchev, Peter Boncz, Alfons Kemper, and Thomas Neumann. 2015. How good are query optimizers, really? Proc. VLDB Endow. 9, 3 (nov 2015), 204–215. https://doi.org/10.14778/2850583.2850594

  35. [47]

    Guoliang Li, Xuanhe Zhou, Ji Sun, Xiang Yu, Yue Han, Lianyuan Jin, Wenbo Li, Tianqing Wang, and Shifu Li. 2021. openGauss: an autonomous database system. Proceedings of the VLDB Endowment 14, 12 (July 2021), 3028–3042. https://doi.org/10.14778/3476311.3476380

  36. [48]

    Pengfei Li, Wenqing Wei, Rong Zhu, Bolin Ding, Jingren Zhou, and Hua Lu. 2023. ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads. Proc. VLDB Endow. 17, 2 (Oct. 2023), 197–210. https: //doi.org/10.14778/3626292.3626302

  37. [49]

    Wan Shen Lim, Lin Ma, William Zhang, Matthew Butrovich, Samuel Arch, and Andrew Pavlo. 2024. Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems. Proceedings of the VLDB Endowment 17, 11 (July 2024), 3...

  38. [50]

    Ives, and Boon Thau Loo

    Mengmeng Liu, Zachary G. Ives, and Boon Thau Loo. 2016. Enabling Incremen- tal Query Re-Optimization. In Proceedings of the 2016 International Conference on Management of Data (SIGMOD ’16) . Association for Computing Machinery, New York, NY, USA, 1705–1720. https://doi.org/10....

  39. [51]

    Guy Lohman. 2014. Is Query Optimization a "Solved" Problem?. InACM SIGMOD Blog (ACM Blog ’14) . https://wp.sigmod.org/?p=1075

  40. [52]

    Tan, and S

    Hongjun Lu, K. Tan, and S. Dao. 1995. The Fittest Survives: An Adaptive Approach to Query Optimization (VLDB ’95) . Zurich, Switzerland. https: //www.semanticscholar.org/paper/The-Fittest-Survives%3A-An-Adaptive- Approach-to-Query-Lu-Tan/3d2625f15445adc9dd23324d4839c5dd364630fa

  41. [53]

    Wesley J Maddox, Samuel Stanton, and Andrew G Wilson. 2021. Conditioning sparse variational gaussian processes for online decision-making. Advances in Neural Information Processing Systems 34 (2021), 6365–6379

  42. [54]

    Ryan Marcus. 2023. Learned Query Superoptimization. In Joint Workshops at 49th International Conference on Very Large Data Bases (AIDB@VLDB ’23). CEUR Workshop Proceedings, Vancouver, BC, Canada

  43. [55]

    Ryan Marcus, Parimarjan Negi, Hongzi Mao, Nesime Tatbul, Mohammad Al- izadeh, and Tim Kraska. 2021. Bao: Making Learned Query Optimization Prac- tical. In Proceedings of the 2021 International Conference on Management of Data (Virtual Event, China) (SIGMOD ’21). Association fo...

  44. [57]

    Ryan Marcus and Olga Papaemmanouil. 2018. Deep Reinforcement Learning for Join Order Enumeration. In First International Workshop on Exploiting Artificial Intelligence Techniques for Data Management (aiDM @ SIGMOD ’18) . Houston, TX

  45. [58]

    Ryan Marcus and Olga Papaemmanouil. 2019. Plan-Structured Deep Neural Network Models for Query Performance Prediction. PVLDB 12, 11 (2019), 1733–1746. https://doi.org/10.14778/3342263.3342646

  46. [59]

    Markl, P

    V. Markl, P. J. Haas, M. Kutsch, N. Megiddo, U. Srivastava, and T. M. Tran. 2007. Consistent selectivity estimation via maximum entropy. The VLDB Journal 16, 1 (Jan. 2007), 55–76. https://doi.org/10.1007/s00778-006-0030-1

  47. [60]

    Alexia Massalin. 1987. Superoptimizer: a look at the smallest program. ACM SIGARCH Computer Architecture News 15, 5 (Oct. 1987), 122–126. https://doi. org/10.1145/36177.36194

  48. [61]

    Kusner, John Brad- shaw, and Jacob R

    Natalie Maus, Haydn Jones, Juston Moore, Matt J. Kusner, John Brad- shaw, and Jacob R. Gardner. 2022. Local Latent Space Bayesian Opti- mization over Structured Inputs. In Advances in Neural Information Pro- cessing Systems 35: Annual Conference on Neural Information Processin...

  49. [62]

    Natalie Maus, Haydn Thomas Jones, Juston Moore, Matt Kusner, John Brad- shaw, and Jacob R. Gardner. 2022. Local Latent Space Bayesian Optimiza- tion over Structured Inputs (NeurIPS ’22). https://openreview.net/forum?id= nZRTRevUO-

  50. [63]

    Maus, Haydn T

    Natalie T. Maus, Haydn T. Jones, Juston S. Moore, Matt J. Kusner, John Bradshaw, and Jacob R. Gardner. 2024. Local latent space Bayesian optimization over structured inputs. In Proceedings of the 36th International Conference on Neural Information Processing Systems (New Orlea...

  51. [64]

    Mert Akdere and Ugur Cetintemel. 2012. Learning-based query performance modeling and prediction. In 2012 IEEE 28th International Conference on Data Engineering (ICDE ’12) . IEEE, 390–401

  52. [65]

    Songsong Mo, Yile Chen, Hao Wang, Gao Cong, and Zhifeng Bao. 2023. Lemo: A Cache-Enhanced Learned Optimizer for Concurrent Queries. Proc. ACM Manag. Data 1, 4 (Dec. 2023), 247:1–247:26. https://doi.org/10.1145/3626734

  53. [66]

    Parimarjan Negi, Matteo Interlandi, Ryan Marcus, Mohammad Alizadeh, Tim Kraska, Marc Friedman, and Alekh Jindal. 2021. Steering Query Optimizers: A Practical Take on Big Data Workloads. In Proceedings of the 2021 Interna- tional Conference on Management of Data (SIGMOD ’21) . ...

  54. [67]

    Parimarjan Negi, Ryan Marcus, Andreas Kipf, Hongzi Mao, Nesime Tatbul, Tim Kraska, and Mohammad Alizadeh. 2021. Flow-Loss: Learning Cardinality Estimates That Matter. Proc. VLDB Endow. 14, 11 (jul 2021), 2019–2032. https: //doi.org/10.14778/3476249.3476259

  55. [68]

    Kiyoshi Ono and Guy M. Lohman. 1990. Measuring the Complexity of Join Enumeration in Query Optimization. In VLDB (VLDB ’90) . 314–325. http: //dl.acm.org/citation.cfm?id=645916.671976

  56. [69]

    Sathiya Keerthi

    Jennifer Ortiz, Magdalena Balazinska, Johannes Gehrke, and S. Sathiya Keerthi

  57. [70]

    Yongjoo Park, Shucheng Zhong, and Barzan Mozafari. 2018. QuickSel: Quick Selectivity Learning with Mixture Models. arXiv:1812.10568 [cs] (Dec. 2018). http://arxiv.org/abs/1812.10568

  58. [71]

    Matthew Perron, Zeyuan Shang, Tim Kraska, and Michael Stonebraker. 2019. How I Learned to Stop Worrying and Love Re-optimization. 2019 IEEE 35th International Conference on Data Engineering (ICDE) (April 2019), 1758–1761. https://doi.org/10.1109/ICDE.2019.00191 Conference Name...

  59. [72]

    In 2nd Workshop on Data Managmeent for End-to-End Machine Learning (DEEM ’18)

    Learning State Representations for Query Optimization with Deep Re- inforcement Learning. In 2nd Workshop on Data Managmeent for End-to-End Machine Learning (DEEM ’18) . https://arxiv.org/abs/1803.08604

  60. [73]

    Silvan Reiner and Michael Grossniklaus. 2024. Sample-Efficient Cardinality Estimation Using Geometric Deep Learning. Proc. VLDB Endow. 17, 4 (March 2024), 740–752. https://doi.org/10.14778/3636218.3636229

  61. [74]

    Tobias Schmidt, Andreas Kipf, Dominik Horn, Gaurav Saxena, and Tim Kraska

  62. [75]

    PostgreSQL Developers. 2024. PostgreSQL hints, https://www.postgresql.org/docs/current/runtime-config-query.html. https://www.postgresql.org/docs/current/runtime-config-query.html tex.key= 1

  63. [76]

    Ohad Shamir, Sivan Sabato, and Naftali Tishby. 2010. Learning and general- ization with the information bottleneck. Theoretical Computer Science 411, 29 (June 2010), 2696–2711. https://doi.org/10.1016/j.tcs.2010.04.006 Tao et al

  64. [77]

    Alexander Shypula, Aman Madaan, Yimeng Zeng, Uri Alon, Jacob Gardner, Milad Hashemi, Graham Neubig, Parthasarathy Ranganathan, Osbert Bastani, and Amir Yazdanbakhsh. 2024. Learning Performance-Improving Code Edits. In The Twelfth International Conference on Learning Representa...

  65. [78]

    Ji Sun and Guoliang Li. 2019. An end-to-end learning-based cost estimator. Proceedings of the VLDB Endowment 13, 3 (Nov. 2019), 307–319. https://doi.org/ 10.14778/3368289.3368296

  66. [79]

    Adams, and Nando de Freitas

    Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando de Freitas. 2016. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proc. IEEE 104, 1 (Jan. 2016), 148–175. https://doi.org/10.1109/ JPROC.2015.2494218

  67. [80]

    Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks. arXiv:1503.00075 [cs] (Feb. 2015). http://arxiv.org/abs/1503.00075

  68. [81]

    Thompson

    William R. Thompson. 1933. On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples. Biometrika (1933)

  69. [82]

    Michalis K. Titsias. 2009. Variational Learning of Inducing Variables in Sparse Gaussian Processes. In Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics, AISTATS 2009, Clearwater Beach, Florida, USA, April 16-18, 2009 (JMLR Proceedin...

  70. [83]

    Sutton and Andrew G

    Richard S. Sutton and Andrew G. Barto. 1998. Introduction to Reinforcement Learning (1st ed.). MIT Press, Cambridge, MA, USA

  71. [84]

    Immanuel Trummer, Samuel Moseley, Deepak Maram, Saehan Jo, and Joseph Antonakakis. 2018. SkinnerDB: Regret-bounded Query Evaluation via Rein- forcement Learning. PVLDB 11, 12 (2018), 2074–2077. https://doi.org/10.14778/ 3229863.3236263

  72. [85]

    Robin Van De Water, Francesco Ventura, Zoi Kaoudi, Jorge-Arnulfo Quiané- Ruiz, and Volker Markl. 2022. Farming Your ML-based Query Optimizer’s Food. In 2022 IEEE 38th International Conference on Data Engineering (ICDE) (ICDE ’22). 3186–3189. https://doi.org/10.1109/ICDE53745.2...

  73. [86]

    Alexander van Renen, Dominik Horn, Pascal Pfeil, Kapil Eknath Vaidya, Wenjian Dong, Murali Narayanaswamy, Zhengchun Liu, Gaurav Saxena, Andreas Kipf, and Tim Kraska. 2024. Why TPC is not enough: An anal- ysis of the Amazon Redshift fleet. Proceedings of the VLDB Endowment (202...

  74. [87]

    Daxberger, and José Miguel Hernández-Lobato

    Austin Tripp, Erik A. Daxberger, and José Miguel Hernández-Lobato. 2020. Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retraining. In Advances in Neural Information Processing Systems 33

  75. [88]

    Michael Waas and Arjan Pellenkoft

    F. Michael Waas and Arjan Pellenkoft. 2000. Join Order Selection - Good Enough Is Easy. InBritish National Conference on Databases. https://api.semanticscholar. org/CorpusID:15111246

  76. [89]

    David Weininger. 1988. SMILES, a chemical language and information system

  77. [90]

    Lianggui Weng, Rong Zhu, Di Wu, Bolin Ding, Bolong Zheng, and Jingren Zhou

  78. [91]

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems (NeurIPS ’17, Vol. 30). Curran Associates, Inc. https://papers.nip...

  79. [92]

    Peizhi Wu and Zachary G. Ives. 2024. Modeling Shifting Workloads for Learned Database Systems. Proceedings of the ACM on Management of Data 2, 1 (March 2024), 1–27. https://doi.org/10.1145/3639293

  80. [93]

    Ziniu Wu, Ryan Marcus, Zhengchun Liu, Parimarjan Negi, Vikram Nathan, Pas- cal Pfeil, Gaurav Saxena, Mohammad Rahman, Balakrishnan Narayanaswamy, and Tim Kraska. 2024. Stage: Query Execution Time Prediction in Amazon Redshift. In Proceedings of the 2024 International Conferenc...

  81. [94]

    Journal of Chemical In- formation and Computer Sciences 28, 1 (1988), 31–36

    Introduction to methodology and encoding rules. Journal of Chemical In- formation and Computer Sciences 28, 1 (1988), 31–36. https://doi.org/10.1021/ ci00057a005 arXiv:https://doi.org/10.1021/ci00057a005

  82. [95]

    Zongheng Yang, Wei-Lin Chiang, Sifei Luan, Gautam Mittal, Michael Luo, and Ion Stoica. 2022. Balsa: Learning a Query Optimizer Without Expert Demonstra- tions. In Proceedings of the 2022 International Conference on Management of Data . ACM, Philadelphia PA USA, 931–944. https:...

  83. [97]

    Lucas Woltmann, Jerome Thiessat, Claudio Hartmann, Dirk Habich, and Wolf- gang Lehner. 2023. FASTgres: Making Learned Query Optimizer Hinting Ef- fective. Proceedings of the VLDB Endowment 16, 11 (Aug. 2023), 3310–3322. https://doi.org/10.14778/3611479.3611528

  84. [98]

    Xiang Yu, Chengliang Chai, Guoliang Li, and Jiabin Liu. 2022. Cost-Based or Learning-Based? A Hybrid Query Optimizer for Query Plan Selection. Proceedings of the VLDB Endowment 15, 13 (Sept. 2022), 3924–3936. https: //doi.org/10.14778/3565838.3565846

  85. [99]

    Xiang Yu, Guoliang Li, Chengliang Chai, and Nan Tang. 2020. Reinforce- ment Learning with Tree-LSTM for Join Order Selection. In 2020 IEEE 36th International Conference on Data Engineering (ICDE ’20) . 1297–1308. https: //doi.org/10.1109/ICDE48307.2020.00116 ISSN: 2375-026X

  86. [100]

    Ziniu Wu, Ryan Marcus, Zhengchun Liu, Parimarjan Negi, Vikram Nathan, Pas- cal Pfeil, Gaurav Saxena, Mohammad Rahman, Balakrishnan Narayanaswamy, and Tim Kraska. 2024. Stage: Query Execution Time Prediction in Amazon Redshift. In Companion of the 2024 International Conference ...

  87. [101]

    Xinyi Zhang, Zhuo Chang, Yang Li, Hong Wu, Jian Tan, Feifei Li, and Bin Cui. 2022. Facilitating database tuning with hyper-parameter optimization: a comprehensive experimental evaluation. Proc. VLDB Endow. 15, 9 (may 2022), 1808–1821. https://doi.org/10.14778/3538598.3538604

  88. [102]

    Zongheng Yang, Amog Kamsetty, Sifei Luan, Eric Liang, Yan Duan, Xi Chen, and Ion Stoica. 2020. NeuroCard: One Cardinality Estimator for All Tables. arXiv:2006.08109 [cs] (June 2020). http://arxiv.org/abs/2006.08109 arXiv: 2006.08109

  89. [103]

    Ives, and Ryan Marcus

    Zixuan Yi, Yao Tian, Zachary G. Ives, and Ryan Marcus. 2024. Low Rank Approximation for Learned Query Optimization. In International Workshop on Exploiting Artificial Intelligence Techniques for Data Management (aiDM @ SIGMOD ’24). ACM, Santiago, Chile. https://doi.org/10.1145...

  90. [104]

    Rong Zhu, Wei Chen, Bolin Ding, Xingguang Chen, Andreas Pfadler, Ziniu Wu, and Jingren Zhou. 2023. Lero: A Learning-to-Rank Query Optimizer.Proc. VLDB Endow. 16, 6 (feb 2023), 1466–1479. https://doi.org/10.14778/3583140.3583160

  91. [105]

    Rong Zhu, Lianggui Weng, Wenqing Wei, Di Wu, Jiazhen Peng, Yifan Wang, Bolin Ding, Defu Lian, Bolong Zheng, and Jingren Zhou. 2024. PilotScope: Steering Databases with Machine Learning Drivers. PVLDB 17, 5 (2024), 980–

  92. [106]

    Wangda Zhang, Matteo Interlandi, Paul Mineiro, Shi Qiao, Nasim Ghazanfari, Karlen Lie, Marc Friedman, Rafah Hosn, Hiren Patel, and Alekh Jindal. 2022. Deploying a Steered Query Optimizer in Production at Microsoft. InProceedings of the 2022 International Conference on Manageme...

  93. [108]

    Yue Zhao, Gao Cong, Jiachen Shi, and Chunyan Miao. 2022. QueryFormer: a tree transformer model for query plan representation. Proceedings of the VLDB Endowment 15, 8 (April 2022), 1658–1670. https://doi.org/10.14778/3529337. 3529349

  94. [109]

    Xuanhe Zhou, Guoliang Li, Chengliang Chai, and Jianhua Feng. 2021. A learned query rewrite system using Monte Carlo tree search. Proceedings of the VLDB Endowment 15, 1 (Sept. 2021), 46–58. https://doi.org/10.14778/3485450.3485456

  95. [113]

    Sergey Zinchenko and Sergey Iazov. 2024. HERO: Hint-Based Efficient and Reliable Query Optimizer. https://doi.org/10.48550/arXiv.2412.02372 arXiv:2412.02372 [cs]

  96. [993]

    https://doi.org/10.14778/3641204.3641209

  97. [2018]

    Bayesian optimization and attribute adjustment. In Proc. 34th Conference on Uncertainty in Artificial Intelligence

  98. [5507]

    http://papers.nips.cc/paper/8788-scalable-global-optimization-via-local- bayesian-optimization.pdf

Pith tools

Reviewed August 8, 2026 · model on record in the stance chip above.