US patent US12754912
Systems and methods for dynamic query optimization for distributed computing environments
Abstract
Systems and methods are provided for dynamically optimizing query execution in distributed computing environments. The method may begin by receiving and analyzing a query to determine complexity of the query, including generating an execution plan, assessing data volume, and identifying required operations. Based on this analysis, the system may estimate necessary computational resources. The system may then select an optimal execution environment by evaluating available resources and current workloads, or provision a new environment if needed. The system may then submit the query to the chosen environment, monitor the query during execution, and/or record performance statistics. This adaptive approach ensures efficient resource allocation and query processing, potentially improving performance and reducing costs in large-scale data processing systems.