Abstract:In recent years, the surge in unstructured data analysis, facilitated by advancements in Machine Learning (ML), has prompted diverse approaches for handling images, text documents, and videos. Analysts, leveraging ML models, can extract meaningful information from unstructured data and store it in relational databases, allowing the execution of SQL queries for further analysis. Simultaneously, vector databases have emerged, embedding unstructured data for efficient top-k queries based on textual queries. This paper introduces a novel framework SSQL - Semantic SQL that utilizes these two approaches, enabling the incorporation of semantic queries within SQL statements. Our approach extends SQL queries with dedicated keywords for specifying semantic queries alongside predicates related to ML model results and metadata. Our experimental results show that using just semantic queries fails catastrophically to answer count and spatial queries in more than 60% of the cases. Our proposed method jointly optimizes the queries containing both semantic predicates and predicates on structured tables, such as those generated by ML models or other metadata. Further, to improve the query results, we incorporated human-in-the-loop feedback to determine the optimal similarity score threshold for returning results.

Schema Based Data Storage and Query Optimization for Semi-structured Data

Schema-Driven Performance Evaluation for Highly Concurrent Scenarios.

A Survey on Mapping Semi-Structured Data and Graph Data to Relational Data

Schema Extraction on Semi-structured Data

Keyword Search on Structured and Semi-Structured Data

Extracting Local Schema from Semistructured Data Based on Graph-Oriented Semantic Model

Incremental Mining of the Schema of Semistructured Data

Schema-Based Query Optimisation for Graph Databases

QUERY REWRITING FOR SEMI-STRUCTURED DATA

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Database Physical Structure Optimization Technology

A Query Optimizing Scheme in the SESQ System

Algebraic Meta-structure Handling of Huge Database Schemata

Schemaless Queries over Document Tables with Dependencies

Semantic SQL -- Combining and optimizing semantic predicates in SQL

Schema Optimization and Conflict Mechanism in Relational Database System Migration

Dynamic Query Optimization Approach for Semantic Database Grid

Layout-Conscious Optimization: Beyond Hybrid Row-Column Storage Model

A New Conceptual Graph Generated Algorithm for Semi-structured Databases

SchemaDB: Structures in Relational Datasets