KidZddlmZmZmZddlZddlmZddl m Z ddl m Z m Z mZmZmZmZmZddlmZGdd eZdS) zEmbeddings integration utilities for MySQL Connector/Python. Provides MyEmbeddings class to generate embeddings via MySQL HeatWave using ML_EMBED_TABLE and ML_EMBED_ROW. )DictListOptionalN) Embeddings) PrivateAttr)atomic_transaction execute_sqlformat_value_sql source_schemasql_table_from_dfsql_table_to_dftemporary_sql_tables)MySQLConnectionAbstractceZdZUdZeZeed< d dedee ffd Z de e de e e fd Zd e de e fd ZxZS) MyEmbeddingsa Embedding generator class that uses a MySQL database to compute embeddings for input text. This class batches input text into temporary SQL tables, invokes MySQL's ML_EMBED_TABLE to generate embeddings, and retrieves the results as lists of floats. Attributes: _db_connection (MySQLConnectionAbstract): MySQL connection used for all database operations. schema_name (str): Name of the database schema to use. options_placeholder (str): SQL-ready placeholder string for ML_EMBED_TABLE options. options_params (dict): Dictionary of concrete option values to be passed as SQL parameters. _db_connectionN db_connectionoptionsct||_t||_|pi}t |\|_|_dS)a Initialize MyEmbeddings with a database connection and optional embedding parameters. References: https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-embed-row.html A full list of supported options can be found under "options" NOTE: The supported "options" are the intersection of the options provided in https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-embed-row.html https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-embed-table.html Args: db_connection: Active MySQL connector database connection. options: Optional dictionary of options for embedding operations. Raises: ValueError: If the schema name is not valid DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. N)super__init__rr schema_namer options_placeholderoptions_params)selfrr __class__s T/var/www/html/analyses/venv/lib/python3.11/site-packages/mysql/ai/genai/embedding.pyrzMyEmbeddings.__init__FsZ0 +(77-R8H8Q8Q5 $"5"5"5textsreturnc $|sgStjtt||d}t |j5}t |j5}t||j|\}}| |j|fd|d|d|j d}t|||j t||j|}|dstd|dDrt!d |d} d | D} | cd d d cd d d S#1swxYwYd d d d S#1swxYwYd S) a Generate embeddings for a list of input texts using the MySQL ML embedding procedure. References: https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-embed-table.html Args: texts: List of input strings to embed. Returns: List of lists of floats, with each inner list containing the embedding for a text. Raises: DatabaseError: If provided options are invalid or unsupported. If a database connection issue occurs. If an operational error occurs during execution. ValueError: If one or more text entries were unable to be embedded. Implementation notes: - Creates a temporary table to pass input text to the MySQL embedding service. - Adds a primary key to ensure results preserve input order. - Calls ML_EMBED_TABLE and fetches the resulting embeddings. - Deletes the temporary table after use to avoid polluting the database. - Embedding vectors are extracted from the "embeddings" column of the result table. )idtextzCALL sys.ML_EMBED_TABLE('z .text', 'z.embeddings', )params embeddingsc3K|]}|duV dSN.0es r z/MyEmbeddings.embed_documents..s?AAT AAAAAArz:Failure to generate embeddings for one or more text entry.c,g|]}t|Sr*)listr+s r z0MyEmbeddings.embed_documents..s666a$q''666rN)pd DataFramerangelenrrrr rappendrr rr isnullany ValueErrortolist) rrdfcursortemporary_tablesqualified_table_name table_name embed_query df_embeddingsr's rembed_documentszMyEmbeddings.embed_documentsds8 I \s5zz!2!2EBB C C t2 3 3! 7= !4 5 5! 9I/@("00 , *  # #T%5z$B C C C((+   D4G H H H H,FD4DjQQM\*11337799 SAA#0#>AAA>> !P '|4;;==J66:666JC! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! s7 FC5E- F-E1 1F4E1 5FF  F r#ct|j5}t|d|jd|g|jRt |dcdddS#1swxYwYdS)a Generate an embedding for a single text string. References: https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-embed-row.html Args: text: The input string to embed. Returns: List of floats representing the embedding vector. Raises: DatabaseError: If provided options are invalid or unsupported. If a database connection issue occurs. If an operational error occurs during execution. Example: >>> MyEmbeddings(db_conn).embed_query("Hello world") [0.1, 0.2, ...] zSELECT sys.ML_EMBED_ROW("%s", r$r%rN)rrr rrr0fetchone)rr#r<s rr@zMyEmbeddings.embed_querys.  3 4 4 . L1ILLL3t233     ))!,--  . . . . . . . . . . . . . . . . . .sA A--A14A1r))__name__ __module__ __qualname____doc__rrr__annotations__rrrrstrfloatrBr@ __classcell__)rs@rrr6s  /:kmmN+;;;QURR4R?G~RRRRRRrSs : ('''''''''000000 >=====O.O.O.O.O.:O.O.O.O.O.r