o ҷh7@sPddlmZddlmZddlZddlmZddlm Z ddl m Z ddl m Z ddlmZmZddlZdd lmZdd lmZdd lmZmZmZmZdd lmZmZmZej ej!ej"ej#ej$ej%ej%d Z&ej"ej'dfej%ej(e fej ej)dfej!ej)dfej#ej)dfej*ej(dfej$ej+dfiZ,ej)dej'dej(diZ-GdddeZ.dS)) annotations)AnyN) infer_dtype)iNaT)NoBufferPresent)cache_readonly) ArrowDtypeDatetimeTZDtype)is_string_dtype) PandasBuffer)Column ColumnBuffersColumnNullType DtypeKind) ArrowCTypes Endiannessdtype_to_arrow_c_fmt)iufbUMmzThis column is non-nullablezThis column uses NaN as nullz!This column uses a sentinel valuec@seZdZdZd/d0d d Zd1d d Zed1ddZed2ddZ d2ddZ eddZ eddZ ed1ddZ ed3ddZd1ddZd4d5d#d$Zd6d&d'Zd7d)d*Zd7d+d,Zd7d-d.Zd S)8 PandasColumna A column object, with only the methods and properties required by the interchange protocol defined. A column can contain one or more chunks. Each chunk can contain up to three buffers - a data buffer, a mask buffer (depending on null representation), and an offsets buffer (if variable-size binary; e.g., variable-length strings). Note: this Column object can only be produced by ``__dataframe__``, so doesn't need its own version or ``__column__`` protocol. Tcolumn pd.Series allow_copyboolreturnNonecCs0t|tjstdt|d||_||_dS)zu Note: doesn't deal with extension arrays yet, just assume a regular Series/ndarray for now. zColumns of type  not handled yetN) isinstancepdSeriesNotImplementedErrortype_col _allow_copy)selfrrr+Q/var/www/html/venv/lib/python3.10/site-packages/pandas/core/interchange/column.py__init__Js  zPandasColumn.__init__intcCs|jjS)z2 Size of the column, in elements. )r(sizer*r+r+r,r/VszPandasColumn.sizecCdS)z7 Offset of first element. Always zero. rr+r0r+r+r,offset\szPandasColumn.offsettuple[DtypeKind, int, str, str]cCs~|jj}t|tjr!|jjj}||j\}}}}tj ||t j fSt |r:t |jdkr6tjdt|t j fStd||S)Nstringz.Non-string object dtypes are not supported yet)r(dtyper#r$CategoricalDtypevaluescodes_dtype_from_pandasdtyper CATEGORICALrNATIVEr rSTRINGrr&)r*r6r9_bitwidthc_arrow_dtype_f_strr+r+r,r6ds.    zPandasColumn.dtypecCsjt|jd}|durtd|dt|tr|jj}n t|tr'|j j}n|j}||j dt ||fS)z/ See `self.dtype` for details. N Data type z& not supported by interchange protocolr5) _NP_KINDSgetkind ValueErrorr#r numpy_dtype byteorderr baseitemsizer)r*r6rDrGr+r+r,r:s    z$PandasColumn._dtype_from_pandasdtypecCs:|jdtjks td|jjjdtt |jjj dS)a: If the dtype is categorical, there are two options: - There are only values in the data buffer. - There is a separate non-categorical Column encoding for categorical values. Raises TypeError if the dtype is not categorical Content of returned dict: - "is_ordered" : bool, whether the ordering of dictionary indices is semantically meaningful. - "is_dictionary" : bool, whether a dictionary-style mapping of categorical values to other objects exists - "categories" : Column representing the (implicit) mapping of indices to category values (e.g. an array of cat1, cat2, ...). None if not a dictionary-style categorical. rzCdescribe_categorical only works on a column with categorical dtype!T) is_ordered is_dictionary categories) r6rr; TypeErrorr(catorderedrr$r%rLr0r+r+r,describe_categoricalsz!PandasColumn.describe_categoricalcCs@|jd}z t|\}}W||fStytd|dw)NrrAz not yet supported)r6_NULL_DESCRIPTIONKeyErrorr&)r*rDnullvaluer+r+r, describe_nulls  zPandasColumn.describe_nullcCs|jS)zB Number of null elements. Should always be known. )r(isnasumitemr0r+r+r, null_countszPandasColumn.null_countdict[str, pd.Index]cCs d|jjiS)z8 Store specific metadata of the column. z pandas.index)r(indexr0r+r+r,metadatas zPandasColumn.metadatacCr1)zE Return the number of chunks the column consists of. r+r0r+r+r, num_chunksszPandasColumn.num_chunksNn_chunks int | Noneccsv|r6|dkr6t|j}||}||dkr|d7}td|||D]}t|jj||||jVq"dS|VdS)zy Return an iterator yielding the chunks. See `DataFrame.get_chunks` for details on ``n_chunks``. r]rN)lenr(rangerilocr))r*r_r/stepstartr+r+r, get_chunkss    zPandasColumn.get_chunksr cCs\|ddd}z||d<Wn tyYnwz ||d<W|Sty-Y|Sw)a` Return a dictionary containing the underlying buffers. The returned dictionary has the following contents: - "data": a two-element tuple whose first element is a buffer containing the data and whose second element is the data buffer's associated dtype. - "validity": a two-element tuple whose first element is a buffer containing mask values indicating missing data and whose second element is the mask value buffer's associated dtype. None if the null representation is not a bit or byte mask. - "offsets": a two-element tuple whose first element is a buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and whose second element is the offsets buffer's associated dtype. None if the data buffer does not have an associated offsets buffer. N)datavalidityoffsetsrhri)_get_data_buffer_get_validity_bufferr_get_offsets_buffer)r*buffersr+r+r, get_bufferss   zPandasColumn.get_bufferstuple[PandasBuffer, Any]cCs@|jdtjtjtjtjtjfvr?|jdtjkr,t|jddkr,|jj d }n|j }t ||j d}|j}||fS|jdtjkr]|jjj}t ||j d}||j}||fS|jdtjkr|j }t}|D]}t|tr||jddqot tj|dd }tjd tjtjf}||fStd |jjd ) zZ Return the buffer containing the data and the buffer's associated dtype. rN)rutf-8encodinguint8)r6r5rAr")r6rINTUINTFLOATBOOLDATETIMErar(dt tz_convertto_numpyr r)r;r8_codesr:r= bytearrayr#strextendencodenp frombufferrrr<r&)r*np_arrbufferr6r9bufrobjr+r+r,rjsB"       zPandasColumn._get_data_bufferc Cs|j\}}|jdtjkrI|j}|dk}| }tjt|ftj d}t |D]\}}t |t r3|n|||<q(t |}tjdtjtjf} || fSz t|d} Wt| ty`tdw)z Return the buffer containing the mask values indicating missing data and the buffer's associated dtype. Raises NoBufferPresent if null representation is not a bit or byte mask. rshaper6r5z! so does not have a separate maskzSee self.describe_null)rUr6rr=r(r}rzerosrabool_ enumerater#rr ryrrr<_NO_VALIDITY_BUFFERrRr&r) r*rSinvalidrvalidmaskrrrr6msgr+r+r,rk;s"   z!PandasColumn._get_validity_bufferc Cs|jdtjkrM|j}d}tjt|dftjd}t |D]\}}t |t r5|j dd}|t|7}|||d<q t |}tjdtjtjf}||fStd)a Return the buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and the buffer's associated dtype. Raises NoBufferPresent if the data buffer does not have an associated offsets buffer. rr]rrrrs@zJThis column has a fixed-length dtype so it does not have an offsets buffer)r6rr=r(r}rrraint64rr#rrr rvrINT64rr<r) r*r8ptrrirvrrr6r+r+r,rlas&     z PandasColumn._get_offsets_buffer)T)rrrrr r!)r r.)r r3)r rZ)N)r_r`)r r )r ro)__name__ __module__ __qualname____doc__r-r/propertyr2rr6r:rPrUrYr\r^rfrnrjrkrlr+r+r+r,r>s.            % 3&r)/ __future__rtypingrnumpyrpandas._libs.librpandas._libs.tslibsr pandas.errorsrpandas.util._decoratorsrpandas.core.dtypes.dtypesrr pandasr$pandas.api.typesr pandas.core.interchange.bufferr *pandas.core.interchange.dataframe_protocolr r rrpandas.core.interchange.utilsrrrrvrwrxryr=rzrBUSE_NAN USE_SENTINEL NON_NULLABLEr; USE_BYTEMASKrQrrr+r+r+r,sD