U vId#@sddlmZddlmZddlmZmZmZddlm Z ddl m Z m Z ddl mZmZmZmZmZmZddlmZddlZdd lmZddlZddlZGd d d Zeeee ej!ej"fZ#ee#ee#e#fefZ$ej%Z&ej'Z(dd l)m*Z+zdd l,m-Z.ddl/m%Z0Wn2e1k r8GdddZ.GdddZ0YnXzddl2Z2e2j-Z3Wn$e1k rpGdddZ3YnXzddl4m5Z5Wn$e1k rGdddZ5YnXzdd l6m-Z7Wn$e1k rGdddZ7YnXeefddddddZ8e89ej:efd dddd!d"Z;d#d$Zd&d'd(d&d)d*d+Z=d&d&d,d-d.Z>d/d0d1d2Z?d3d4Z@dd5d6d7d8d9d:ZAd?d;d dd dsr#c@seZdZeddZdS) DaskArraycCsdS)Nzmock dask.array.core.ArrayrrrrrrIszDaskArray.__repr__Nrrrrrr$Hsr$rstrz Optional[Any]attrsnamedefaultcCs"|tkr||S|j||dSdS)N)r))rgetr&rrr _read_attrNsr+zh5py.AttributeManagercCsv||kr|tk r|S||}||}t|j}|dkr>|S|jdkrL|St|jdkrd|dSdd|DSdS)al Read an HDF5 attribute and perform all necessary conversions. At the moment, this only implements conversions for string attributes, other types are passed through. String conversion is needed compatibility with other languages. For example Julia's HDF5.jl writes string attributes as fixed-size strings, which are read as bytes by h5py. Nrutf-8cSsg|]}t|dqS)r,r).0srrr osz#_read_attr_hdf5..) rZget_idh5pycheck_string_dtypedtypelengthlenshaper)r'r(r)attrZattr_idr2rrr_read_attr_hdf5Vs     r7cCsg}|jjD]}t|}|d}t|t}|r6|d}tt|jtjrfdt |dd|d<n |s~t t|tj rd|d<| t|q | |S)zw Convert from fixed length strings to unicode. For backwards compatability with older h5ad and zarr files. rUNO)r2descrlist isinstancetuple issubclassnptypeZstring_intZ issubdtypeZstr_appendastype)value new_dtypedtZdt_listdt_typeZ is_annotatedrrr_from_fixed_length_stringsrs  rJFz np.ndarrayzOptional[np.dtype]bool)arrr2copyreturncCsx|r |}|dkr|j}tdddd}|jD]<\}\}}t|}|dk r6|jdkr6|||||dq6|S)a h5py 3.0 now reads all strings as bytes. There is a helper method which can convert these to strings, but there isn't anything for fields of structured dtypes. Params ------ arr An array with structured dtype dtype dtype of the array. This is checked for h5py string data types. Passing this is allowed for cases where array may have been processed by another function before hand. NcSs |dS)Nr,r)xrrrz*_decode_structured_array..r8r,)out) rMr2rAZ frompyfuncfieldsitemsr0r1encoding)rLr2rMrkrH_checkrrr_decode_structured_arrays rY)rFrNcCsng}|jjD]R\}\}}|jdkrTtdd|d|D}||d|ffq|||fq||S)z Convert variable length strings to fixed length. Currently a workaround for https://github.com/zarr-developers/zarr-python/pull/422 r;css|]}t|VqdS)N)r4encode)r-rOrrr sz+_to_fixed_length_strings..r9)r2rSrTkindmaxZgetfieldrDrE)rFrGZdt_namerIZ dt_offsetsizerrr_to_fixed_length_stringss r_z 'AnnData')adatacCst}|jD]\}}|ds$q|dd}t|ttfrD|g}|j|j fD]H}||kr^qP||j }t |t |ks|qPtj||||<||qPq|D] }|j|=qdS)z Compat function for when categorical keys were stored in uns. This used to be buggy because when storing categorical columns in obs and var with the same column name, only one `_categories` is retained. Z _categoriesN)setunsrTendswithreplacer>r%rCZobsvarvaluesrAallr4pdZ CategoricalZ from_codesadd)r`Z k_to_deleteZ cats_nameZcatsr(anncodesrrr _clean_unss"   rmcCs|didi}|di}dD]X}||kr$t||ttjfr$t||jdkr$td|d|dt | |||<q$d S) zF Read-time fix for moving adjacency matrices from uns to obsp rcZ neighborsobsp)Z distancesZconnectivitiesr:z'Moving element from .uns['neighbors']['z '] to .obsp['z4']. This is where adjacency matrices should go now.N) r* setdefaultr>rrAndarrayr4r5r FutureWarningpop)dnrnrVrrr _move_adj_mtxs rurCr?r=)rsrtkeyspathscCs^|D]P\}}t|tr0t||||f|qt|tr|j||fkr|||fq|S)z0Find paths to sparse matrices with shape (n, n).)rTr>r_find_sparse_matricesrr5rD)rsrtrvrwrVvrrrrxs  rxz1.0 (renaming of 0.25)cs fdd}|dk r||S|S)avDecorator for methods that issues warnings for positional arguments. Using the keyword-only argument syntax in pep 3102, arguments after the * will issue a warning when passed as a positional argument. Parameters ---------- func Function to check arguments on. version The version when positional arguments will result in error. csrtggjD]6\}}|jtjkr:|q|jtjkr|qtfdd}|S)Ncst|t}|dkr"||Sddtd||| dD}d|}td|ddt|tj|f|S)NrcSsg|]\}}d||qS)z{}={})format)r-r(argrrrr/szi_deprecate_positional_args.._inner_deprecate_positional_args..inner_f..z, zPass z as keyword args. From version z> passing these as positional arguments will result in an error)r4zipjoinrrqupdate parameters)argskwargs extra_argsZargs_msg)all_argsf kwonly_argssigrrrinner_fs  zU_deprecate_positional_args.._inner_deprecate_positional_args..inner_f) r rrTr\r POSITIONAL_OR_KEYWORDrD KEYWORD_ONLYr)rr(paramrr)rrrrr _inner_deprecate_positional_argss    zD_deprecate_positional_args.._inner_deprecate_positional_argsNr)funcrrrrr_deprecate_positional_argss !r)NF)N)C __future__rrMr functoolsrrrcodecsrinspectr r typingr r r rrrwarningsrr0Z scipy.sparsernumpyrAZpandasrirslicerCr%Zint64rpZIndex1DIndexrZH5GroupZDatasetZH5Array packagingr_vZ zarr.corerrZzarr.hierarchyr! ImportErrorZawkwardr"Z zappy.baser#Z dask.arrayr$r+registerZAttributeManagerr7rJrYr_rmrurxrrrrrsb