;iTSSKJrJr SSKrSSKrSSKJr SSKrSSKJ r J r SSK J r SSK Jr Sr1Skr\ (aS OS r\R$"\5rS \S \\4S jrS\S\S \4SjrS \\\44SjrS \\4SjrS\ S S4SjrS\ S S4SjrS\ S S4SjrSSjrSSjr SSjr!g))IterableIteratorN)Path)HIP_ENVIRONMENTget_cuda_bnb_library_path) CUDASpecs)print_dedented) CONDA_PREFIXLD_LIBRARY_PATH>_PWDHOMEMAILPATHTMUXSHELLOLDPWDSSH_TTYLESSOPEN LESSCLOSE SSH_AUTH_SOCK XDG_DATA_DIRSXDG_RUNTIME_DIRXDG_GREETER_DATA_DIRDBUS_SESSION_BUS_ADDRESSGOOGLE_VM_CONFIG_LOCK_FILE)zlibamdhip64.so*)z cudart64*.dllzlibcudart*.so*z nvcuda*.dllpaths_list_candidatereturnc# # UR[R5HnU(dM [RU;aM"[ U5nUR 5(d[ RSU35 M^[HMnURU5H5nUR5(dMUR5(aM1Uv M7 MO M g![a Nhf=f![[4a Mf=f7f)Nz?The directory listed in your path is found to be non-existent: )splitospathsepseprexistsloggerwarningOSErrorCUDA_RUNTIME_LIB_PATTERNSglobis_file is_symlinkPermissionError)r dir_stringdir lib_patternpths m/home/dmtnaga/Documents/work/airagagent/rag_env/lib/python3.13/site-packages/bitsandbytes/diagnostics/cuda.py find_cuda_libraries_in_path_listr2/s*00<   66 #  z"C zz||NN%dehdi#jk$ 9 88K0C{{}}S^^-=-=! 1 9=   )   s`AD C--C>D1C-5C- C-D C*'C-)C**C--D=DDDenv_varvaluecU[;=(dG [RU;=(a- U[;=(a SU;=(a SU;=(a SU;$)NCONDA BASH_FUNC )CUDART_PATH_PREFERRED_ENVVARSr!r#CUDART_PATH_IGNORED_ENVVARSr3r4s r1is_relevant_candidate_env_varr<EsY00 FFeO ":: "w& "7* "E! c[RR5VVs0sHup[X5(dMX_M snn$s snnfN)r!environitemsr<r;s r1,get_potentially_lib_path_containing_env_varsrBRs8131A1A1C u1C~wGdelGtNGN1C uu us AAc## [5n[H2nX;dM Xn[U5ShvN URU5 M4 UR 5Hup4[U5ShvN M gNFN 7f)af Searches for a cuda installations, in the following order of priority: 1. active conda env 2. LD_LIBRARY_PATH 3. any other env vars, while ignoring those that - are known to be unrelated - don't contain the path separator `/` If multiple libraries are found in part 3, we optimistically try one, while giving a warning message. N)rBr9r2poprA)candidate_env_varsenvvar directoryr3r4s r1find_cudart_librariesrHVsuFG/  '*2I7 B B B  " "6 * 0 -2243E:::5 C ;s&A:A:A6` environmental variable. For example, if you want to use the CUDA version 122, BNB_CUDA_VERSION=122 python ... OR set the environmental variable in your .bashrc: export BNB_CUDA_VERSION=122 In the case of a manual override, make sure you set LD_LIBRARY_PATH, e.g. export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-11.2, z* Found CUDA runtime at: )listrHrLlenr torchversioncuda cudart_pathsr0s r1_print_cuda_runtime_diagnosticsrcsw-/0L  \] \ Q BCH--BTBTAU V   $ C -cU3 4 ' r=c[[55nU(d [S5 g[U5S:a?[ S[ R RS35 UHn[SU35 M gg)Nz@WARNING! ROCm runtime files not found in any environmental path.rTz Found duplicate ROCm runtime files (see below). We select the PyTorch default ROCm runtime, which is aN, but this might mismatch with the ROCm version that is needed for bitsandbytes. To resolve it, install PyTorch built for the ROCm version you want to use and set LD_LIBRARY_PATH to your ROCm install path, e.g. export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/rocm-6.1.2/lib, z* Found ROCm runtime at: )r\rHrLr]r r^r_hipras r1_print_hip_runtime_diagnosticsrfsw-/0L  PQ \ Q BCH--BSBSATU    C -cU3 4  r=cD[(a [5 g[5 gr?)rrfrcr=r1print_runtime_diagnosticsris&(')r=)rN)"collections.abcrrloggingr!pathlibrr^bitsandbytes.cextensionrrbitsandbytes.cuda_specsrbitsandbytes.diagnostics.utilsr r9r:r( getLogger__name__r%strr2boolr<dictrBrHrQrXrZrcrfrirhr=r1rus.  N-9 C,    8 $38D>, 3 s t vd38nv;x~;0  d 2 y T .,),,565.*r=