Your IP : 216.73.216.220
a
o��d� � @ s. d dl Z d dlZdd� Zedkr*ee� � dS )� Nc sH dt jv rt jd S dd� � d} dg}dt� v rf|t j�t j�t j�t��| �t j�t j�t��g7 }d}dd lm } zHt j�|d
�j
�}|� t j�|| �� |� |� |� t j�|d �� W n t y� d }Y n0 d
d� |D �}zt
� fdd�|D ��W S t�yB td�|�tjd� |�r4tdtjd� t�d� Y n0 dS )zFind the SPARK_HOME.Z
SPARK_HOMEc S sB t j�t j�| d��o@t j�t j�| d��p@t j�t j�| d��S )zSTakes a path and returns true if the provided path could be a reasonable SPARK_HOMEzbin/spark-submitZjarsZassembly)�os�path�isfile�join�isdir)r � r �Q/home/deltalab/.local/lib/python3.9/site-packages/../../../bin/find_spark_home.py�
is_spark_home! s �z'_find_spark_home.<locals>.is_spark_homezspark-distributionz../�__file__Fr )� find_specZpysparkz../../Tc S s g | ]}t j�|��qS r )r r �abspath)�.0�pr r r �
<listcomp>F � z$_find_spark_home.<locals>.<listcomp>c 3 s | ]}� |�r|V qd S )Nr )r
r �r r r � <genexpr>I r z#_find_spark_home.<locals>.<genexpr>z3Could not find valid SPARK_HOME while searching {0})�filea�
Did you install PySpark via a package manager such as pip or Conda? If so,
PySpark was not found in your Python environment. It is possible your
Python environment does not properly bind with your package manager.
Please check your default 'python' and if you set PYSPARK_PYTHON and/or
PYSPARK_DRIVER_PYTHON environment variables, and see if you can import
PySpark, for example, 'python -c 'import pyspark'.
If you cannot import, you can install by using the Python executable directly,
for example, 'python -m pip install pyspark [--user]'. Otherwise, you can also
explicitly set the Python executable, that has PySpark installed, to
PYSPARK_PYTHON or PYSPARK_DRIVER_PYTHON environment variables, for example,
'PYSPARK_PYTHON=python3 pyspark'.
���N)r �environ�globalsr r �dirname�realpathr
Zimportlib.utilr �origin�append� ImportError�next�
StopIteration�print�format�sys�stderr�exit)Zspark_dist_dir�pathsZimport_error_raisedr Z module_homer r r �_find_spark_home s>
�
�
�r$ �__main__)r r r$ �__name__r r r r r �<module> s C