Details
-
Bug
-
Status: Closed (View Workflow)
-
Low
-
Resolution: Fixed
-
None
-
None
-
Centos7 (lxplus)
dev3
-
ANY
-
Description
Hello,
I am trying to use the Dask installation on the LCG releases, in particular I'm using dev3 (but I also tried with LCG 100 with the same result, please see below).
If I try to create a dask scheduler process with dask-scheduler on lxplus, I get:
[etejedor@lxplus783 ~]$ source /cvmfs/sft.cern.ch/lcg/views/dev3/latest/x86_64-centos7-gcc8-opt/setup.sh
|
[etejedor@lxplus783 ~]$ dask-scheduler
|
Traceback (most recent call last):
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 583, in _build_master
|
ws.require(__requires__)
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 900, in require
|
needed = self.resolve(parse_requirements(requirements))
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 791, in resolve
|
raise VersionConflict(dist, req).with_context(dependent_req)
|
pkg_resources.ContextualVersionConflict: (dask 0+unknown (/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages), Requirement.parse('dask>=0.18.0'), {'distributed'})
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
Traceback (most recent call last):
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/bin/dask-scheduler", line 6, in <module>
|
from pkg_resources import load_entry_point
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 3252, in <module>
|
def _initialize_master_working_set():
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 3235, in _call_aside
|
f(*args, **kwargs)
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 3264, in _initialize_master_working_set
|
working_set = WorkingSet._build_master()
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 585, in _build_master
|
return cls._build_from_requirements(__requires__)
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 598, in _build_from_requirements
|
dists = ws.resolve(reqs, Environment())
|
File "/cvmfs/sft-nightlies.cern.ch/lcg/views/dev3/Tue/x86_64-centos7-gcc8-opt/lib/python3.8/site-packages/pkg_resources/__init__.py", line 786, in resolve
|
raise DistributionNotFound(req, requirers)
|
pkg_resources.DistributionNotFound: The 'dask>=0.18.0' distribution was not found and is required by distributed
|
I believe the problem is in the dask package version, which shows as 0+unknown (see version conflict error above).
If I check the dask version on the Python prompt, I indeed get:
[etejedor@lxplus783 ~]$ python3
|
imPython 3.8.6 (default, Dec 11 2020, 21:39:59)
|
[GCC 8.3.0] on linux
|
Type "help", "copyright", "credits" or "license" for more information.
|
>>> import dask
|
>>> dask.__version__
|
'0+unknown'
|
