Uploaded image for project: 'SPI'
  1. SPI
  2. SPI-1086

xgboost python module not available in lcg views

    XMLWordPrintable

Details

    Description

      as discussed in https://indico.cern.ch/event/565647/ (2016-09-29) it would be really nice to have xgboost available for the preparation of 2017 data taking ... or in general. the current situation on lxplus is still "computer says no"

      pseyfert@robusta ~ > ssh lxplus7                                                                                                                                                                       13:20:32
      Password: 
      Last login: Mon Jun  4 16:45:12 2018 from 2001:1458:204:1::102:cf6e
      * ********************************************************************
      * Welcome to lxplus092.cern.ch, CentOS, 7.5.1804
      * Archive of news is available in /etc/motd-archive
      * Reminder: you have agreed to the CERN
      *   computing rules, in particular OC5. CERN implements
      *   the measures necessary to ensure compliance.
      *   https://cern.ch/ComputingRules
      * Puppet environment: qa, Roger state: production
      * Foreman hostgroup: lxplus/nodes/login
      * Availability zone: cern-geneva-a
      * LXPLUS Public Login Service - https://cern.ch/lxplusdoc
      * ********************************************************************
      hepix: W: Your home directory is 98% full.  This may
      hepix: W: cause problems, especially when logging in.
      hepix: W: Please remove unwanted files, or go to
      hepix: W: http://cern.ch/account to increase your quota.
      ********************************************************************************
      *                         ---- LHCb Login v9r2p4 ----                          *
      *   Building with gcc62 on centos7 x86_64 system (x86_64-centos7-gcc62-opt)    *
      ********************************************************************************
       --- User_release_area is set to /afs/cern.ch/user/p/pseyfert/cmtuser
       --- LHCBPROJECTPATH is set to:
          /cvmfs/lhcb.cern.ch/lib/lhcb
          /cvmfs/lhcb.cern.ch/lib/lcg/releases
          /cvmfs/lhcb.cern.ch/lib/lcg/app/releases
          /cvmfs/lhcb.cern.ch/lib/lcg/external
      --------------------------------------------------------------------------------
      not importing aliases
      [ins] pseyfert@lxplus092 ~ > unalias 'grep'                                                                                                                                                              13:20:35
      [ins] pseyfert@lxplus092 ~ > source /cvmfs/sft.cern.ch/lcg/views/dev3/Fri/x86_64-centos7-gcc7-opt/setup.sh                                                                                               13:20:43
      [ins] pseyfert@lxplus092 ~ > python -c 'import xgboost'                                                                                                                                                  13:21:19
      Traceback (most recent call last):
        File "<string>", line 1, in <module>
      ImportError: No module named xgboost
      [ins] 1 pseyfert@lxplus092 ~ >                                                                                                                                                                           13:21:28
      

      see also jira tickets
      SPI-1024
      LBCORE-1276

      also also, following pere's instructions here https://indico.cern.ch/event/571102/ doesn't help:

      hepix: W: Your home directory is 98% full.  This may
      hepix: W: cause problems, especially when logging in.
      hepix: W: Please remove unwanted files, or go to
      hepix: W: http://cern.ch/account to increase your quota.
      ********************************************************************************
      *                         ---- LHCb Login v9r2p4 ----                          *
      *      Building with gcc62 on slc6 x86_64 system (x86_64-slc6-gcc62-opt)       *
      ********************************************************************************
       --- User_release_area is set to /afs/cern.ch/user/p/pseyfert/cmtuser
       --- LHCBPROJECTPATH is set to:
          /cvmfs/lhcb.cern.ch/lib/lhcb
          /cvmfs/lhcb.cern.ch/lib/lcg/releases
          /cvmfs/lhcb.cern.ch/lib/lcg/app/releases
          /cvmfs/lhcb.cern.ch/lib/lcg/external
      --------------------------------------------------------------------------------
      not importing aliases
      [ins] pseyfert@lxplus022 ~ > unalias 'grep'                                                                                                                                                              13:53:35
      [ins] pseyfert@lxplus022 ~ > source /cvmfs/sft.cern.ch/lcg/views/LCG_93/x86_64-slc6-gcc7-opt/setup.sh                                                                                                    13:53:37
      python -c 'import xgboost'
      pip install --user xgboost%                                                                                                                                                                                       [ins] pseyfert@lxplus022 ~ > python -c 'import xgboost'                                                                                                                                                  13:53:50
       
      Traceback (most recent call last):
        File "<string>", line 1, in <module>
      ImportError: No module named xgboost
      [ins] 1 pseyfert@lxplus022 ~ > pip install --user xgboost                                                                                                                                                13:53:51
      python -c 'import xgboost'
      Collecting xgboost
      Requirement already satisfied: scipy in /cvmfs/sft.cern.ch/lcg/views/LCG_93/x86_64-slc6-gcc7-opt/lib/python2.7/site-packages (from xgboost)
      Requirement already satisfied: numpy in /cvmfs/sft.cern.ch/lcg/views/LCG_93/x86_64-slc6-gcc7-opt/lib/python2.7/site-packages (from xgboost)
      Installing collected packages: xgboost
      Successfully installed xgboost-0.72
      You are using pip version 9.0.1, however version 10.0.1 is available.
      You should consider upgrading via the 'pip install --upgrade pip' command.
      [ins] pseyfert@lxplus022 ~ > python -c 'import xgboost'                                                                                                                                                  13:54:11
      Traceback (most recent call last):
        File "<string>", line 1, in <module>
        File "/afs/cern.ch/user/p/pseyfert/.local/lib/python2.7/site-packages/xgboost/__init__.py", line 11, in <module>
          from .core import DMatrix, Booster
        File "/afs/cern.ch/user/p/pseyfert/.local/lib/python2.7/site-packages/xgboost/core.py", line 115, in <module>
          _LIB = _load_lib()
        File "/afs/cern.ch/user/p/pseyfert/.local/lib/python2.7/site-packages/xgboost/core.py", line 109, in _load_lib
          lib = ctypes.cdll.LoadLibrary(lib_path[0])
        File "/cvmfs/sft.cern.ch/lcg/releases/Python/2.7.13-b163d/x86_64-slc6-gcc7-opt/lib/python2.7/ctypes/__init__.py", line 440, in LoadLibrary
          return self._dlltype(name)
        File "/cvmfs/sft.cern.ch/lcg/releases/Python/2.7.13-b163d/x86_64-slc6-gcc7-opt/lib/python2.7/ctypes/__init__.py", line 362, in __init__
          self._handle = _dlopen(self._name, mode)
      OSError: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /afs/cern.ch/user/p/pseyfert/.local/lib/python2.7/site-packages/xgboost/./lib/libxgboost.so)
      [ins] 1 pseyfert@lxplus022 ~ >                                                                                                                                                                           13:54:30
      

      (yes, a bit cluttered because I was typing commands before the previous ones finished ... but shrugg)

      Attachments

        Activity

          People

            rpachole Rafal Pacholek (Inactive)
            pseyfert Paul Seyfert (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:
              Actual End: