Uploaded image for project: 'CORAL and COOL'
  1. CORAL and COOL
  2. CORALCOOL-1902

'No module named subprocess' in QMTEST for osx in COOL_HEAD

    Details

    • Type: Bug
    • Status: Closed
    • Priority: High
    • Resolution: Fixed
    • Affects Version/s: COOL_HEAD
    • Fix Version/s: None
    • Component/s: Infrastructure
    • Labels:
      None

      Description

      The COOL220 config for osx seems ok. The following produces real results:

      ssh macphsft01
      klog
      tcsh
      cd /afs/cern.ch/sw/lcg/app/releases/COOL/COOL_2_2_0/src/config/cmt
      setenv CMTCONFIG osx104_ppc_gcc401_dbg
      source CMT_env.csh
      source setup.csh
      cd ../qmtest
      qmtest run -o /tmp/COOL220-$CMTCONFIG.qmr cool

      However, I do not manage to produce decent results from the HEAD:

      ssh macphsft01
      klog
      tcsh
      cd /afs/cern.ch/user/a/avalassi/myLCG/COOL_HEAD/src/config/cmt/
      setenv CMTCONFIG osx104_ppc_gcc401_dbg
      source CMT_env.csh
      source setup.csh
      cd ../qmtest
      qmtest run -o /tmp/COOLHEAD-$CMTCONFIG.qmr coolkernel

      This fails:

      coolkernel.folderspec : UNTESTED
      Could not load test.

      qmtest.exception:

      xml_database.TestFileError: A problem occurred while loading the XML test file "coolkernel.folderspec":
      Exception 'exceptions.ImportError' : 'No module named subprocess'

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/test/base.py", line 223, in get_extension_class_from_directory
      path + sys.path)

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/common.py", line 366, in load_class
      module = load_module(module_name, search_path, load_path)

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/common.py", line 312, in load_module
      module = imp.load_module(name, file, file_name, description)

      File "/afs/cern.ch/user/a/avalassi/myLCG/COOL_HEAD/src/../src/config/qmtest/COOLTests.py", line 40, in ?
      from subprocess import Popen, PIPE, STDOUT

      The "COOLTests.StandardTest" extension class could not be loaded..

      qmtest.traceback:

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/test/execution_engine.py", line 796, in __GetTestDescriptor
      return self.__database.GetTest(test_id)

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/test/file_database.py", line 58, in GetTest
      return self._GetTestFromPath(test_id, os.path.normpath(path))

      File "/afs/.cern.ch/sw/lcg/external/QMtest/2.3.0_python242/osx104_ppc_gcc401/lib/python2.3/site-packages/qm/test/classes/xml_database.py", line 69, in _GetTestFromPath
      raise TestFileError, message

      What is wrong here?

        Activity

        Hide
        clemenci Marco Clemencic added a comment -

        Hi Andrea,

        just thought about it: what about an option (an environment variable) to disable the time-out?
        I can also implement platform-specific time-outs, but I would be much more complicated.

        Cheers
        Marco

        Show
        clemenci Marco Clemencic added a comment - Hi Andrea, just thought about it: what about an option (an environment variable) to disable the time-out? I can also implement platform-specific time-outs, but I would be much more complicated. Cheers Marco
        Hide
        valassi Andrea Valassi added a comment -

        Ciao Marco, whatever you think most appropriate for the nightlies, keeping into account PPC is slow... I would imagine that if you can easily implement an env variable to disable the timeout (only on some platforms?), maybe you can also do that for increasing the timeout (eg apply a factor 3-4 to PPC versus linux)?
        Andrea

        Show
        valassi Andrea Valassi added a comment - Ciao Marco, whatever you think most appropriate for the nightlies, keeping into account PPC is slow... I would imagine that if you can easily implement an env variable to disable the timeout (only on some platforms?), maybe you can also do that for increasing the timeout (eg apply a factor 3-4 to PPC versus linux)? Andrea
        Hide
        valassi Andrea Valassi added a comment -

        Ah maybe I see what you mean: actually you can provide an env variable to disable the timeout ONLY for the manual tests, while the timeout would ONLY stay for the nightlies. This sounds ok to me too!

        But in any case you need a larger timeout for osx ppc in the nightlies...

        Andrea

        Show
        valassi Andrea Valassi added a comment - Ah maybe I see what you mean: actually you can provide an env variable to disable the timeout ONLY for the manual tests, while the timeout would ONLY stay for the nightlies. This sounds ok to me too! But in any case you need a larger timeout for osx ppc in the nightlies... Andrea
        Hide
        clemenci Marco Clemencic added a comment -

        My idea is to have a quick and simple way to disable (temporarily) all the time-outs.
        One use case is to be able to measure new sensible time-out values.

        I have a script that allows to modify the time-outs from a full qmtest report, by increasing the time-outs that needs to be increased, and not touching those already good enough.
        Unfortunately, to produce such a report I have to disable the time-out setting it to -1. The env. variable allows to ignore the value without touching the files.

        Cheers
        Marco

        Show
        clemenci Marco Clemencic added a comment - My idea is to have a quick and simple way to disable (temporarily) all the time-outs. One use case is to be able to measure new sensible time-out values. I have a script that allows to modify the time-outs from a full qmtest report, by increasing the time-outs that needs to be increased, and not touching those already good enough. Unfortunately, to produce such a report I have to disable the time-out setting it to -1. The env. variable allows to ignore the value without touching the files. Cheers Marco
        Hide
        valassi Andrea Valassi added a comment -

        Ciao Marco, thanks for committing the changes:
        http://cool.cvs.cern.ch/cgi-bin/cool.cgi/cool/config/qmtest/COOLTests.py?r1=1.39&r2=1.40
        This has come after tag COOL_2_2_1-pre2.
        Andrea

        Show
        valassi Andrea Valassi added a comment - Ciao Marco, thanks for committing the changes: http://cool.cvs.cern.ch/cgi-bin/cool.cgi/cool/config/qmtest/COOLTests.py?r1=1.39&r2=1.40 This has come after tag COOL_2_2_1-pre2. Andrea

          People

          • Assignee:
            valassi Andrea Valassi
            Reporter:
            valassi Andrea Valassi
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: