Uploaded image for project: 'ROOT'
  1. ROOT
  2. ROOT-9966

Thread-safety problem in TFile from use of TSystem

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: High
    • Resolution: Unresolved
    • Affects Version/s: master
    • Fix Version/s: None
    • Component/s: I/O
    • Labels:
      None
    • Environment:

      slc7 with gcc 7.2

    • Development:

      Description

      CMSSW tests failed while running multi-threaded where the job was doing TFile::Open on multiple threads concurrently.  The relevant parts of the different thread stacks at the time of the segmentation fault are below:

       

      Thread 11 (Thread 0x7f59b7fff700 (LWP 13194)):<This thread is OK>
      #4 0x00007f59e4fce995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #5 0x00007f59e55aecec in _gthread_cond_wait (_mutex=<optimized out>, __cond=<optimized out>) at /build/cmsbld/auto-builds/CMSSW_10_1_0_pre2-slc7_amd64_gcc700/build/CMSSW_10_1_0_pre2-build/BUILD/slc7_amd64_gcc700/external/gcc/7.0.0-omkpbe2/gcc-branches_gcc-7-branch-257125/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/x86_64-unknown-linux-gnu/bits/gthr-default.h:864
      #6 std::condition_variable::wait (this=<optimized out>, __lock=...) at ../../../../../libstdc+-v3/src/c+11/condition_variable.cc:53
      #7 0x00007f59e7980656 in std::_V2::condition_variable_any::wait<std::unique_lock<std::mutex> > (this=0x7f59d3049620, __lock=...) at /build/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc700/external/gcc/7.0.0-omkpbe2/include/c++/7.3.1/condition_variable:251
      #8 0x00007f59e797fb06 in std::_V2::condition_variable_any::wait<std::unique_lock<std::mutex>, ROOT::TReentrantRWLock<std::mutex, ROOT::Internal::RecurseCounts>::ReadLock()::{lambda()#1}>(std::unique_lock<std::mutex>&, ROOT::TReentrantRWLock<std::mutex, ROOT::Internal::RecurseCounts>::ReadLock()::{lambda()#1}) (this=0x7f59d3049620, __lock=..., __p=...) at /build/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc700/external/gcc/7.0.0-omkpbe2/include/c++/7.3.1/condition_variable:260
      #9 0x00007f59e797ca87 in ROOT::TReentrantRWLock<std::mutex, ROOT::Internal::RecurseCounts>::ReadLock (this=0x7f59d30495e8) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/thread/src/TReentrantRWLock.cxx:102
      #10 0x00007f59e79827a2 in ROOT::TRWMutexImp<std::mutex, ROOT::Internal::RecurseCounts>::ReadLock (this=0x7f59d30495e0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/thread/src/TRWMutexImp.cxx:33
      #11 0x00007f59e77a856e in ROOT::TReadLockGuard::TReadLockGuard (this=0x7f59b7ff6a30, mutex=0x7f59d30495e0) at include/TVirtualRWMutex.h:107
      #12 0x00007f59e6db9b7c in TPluginManager::LoadHandlersFromPluginDirs (this=0x7f59e2e3b000, base=0x7f59e75045ca "TFile") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TPluginManager.cxx:456
      #13 0x00007f59e6dba894 in TPluginManager::FindHandler (this=0x7f59e2e3b000, base=0x7f59e75045ca "TFile", uri=0x7f59b4eaeb40 "root://cms-xrd-global.cern.ch//store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TPluginManager.cxx:583
      #14 0x00007f59e72eaaf9 in TFile::Open (url=0x7f59b4eaed80 "root://cms-xrd-global.cern.ch//store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root", options=0x7f59c14ab2aa "", ftitle=0x7f59c14ab2aa "", compress=101, netopt=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4108
      #15 0x00007f59c1491fe8 in edm::InputFile::InputFile(char const*, char const*, edm::InputType) () from /cvmfs/cms-ib.cern.ch/nweek-02563/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_5_ROOT6_X_2019-02-13-2300/lib/slc7_amd64_gcc700/pluginIOPoolInput.so
      [CMSSW stack part cut]Thread 10 (Thread 0x7f59b9152700 (LWP 13193)):
      <This thread is OK>#4 0x00007f59e6d6e543 in TSTBIT (b=117 'u', map=0x7f59c3487006) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/Match.cxx:98
      #5 0x00007f59e6d6ed89 in omatch (strp=0x7f59b9148b08, slenp=0x7f59b9148b00, pat=0x7f59c3487004, start=0x7f59c938be80 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/Match.cxx:387
      #6 0x00007f59e6d6ebad in patcmp (str=0x7f59c938be8f "user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", slen=150, pat=0x7f59c3487004, start=0x7f59c938be80 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/Match.cxx:310
      #7 0x00007f59e6d6ec86 in patcmp (str=0x7f59c938be8f "user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", slen=150, pat=0x7f59c3487004, start=0x7f59c938be80 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/Match.cxx:339
      #8 0x00007f59e6d6e8fc in Matchs (str=0x7f59c938be81 "eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", slen=164, pat=0x7f59c3487000, startpat=0x7f59b9148bd0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/Match.cxx:233
      #9 0x00007f59e6dce2c8 in TRegexp::Index (this=0x7f59b9148c80, string=..., len=0x7f59b9148c2c, i=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TRegexp.cxx:218
      #10 0x00007f59e6dce356 in TString::Index (this=0x7f59b9148c60, r=..., start=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TRegexp.cxx:253
      #11 0x00007f59e6db861e in TPluginHandler::CanHandle (this=0x7f59c2a06040, base=0x7f59e74fb2f5 "TArchiveFile", uri=0x7f59c938bc40 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TPluginManager.cxx:175
      #12 0x00007f59e6dba99d in TPluginManager::FindHandler (this=0x7f59e2e3b000, base=0x7f59e74fb2f5 "TArchiveFile", uri=0x7f59c938bc40 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TPluginManager.cxx:590
      #13 0x00007f59e7268be5 in TArchiveFile::Open (url=0x7f59c2a067c0 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", file=0x7f59c9a28200) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TArchiveFile.cxx:136
      #14 0x00007f59e72d9ed6 in TFile::TFile (this=0x7f59c9a28200, fname1=0x7f59c2a06880 "/eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", option=0x7f59dfcf3cca "NET", ftitle=0x7f59c14ab2aa "", compress=101) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:395
      #15 0x00007f59dfce7ced in TStorageFactoryFile::TStorageFactoryFile(char const*, char const*, char const*, int, int, bool) () from /cvmfs/cms-ib.cern.ch/nweek-02563/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_5_ROOT6_X_2019-02-13-2300/lib/slc7_amd64_gcc700/libIOPoolTFileAdaptor.so
      #16 0x00007f59e17130a4 in ?? ()
      #17 0x00007f5900000000 in ?? ()
      #18 0x00007f59d30495f8 in ?? ()
      #19 0x00007f59b9148f00 in ?? ()
      #20 0x0000000000000001 in ?? ()
      #21 0x00007f59b9148f00 in ?? ()
      #22 0x00007f59e7982813 in ROOT::TRWMutexImp<std::mutex, ROOT::Internal::RecurseCounts>::WriteUnLock (this=0x7f59c30b5f88, hint=0x7f59e1713000) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/thread/src/TRWMutexImp.cxx:60
      #23 0x00007f59dba1a4b5 in TClingCallFunc::exec (this=0x7f59c2a32400, address=0x0, ret=0x7f59b9149970) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TClingCallFunc.cxx:1776
      #24 0x00007f59dba1b2e2 in TClingCallFunc::<lambda(void*, cling::Value&)>::operator()(void *, cling::Value &) const (__closure=0x7f59b9149900, address=0x0, ret=...) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TClingCallFunc.cxx:1976
      #25 0x00007f59dba1f47b in std::Function_handler<void(void*, cling::Value&), TClingCallFunc::InitRetAndExec(const clang::FunctionDecl*, cling::Value&)::<lambda(void*, cling::Value&)> >::_M_invoke(const std::_Any_data &, void *&&, cling::Value &) (_functor=..., __args#0=@0x7f59b91498a0: 0x0, __args#1=...) at /build/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc700/external/gcc/7.0.0-omkpbe2/include/c++/7.3.1/bits/std_function.h:316
      #26 0x00007f59dba22b71 in std::function<void (void*, cling::Value&)>::operator()(void*, cling::Value&) const (this=0x7f59b9149900, __args#0=0x0, __args#1=...) at /build/cmsbld/jenkins/workspace/build-any-ib/w/slc7_amd64_gcc700/external/gcc/7.0.0-omkpbe2/include/c++/7.3.1/bits/std_function.h:706
      #27 0x00007f59dba1b53f in TClingCallFunc::exec_with_valref_return (this=0x7f59c2a32400, address=0x0, ret=0x7f59b9149970) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TClingCallFunc.cxx:1998
      #28 0x00007f59dba22cb4 in TClingCallFunc::ExecT<long> (this=0x7f59c2a32400, address=0x0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TClingCallFunc.cxx:2052
      #29 0x00007f59dba1b879 in TClingCallFunc::ExecInt (this=0x7f59c2a32400, address=0x0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TClingCallFunc.cxx:2065
      #30 0x00007f59dba4ef15 in TCling::CallFunc_ExecInt (this=0x7f59e1d32d80, func=0x7f59c2a32400, address=0x0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/metacling/src/TCling.cxx:7264
      #31 0x00007f59e6eb2456 in TMethodCall::Execute (this=0x7f59c2a07600, object=0x0, retLong=@0x7f59b9149ab8: 140023333952224) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/meta/src/TMethodCall.cxx:457
      #32 0x00007f59e7be4ec3 in TMethodCall::Execute (this=0x7f59c2a07600, retLong=@0x7f59b9149ab8: 140023333952224) at include/TMethodCall.h:136
      #33 0x00007f59e72f0f35 in TPluginHandler::ExecPluginImpl<char const*, char const*, char const*, int, int> (this=0x7f59e0af65c0, params#0=@0x7f59b9149e50: 0x7f59c2a06ac0 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", params#1=@0x7f59b9149dd8: 0x7f59b9149de9 "", params#2=@0x7f59b9149b48: 0x7f59c14ab2aa "", params#3=@0x7f59b9149b44: 101, params#4=@0x7f59b9149b40: 0) at include/TPluginManager.h:161
      #34 0x00007f59e72f0191 in TPluginHandler::ExecPlugin<char const*, char const*, char const*, int, int> (this=0x7f59e0af65c0, nargs=5, params#0=@0x7f59b9149e50: 0x7f59c2a06ac0 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", params#1=@0x7f59b9149dd8: 0x7f59b9149de9 "", params#2=@0x7f59b9149b48: 0x7f59c14ab2aa "", params#3=@0x7f59b9149b44: 101, params#4=@0x7f59b9149b40: 0) at include/TPluginManager.h:173
      #35 0x00007f59e72eab88 in TFile::Open (url=0x7f59c2a05380 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/F75D457E-7A3D-6A40-8838-0E2B065984EA.root", options=0x7f59c14ab2aa "", ftitle=0x7f59c14ab2aa "", compress=101, netopt=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4111
      #36 0x00007f59c1491fe8 in edm::InputFile::InputFile(char const*, char const*, edm::InputType) () from /cvmfs/cms-ib.cern.ch/nweek-02563/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_5_ROOT6_X_2019-02-13-2300/lib/slc7_amd64_gcc700/pluginIOPoolInput.so
      [CMSSW stack part cut]Thread 9 (Thread 0x7f59b9b53700 (LWP 13192)):
      <This thread is OK>#4 0x00007f59e4fd151d in __lll_lock_wait () from /lib64/libpthread.so.0
      #5 0x00007f59e4fcce36 in _L_lock_870 () from /lib64/libpthread.so.0
      #6 0x00007f59e4fccd2f in pthread_mutex_lock () from /lib64/libpthread.so.0
      #7 0x00007f59e798bb94 in TPosixMutex::Lock (this=0x7f59c29f7340) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/thread/src/TPosixMutex.cxx:76
      #8 0x00007f59e7976a1f in TMutex::Lock (this=0x7f59c9bb9750) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/thread/src/TMutex.cxx:48
      #9 0x00007f59e7b8e894 in TLockGuard::TLockGuard (this=0x7f59b9b4a490, mutex=0x7f59c9bb9750) at include/TVirtualMutex.h:79
      #10 0x00007f59e6dba94e in TPluginManager::FindHandler (this=0x7f59e2e3b000, base=0x7f59e6f4727f "TSystem", uri=0x7f59baf59680 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TPluginManager.cxx:585
      #11 0x00007f59e6de800d in TSystem::FindHelper (this=0x7f59e2e3e000, path=0x7f59baf59680 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root", dirptr=0x0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TSystem.cxx:782
      #12 0x00007f59e6ee889e in TUnixSystem::IsPathLocal (this=0x7f59e2e3e000, path=0x7f59baf59680 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/unix/src/TUnixSystem.cxx:1587
      #13 0x00007f59e72ecc00 in TFile::GetType (name=0x7f59baf59680 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root", option=0x7f59b9b4ade9 "", prefix=0x7f59b9b4ac90) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4712
      #14 0x00007f59e72ea9f4 in TFile::Open (url=0x7f59baf58780 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/264C7F72-1A79-C647-A302-B41F2987D828.root", options=0x7f59c14ab2aa "", ftitle=0x7f59c14ab2aa "", compress=101, netopt=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4093
      #15 0x00007f59c1491fe8 in edm::InputFile::InputFile(char const*, char const*, edm::InputType) () from /cvmfs/cms-ib.cern.ch/nweek-02563/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_5_ROOT6_X_2019-02-13-2300/lib/slc7_amd64_gcc700/pluginIOPoolInput.so
      [CMSSW stack part cut][Thread 4 - Thread 8 are waiting XRootD threads]
      [Thread 2&3 are CMSSW helper threads]Thread 1 (Thread 0x7f59e3330480 (LWP 12883)):#### This thread has segmentation fault ####
      #4 <signal handler called>
      #5 0x00007f59e6de7f2c in TSystem::FindHelper (this=0x7f59e2e3e000, path=0x7f59bafc2980 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/6D675869-EBCE-E14F-8D4F-676D96689255.root", dirptr=0x0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/base/src/TSystem.cxx:771
      #6 0x00007f59e6ee889e in TUnixSystem::IsPathLocal (this=0x7f59e2e3e000, path=0x7f59bafc2980 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/6D675869-EBCE-E14F-8D4F-676D96689255.root") at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/core/unix/src/TUnixSystem.cxx:1587
      #7 0x00007f59e72ecc00 in TFile::GetType (name=0x7f59bafc2980 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/6D675869-EBCE-E14F-8D4F-676D96689255.root", option=0x7fff9aee6199 "", prefix=0x7fff9aee6040) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4712
      #8 0x00007f59e72ea9f4 in TFile::Open (url=0x7f59bafc1a80 "root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/relval/CMSSW_10_5_0_pre1/RelValMinBias_13/GEN-SIM/103X_upgrade2018_realistic_v8-v1/20000/6D675869-EBCE-E14F-8D4F-676D96689255.root", options=0x7f59c14ab2aa "", ftitle=0x7f59c14ab2aa "", compress=101, netopt=0) at /build/cmsbld/jenkins/workspace/build-any-ib/w/BUILD/slc7_amd64_gcc700/lcg/root/6.17.01-pbfdoj/root-6.17.01/io/io/src/TFile.cxx:4093
      #9 0x00007f59c1491fe8 in edm::InputFile::InputFile(char const*, char const*, edm::InputType) () from /cvmfs/cms-ib.cern.ch/nweek-02563/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_5_ROOT6_X_2019-02-13-2300/lib/slc7_amd64_gcc700/pluginIOPoolInput.so
      [CMSSW stack parts cut]

       

      Four of the threads are in TFile::Open. The seg fault happens in TSystem::FindHelper while another thread is also in that routine.

        Attachments

          Activity

            People

            • Assignee:
              pcanal Philippe Canal
              Reporter:
              chrjones Christopher Jones
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: