soft time limit exceed in MOT20

[mmmm123456mmm]

After I submit my results, the submission fails after about one hour with no error logs available. However, it succeeds occasionally with a small probability. Could this be due to server instability?

Username: zouyifeng
Submission ID: 563677
Competition URL: https://codabench.org/competitions/10050

[Didayolo]

From what I'm seeing, the scoring quickly goes to this state, and then remains blocked until exceeding the time limit:

2026-02-28 02:53:24.059 | INFO     | compute_worker:show_progress:89 - Status: Image is up to date for codalab/codalab-legacy:py37

2026-02-28 02:53:24.060 | INFO     | compute_worker:_update_submission:478 - Updating submission @ https://www.codabench.org/api/submissions/579025/ with data = {'status': 'Running', 'status_details': 'scoring_hostname-worker9', 'secret': '8b04871b-7ec9-4182-ad34-92ddc3944506'}
2026-02-28 02:53:24.624 | INFO     | compute_worker:_update_submission:482 - Submission updated successfully!
2026-02-28 02:53:24.624 | INFO     | compute_worker:start:1125 - Running scoring program, and then ingestion program
2026-02-28 02:53:24.625 | INFO     | compute_worker:_run_program_directory:831 - Metadata path is /codabench/tmp_omyn195/program/metadata.yaml
2026-02-28 02:53:24.625 | INFO     | compute_worker:_run_program_directory:835 - Metadata contains:
 {'command': 'python3 runMOT.py'}
2026-02-28 02:53:24.626 | INFO     | compute_worker:_run_program_directory:975 - Running container with command python3 runMOT.py
2026-02-28 02:53:25.745 | INFO     | compute_worker:_run_program_directory:992 - Volume configuration of the container: 
{
│   '/codabench/tmp_omyn195/program': {'bind': '/app/program', 'mode': 'z'},
│   '/codabench/tmp_omyn195/output': {'bind': '/app/output', 'mode': 'z'},
│   '/codabench/data': {'bind': '/app/data', 'mode': 'ro'},
│   '/codabench/tmp_omyn195/shared': {'bind': '/app/shared'},
│   '/codabench/tmp_omyn195/input': {'bind': '/app/input'}
}
2026-02-28 02:53:25.747 | WARNING  | compute_worker:_run_program_directory:806 - /codabench/tmp_omyn195/ingestion_program not found, no program to execute
2026-02-28 02:53:25.747 | INFO     | compute_worker:watch_detailed_results:405 - 1.1920928955078125e-06
2026-02-28 02:53:29.202 | INFO     | compute_worker:_run_container_engine_cmd:700 - 
Eval Config:
USE_PARALLEL         : True                          
NUM_PARALLEL_CORES   : 2                             
PLOT_CURVES          : False                         
BREAK_ON_ERROR       : False                         
RETURN_ON_ERROR      : True                          
LOG_ON_ERROR         : True                          
PRINT_RESULTS        : True                          
PRINT_ONLY_COMBINED  : False                         
PRINT_CONFIG         : True                          
TIME_PROGRESS        : True                          
DISPLAY_LESS_PROGRESS : True                          

2026-02-28 02:53:29.203 | INFO     | compute_worker:_run_container_engine_cmd:700 - OUTPUT_SUMMARY       : True                          
OUTPUT_EMPTY_CLASSES : True                          
OUTPUT_DETAILED      : True                          

MotChallenge2DBox Config:
TRACKERS_TO_EVAL     : ['res']                       
TRACKER_SUB_FOLDER   :                               
OUTPUT_SUB_FOLDER    : ../                           
OUTPUT_FOLDER        : /app/output/                  
BENCHMARK            : MOT20                         
SPLIT_TO_EVAL        : test                          
SKIP_SPLIT_FOL       : True                          
GT_FOLDER            : /app/input/ref                
TRACKERS_FOLDER      : /app/input                    
SEQMAP_FOLDER        : /app/input/ref                
SEQMAP_FILE          : /app/input/ref/test-sequences.txt
CLASSES_TO_EVAL      : ['pedestrian']                
INPUT_AS_ZIP         : False                         
PRINT_CONFIG         : True                          
DO_PREPROC           : True                          
TRACKER_DISPLAY_NAMES : None                          
SEQ_INFO             : None                          
GT_LOC_FORMAT        : {gt_folder}/{seq}/gt/gt.txt   


2026-02-28 02:53:29.203 | INFO     | compute_worker:_run_container_engine_cmd:700 - 
Evaluating 1 tracker(s) on 4 sequence(s) for 1 class(es) on MotChallenge2DBox dataset using the following metrics: HOTA, CLEAR, Identity, Count


Evaluating res


2026-02-28 03:13:24.625 | ERROR    | compute_worker:_run_program_directory:998 - can only concatenate str (not "ExecutionTimeLimitExceeded") to str
2026-02-28 03:13:24.626 | INFO     | compute_worker:watch_detailed_results:405 - 1198.8795292377472
2026-02-28 03:13:24.626 | WARNING  | compute_worker:watch_detailed_results:410 - WARNING: Detailed results not written before the execution.
2026-02-28 03:13:29.632 | INFO     | compute_worker:watch_detailed_results:405 - 1203.8853018283844
2026-02-28 03:13:29.632 | WARNING  | compute_worker:watch_detailed_results:410 - WARNING: Detailed results not written before the execution.
2026-02-28 03:13:34.635 | INFO     | compute_worker:watch_detailed_results:405 - 1208.8876390457153

[mmmm123456mmm]

There seems to be no actual error in my submission. Could you please extend the evaluation time limit a bit? I would like to test it again. Thank you very much!