alidenewade commited on
Commit
584a2ba
·
verified ·
1 Parent(s): f8ec7be

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. replay.mp4 +2 -2
  2. sf_log.txt +1248 -0
replay.mp4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8cea0c5f28623c4a47f853504d752b37d401686d459f0743b4e39a9769788c5b
3
- size 147640926
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f278d20db6aa73312c3234bb34d01ece753f2da33a246efc828ebb30d89e941a
3
+ size 59798925
sf_log.txt CHANGED
@@ -12545,3 +12545,1251 @@ main_loop: 717.3057
12545
  [2024-11-07 16:25:58,090][14395] Num frames 99900...
12546
  [2024-11-07 16:25:58,276][14395] Num frames 100000...
12547
  [2024-11-07 16:30:56,493][14395] Replay video saved to /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/replay.mp4!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12545
  [2024-11-07 16:25:58,090][14395] Num frames 99900...
12546
  [2024-11-07 16:25:58,276][14395] Num frames 100000...
12547
  [2024-11-07 16:30:56,493][14395] Replay video saved to /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/replay.mp4!
12548
+ [2024-11-07 16:31:34,770][14395] The model has been pushed to https://huggingface.co/alidenewade/rl_course_vizdoom_health_gathering_supreme
12549
+ [2024-11-07 16:38:07,687][14395] Loading existing experiment configuration from /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/config.json
12550
+ [2024-11-07 16:38:07,688][14395] Overriding arg 'num_workers' with value 1 passed from command line
12551
+ [2024-11-07 16:38:07,689][14395] Adding new argument 'no_render'=True that is not in the saved config file!
12552
+ [2024-11-07 16:38:07,691][14395] Adding new argument 'save_video'=True that is not in the saved config file!
12553
+ [2024-11-07 16:38:07,693][14395] Adding new argument 'video_frames'=1000000000.0 that is not in the saved config file!
12554
+ [2024-11-07 16:38:07,695][14395] Adding new argument 'video_name'=None that is not in the saved config file!
12555
+ [2024-11-07 16:38:07,698][14395] Adding new argument 'max_num_frames'=1000000000.0 that is not in the saved config file!
12556
+ [2024-11-07 16:38:07,699][14395] Adding new argument 'max_num_episodes'=100 that is not in the saved config file!
12557
+ [2024-11-07 16:38:07,701][14395] Adding new argument 'push_to_hub'=False that is not in the saved config file!
12558
+ [2024-11-07 16:38:07,703][14395] Adding new argument 'hf_repository'=None that is not in the saved config file!
12559
+ [2024-11-07 16:38:07,705][14395] Adding new argument 'policy_index'=0 that is not in the saved config file!
12560
+ [2024-11-07 16:38:07,708][14395] Adding new argument 'eval_deterministic'=False that is not in the saved config file!
12561
+ [2024-11-07 16:38:07,711][14395] Adding new argument 'train_script'=None that is not in the saved config file!
12562
+ [2024-11-07 16:38:07,714][14395] Adding new argument 'enjoy_script'=None that is not in the saved config file!
12563
+ [2024-11-07 16:38:07,727][14395] Using frameskip 1 and render_action_repeat=4 for evaluation
12564
+ [2024-11-07 16:38:08,313][14395] RunningMeanStd input shape: (3, 72, 128)
12565
+ [2024-11-07 16:38:08,688][14395] RunningMeanStd input shape: (1,)
12566
+ [2024-11-07 16:38:09,099][14395] ConvEncoder: input_channels=3
12567
+ [2024-11-07 16:38:10,478][14395] Conv encoder output size: 512
12568
+ [2024-11-07 16:38:10,481][14395] Policy head output size: 512
12569
+ [2024-11-07 16:38:11,827][14395] Loading state from checkpoint /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/checkpoint_p0/checkpoint_000004884_20004864.pth...
12570
+ [2024-11-07 16:38:17,313][14395] Num frames 100...
12571
+ [2024-11-07 16:38:17,579][14395] Num frames 200...
12572
+ [2024-11-07 16:38:17,817][14395] Num frames 300...
12573
+ [2024-11-07 16:38:18,019][14395] Num frames 400...
12574
+ [2024-11-07 16:38:18,233][14395] Avg episode rewards: #0: 5.480, true rewards: #0: 4.480
12575
+ [2024-11-07 16:38:18,235][14395] Avg episode reward: 5.480, avg true_objective: 4.480
12576
+ [2024-11-07 16:38:18,359][14395] Num frames 500...
12577
+ [2024-11-07 16:38:18,594][14395] Num frames 600...
12578
+ [2024-11-07 16:38:18,786][14395] Num frames 700...
12579
+ [2024-11-07 16:38:18,987][14395] Num frames 800...
12580
+ [2024-11-07 16:38:19,105][14395] Avg episode rewards: #0: 4.660, true rewards: #0: 4.160
12581
+ [2024-11-07 16:38:19,110][14395] Avg episode reward: 4.660, avg true_objective: 4.160
12582
+ [2024-11-07 16:38:19,277][14395] Num frames 900...
12583
+ [2024-11-07 16:38:19,499][14395] Num frames 1000...
12584
+ [2024-11-07 16:38:19,754][14395] Num frames 1100...
12585
+ [2024-11-07 16:38:20,016][14395] Num frames 1200...
12586
+ [2024-11-07 16:38:20,109][14395] Avg episode rewards: #0: 4.387, true rewards: #0: 4.053
12587
+ [2024-11-07 16:38:20,110][14395] Avg episode reward: 4.387, avg true_objective: 4.053
12588
+ [2024-11-07 16:38:20,330][14395] Num frames 1300...
12589
+ [2024-11-07 16:38:20,550][14395] Num frames 1400...
12590
+ [2024-11-07 16:38:20,785][14395] Num frames 1500...
12591
+ [2024-11-07 16:38:21,001][14395] Num frames 1600...
12592
+ [2024-11-07 16:38:21,239][14395] Num frames 1700...
12593
+ [2024-11-07 16:38:21,369][14395] Avg episode rewards: #0: 5.070, true rewards: #0: 4.320
12594
+ [2024-11-07 16:38:21,373][14395] Avg episode reward: 5.070, avg true_objective: 4.320
12595
+ [2024-11-07 16:38:21,533][14395] Num frames 1800...
12596
+ [2024-11-07 16:38:21,766][14395] Num frames 1900...
12597
+ [2024-11-07 16:38:21,971][14395] Num frames 2000...
12598
+ [2024-11-07 16:38:22,151][14395] Num frames 2100...
12599
+ [2024-11-07 16:38:22,232][14395] Avg episode rewards: #0: 4.824, true rewards: #0: 4.224
12600
+ [2024-11-07 16:38:22,238][14395] Avg episode reward: 4.824, avg true_objective: 4.224
12601
+ [2024-11-07 16:38:22,409][14395] Num frames 2200...
12602
+ [2024-11-07 16:38:22,623][14395] Num frames 2300...
12603
+ [2024-11-07 16:38:22,810][14395] Num frames 2400...
12604
+ [2024-11-07 16:38:23,045][14395] Avg episode rewards: #0: 4.660, true rewards: #0: 4.160
12605
+ [2024-11-07 16:38:23,047][14395] Avg episode reward: 4.660, avg true_objective: 4.160
12606
+ [2024-11-07 16:38:23,058][14395] Num frames 2500...
12607
+ [2024-11-07 16:38:23,259][14395] Num frames 2600...
12608
+ [2024-11-07 16:38:23,470][14395] Num frames 2700...
12609
+ [2024-11-07 16:38:25,810][14395] Num frames 2800...
12610
+ [2024-11-07 16:38:26,038][14395] Avg episode rewards: #0: 4.543, true rewards: #0: 4.114
12611
+ [2024-11-07 16:38:26,042][14395] Avg episode reward: 4.543, avg true_objective: 4.114
12612
+ [2024-11-07 16:38:26,098][14395] Num frames 2900...
12613
+ [2024-11-07 16:38:26,304][14395] Num frames 3000...
12614
+ [2024-11-07 16:38:26,496][14395] Num frames 3100...
12615
+ [2024-11-07 16:38:26,731][14395] Num frames 3200...
12616
+ [2024-11-07 16:38:26,948][14395] Avg episode rewards: #0: 4.455, true rewards: #0: 4.080
12617
+ [2024-11-07 16:38:26,950][14395] Avg episode reward: 4.455, avg true_objective: 4.080
12618
+ [2024-11-07 16:38:27,041][14395] Num frames 3300...
12619
+ [2024-11-07 16:38:27,321][14395] Num frames 3400...
12620
+ [2024-11-07 16:38:27,547][14395] Num frames 3500...
12621
+ [2024-11-07 16:38:27,774][14395] Num frames 3600...
12622
+ [2024-11-07 16:38:27,944][14395] Avg episode rewards: #0: 4.387, true rewards: #0: 4.053
12623
+ [2024-11-07 16:38:27,945][14395] Avg episode reward: 4.387, avg true_objective: 4.053
12624
+ [2024-11-07 16:38:28,090][14395] Num frames 3700...
12625
+ [2024-11-07 16:38:28,314][14395] Num frames 3800...
12626
+ [2024-11-07 16:38:28,554][14395] Num frames 3900...
12627
+ [2024-11-07 16:38:28,706][14395] Avg episode rewards: #0: 4.237, true rewards: #0: 3.937
12628
+ [2024-11-07 16:38:28,709][14395] Avg episode reward: 4.237, avg true_objective: 3.937
12629
+ [2024-11-07 16:38:28,871][14395] Num frames 4000...
12630
+ [2024-11-07 16:38:29,088][14395] Num frames 4100...
12631
+ [2024-11-07 16:38:29,357][14395] Num frames 4200...
12632
+ [2024-11-07 16:38:29,603][14395] Num frames 4300...
12633
+ [2024-11-07 16:38:29,710][14395] Avg episode rewards: #0: 4.201, true rewards: #0: 3.928
12634
+ [2024-11-07 16:38:29,711][14395] Avg episode reward: 4.201, avg true_objective: 3.928
12635
+ [2024-11-07 16:38:29,904][14395] Num frames 4400...
12636
+ [2024-11-07 16:38:30,104][14395] Num frames 4500...
12637
+ [2024-11-07 16:38:30,288][14395] Num frames 4600...
12638
+ [2024-11-07 16:38:30,484][14395] Num frames 4700...
12639
+ [2024-11-07 16:38:30,681][14395] Avg episode rewards: #0: 4.308, true rewards: #0: 3.974
12640
+ [2024-11-07 16:38:30,683][14395] Avg episode reward: 4.308, avg true_objective: 3.974
12641
+ [2024-11-07 16:38:30,761][14395] Num frames 4800...
12642
+ [2024-11-07 16:38:30,968][14395] Num frames 4900...
12643
+ [2024-11-07 16:38:31,186][14395] Num frames 5000...
12644
+ [2024-11-07 16:38:31,393][14395] Avg episode rewards: #0: 4.198, true rewards: #0: 3.890
12645
+ [2024-11-07 16:38:31,394][14395] Avg episode reward: 4.198, avg true_objective: 3.890
12646
+ [2024-11-07 16:38:31,514][14395] Num frames 5100...
12647
+ [2024-11-07 16:38:31,752][14395] Num frames 5200...
12648
+ [2024-11-07 16:38:31,988][14395] Num frames 5300...
12649
+ [2024-11-07 16:38:32,219][14395] Num frames 5400...
12650
+ [2024-11-07 16:38:32,437][14395] Num frames 5500...
12651
+ [2024-11-07 16:38:32,505][14395] Avg episode rewards: #0: 4.289, true rewards: #0: 3.932
12652
+ [2024-11-07 16:38:32,509][14395] Avg episode reward: 4.289, avg true_objective: 3.932
12653
+ [2024-11-07 16:38:32,703][14395] Num frames 5600...
12654
+ [2024-11-07 16:38:32,900][14395] Num frames 5700...
12655
+ [2024-11-07 16:38:33,102][14395] Num frames 5800...
12656
+ [2024-11-07 16:38:33,301][14395] Num frames 5900...
12657
+ [2024-11-07 16:38:33,466][14395] Avg episode rewards: #0: 4.369, true rewards: #0: 3.969
12658
+ [2024-11-07 16:38:33,467][14395] Avg episode reward: 4.369, avg true_objective: 3.969
12659
+ [2024-11-07 16:38:33,566][14395] Num frames 6000...
12660
+ [2024-11-07 16:38:33,787][14395] Num frames 6100...
12661
+ [2024-11-07 16:38:33,997][14395] Num frames 6200...
12662
+ [2024-11-07 16:38:34,211][14395] Num frames 6300...
12663
+ [2024-11-07 16:38:34,423][14395] Num frames 6400...
12664
+ [2024-11-07 16:38:34,755][14395] Avg episode rewards: #0: 4.561, true rewards: #0: 4.061
12665
+ [2024-11-07 16:38:34,758][14395] Avg episode reward: 4.561, avg true_objective: 4.061
12666
+ [2024-11-07 16:38:34,776][14395] Num frames 6500...
12667
+ [2024-11-07 16:38:34,998][14395] Num frames 6600...
12668
+ [2024-11-07 16:38:35,225][14395] Num frames 6700...
12669
+ [2024-11-07 16:38:35,471][14395] Num frames 6800...
12670
+ [2024-11-07 16:38:35,693][14395] Avg episode rewards: #0: 4.518, true rewards: #0: 4.048
12671
+ [2024-11-07 16:38:35,694][14395] Avg episode reward: 4.518, avg true_objective: 4.048
12672
+ [2024-11-07 16:38:35,741][14395] Num frames 6900...
12673
+ [2024-11-07 16:38:35,952][14395] Num frames 7000...
12674
+ [2024-11-07 16:38:36,144][14395] Num frames 7100...
12675
+ [2024-11-07 16:38:36,344][14395] Num frames 7200...
12676
+ [2024-11-07 16:38:36,554][14395] Avg episode rewards: #0: 4.481, true rewards: #0: 4.036
12677
+ [2024-11-07 16:38:36,555][14395] Avg episode reward: 4.481, avg true_objective: 4.036
12678
+ [2024-11-07 16:38:36,629][14395] Num frames 7300...
12679
+ [2024-11-07 16:38:36,859][14395] Num frames 7400...
12680
+ [2024-11-07 16:38:37,154][14395] Num frames 7500...
12681
+ [2024-11-07 16:38:37,450][14395] Num frames 7600...
12682
+ [2024-11-07 16:38:37,717][14395] Avg episode rewards: #0: 4.516, true rewards: #0: 4.043
12683
+ [2024-11-07 16:38:37,724][14395] Avg episode reward: 4.516, avg true_objective: 4.043
12684
+ [2024-11-07 16:38:37,794][14395] Num frames 7700...
12685
+ [2024-11-07 16:38:38,226][14395] Num frames 7800...
12686
+ [2024-11-07 16:38:38,748][14395] Num frames 7900...
12687
+ [2024-11-07 16:38:39,070][14395] Num frames 8000...
12688
+ [2024-11-07 16:38:39,292][14395] Avg episode rewards: #0: 4.483, true rewards: #0: 4.032
12689
+ [2024-11-07 16:38:39,294][14395] Avg episode reward: 4.483, avg true_objective: 4.032
12690
+ [2024-11-07 16:38:39,414][14395] Num frames 8100...
12691
+ [2024-11-07 16:38:39,656][14395] Num frames 8200...
12692
+ [2024-11-07 16:38:39,915][14395] Num frames 8300...
12693
+ [2024-11-07 16:38:40,181][14395] Num frames 8400...
12694
+ [2024-11-07 16:38:40,399][14395] Avg episode rewards: #0: 4.452, true rewards: #0: 4.023
12695
+ [2024-11-07 16:38:40,400][14395] Avg episode reward: 4.452, avg true_objective: 4.023
12696
+ [2024-11-07 16:38:40,628][14395] Num frames 8500...
12697
+ [2024-11-07 16:38:40,952][14395] Num frames 8600...
12698
+ [2024-11-07 16:38:41,486][14395] Num frames 8700...
12699
+ [2024-11-07 16:38:41,806][14395] Num frames 8800...
12700
+ [2024-11-07 16:38:42,060][14395] Avg episode rewards: #0: 4.424, true rewards: #0: 4.015
12701
+ [2024-11-07 16:38:42,062][14395] Avg episode reward: 4.424, avg true_objective: 4.015
12702
+ [2024-11-07 16:38:42,353][14395] Num frames 8900...
12703
+ [2024-11-07 16:38:42,807][14395] Num frames 9000...
12704
+ [2024-11-07 16:38:43,151][14395] Num frames 9100...
12705
+ [2024-11-07 16:38:43,507][14395] Num frames 9200...
12706
+ [2024-11-07 16:38:43,881][14395] Avg episode rewards: #0: 4.470, true rewards: #0: 4.035
12707
+ [2024-11-07 16:38:43,884][14395] Avg episode reward: 4.470, avg true_objective: 4.035
12708
+ [2024-11-07 16:38:43,986][14395] Num frames 9300...
12709
+ [2024-11-07 16:38:44,440][14395] Num frames 9400...
12710
+ [2024-11-07 16:38:45,267][14395] Num frames 9500...
12711
+ [2024-11-07 16:38:45,942][14395] Num frames 9600...
12712
+ [2024-11-07 16:38:46,496][14395] Num frames 9700...
12713
+ [2024-11-07 16:38:46,676][14395] Avg episode rewards: #0: 4.512, true rewards: #0: 4.054
12714
+ [2024-11-07 16:38:46,678][14395] Avg episode reward: 4.512, avg true_objective: 4.054
12715
+ [2024-11-07 16:38:47,074][14395] Num frames 9800...
12716
+ [2024-11-07 16:38:47,433][14395] Num frames 9900...
12717
+ [2024-11-07 16:38:47,817][14395] Num frames 10000...
12718
+ [2024-11-07 16:38:48,101][14395] Num frames 10100...
12719
+ [2024-11-07 16:38:48,194][14395] Avg episode rewards: #0: 4.485, true rewards: #0: 4.045
12720
+ [2024-11-07 16:38:48,195][14395] Avg episode reward: 4.485, avg true_objective: 4.045
12721
+ [2024-11-07 16:38:48,421][14395] Num frames 10200...
12722
+ [2024-11-07 16:38:48,824][14395] Num frames 10300...
12723
+ [2024-11-07 16:38:49,156][14395] Num frames 10400...
12724
+ [2024-11-07 16:38:49,549][14395] Num frames 10500...
12725
+ [2024-11-07 16:38:49,794][14395] Num frames 10600...
12726
+ [2024-11-07 16:38:49,919][14395] Avg episode rewards: #0: 4.587, true rewards: #0: 4.087
12727
+ [2024-11-07 16:38:49,921][14395] Avg episode reward: 4.587, avg true_objective: 4.087
12728
+ [2024-11-07 16:38:50,121][14395] Num frames 10700...
12729
+ [2024-11-07 16:38:50,363][14395] Num frames 10800...
12730
+ [2024-11-07 16:38:50,651][14395] Num frames 10900...
12731
+ [2024-11-07 16:38:50,885][14395] Num frames 11000...
12732
+ [2024-11-07 16:38:50,965][14395] Avg episode rewards: #0: 4.559, true rewards: #0: 4.077
12733
+ [2024-11-07 16:38:50,968][14395] Avg episode reward: 4.559, avg true_objective: 4.077
12734
+ [2024-11-07 16:38:51,222][14395] Num frames 11100...
12735
+ [2024-11-07 16:38:51,467][14395] Num frames 11200...
12736
+ [2024-11-07 16:38:51,697][14395] Num frames 11300...
12737
+ [2024-11-07 16:38:51,939][14395] Avg episode rewards: #0: 4.533, true rewards: #0: 4.069
12738
+ [2024-11-07 16:38:51,941][14395] Avg episode reward: 4.533, avg true_objective: 4.069
12739
+ [2024-11-07 16:38:51,959][14395] Num frames 11400...
12740
+ [2024-11-07 16:38:52,172][14395] Num frames 11500...
12741
+ [2024-11-07 16:38:52,358][14395] Num frames 11600...
12742
+ [2024-11-07 16:38:52,520][14395] Avg episode rewards: #0: 4.465, true rewards: #0: 4.017
12743
+ [2024-11-07 16:38:52,521][14395] Avg episode reward: 4.465, avg true_objective: 4.017
12744
+ [2024-11-07 16:38:52,660][14395] Num frames 11700...
12745
+ [2024-11-07 16:38:52,869][14395] Num frames 11800...
12746
+ [2024-11-07 16:38:53,174][14395] Num frames 11900...
12747
+ [2024-11-07 16:38:53,549][14395] Num frames 12000...
12748
+ [2024-11-07 16:38:53,779][14395] Avg episode rewards: #0: 4.444, true rewards: #0: 4.011
12749
+ [2024-11-07 16:38:53,781][14395] Avg episode reward: 4.444, avg true_objective: 4.011
12750
+ [2024-11-07 16:38:54,073][14395] Num frames 12100...
12751
+ [2024-11-07 16:38:54,379][14395] Num frames 12200...
12752
+ [2024-11-07 16:38:54,660][14395] Num frames 12300...
12753
+ [2024-11-07 16:38:55,132][14395] Num frames 12400...
12754
+ [2024-11-07 16:38:55,326][14395] Avg episode rewards: #0: 4.425, true rewards: #0: 4.005
12755
+ [2024-11-07 16:38:55,329][14395] Avg episode reward: 4.425, avg true_objective: 4.005
12756
+ [2024-11-07 16:38:55,582][14395] Num frames 12500...
12757
+ [2024-11-07 16:38:55,975][14395] Num frames 12600...
12758
+ [2024-11-07 16:38:56,460][14395] Num frames 12700...
12759
+ [2024-11-07 16:38:56,794][14395] Num frames 12800...
12760
+ [2024-11-07 16:38:56,855][14395] Avg episode rewards: #0: 4.407, true rewards: #0: 4.000
12761
+ [2024-11-07 16:38:56,856][14395] Avg episode reward: 4.407, avg true_objective: 4.000
12762
+ [2024-11-07 16:38:57,121][14395] Num frames 12900...
12763
+ [2024-11-07 16:38:57,339][14395] Num frames 13000...
12764
+ [2024-11-07 16:38:57,593][14395] Num frames 13100...
12765
+ [2024-11-07 16:38:57,814][14395] Num frames 13200...
12766
+ [2024-11-07 16:39:00,296][14395] Avg episode rewards: #0: 4.439, true rewards: #0: 4.015
12767
+ [2024-11-07 16:39:00,300][14395] Avg episode reward: 4.439, avg true_objective: 4.015
12768
+ [2024-11-07 16:39:00,433][14395] Num frames 13300...
12769
+ [2024-11-07 16:39:00,680][14395] Num frames 13400...
12770
+ [2024-11-07 16:39:00,916][14395] Num frames 13500...
12771
+ [2024-11-07 16:39:01,141][14395] Num frames 13600...
12772
+ [2024-11-07 16:39:01,294][14395] Avg episode rewards: #0: 4.421, true rewards: #0: 4.010
12773
+ [2024-11-07 16:39:01,298][14395] Avg episode reward: 4.421, avg true_objective: 4.010
12774
+ [2024-11-07 16:39:01,469][14395] Num frames 13700...
12775
+ [2024-11-07 16:39:01,728][14395] Num frames 13800...
12776
+ [2024-11-07 16:39:02,047][14395] Num frames 13900...
12777
+ [2024-11-07 16:39:02,317][14395] Num frames 14000...
12778
+ [2024-11-07 16:39:02,433][14395] Avg episode rewards: #0: 4.405, true rewards: #0: 4.005
12779
+ [2024-11-07 16:39:02,438][14395] Avg episode reward: 4.405, avg true_objective: 4.005
12780
+ [2024-11-07 16:39:02,675][14395] Num frames 14100...
12781
+ [2024-11-07 16:39:02,915][14395] Num frames 14200...
12782
+ [2024-11-07 16:39:03,101][14395] Num frames 14300...
12783
+ [2024-11-07 16:39:03,280][14395] Num frames 14400...
12784
+ [2024-11-07 16:39:03,341][14395] Avg episode rewards: #0: 4.389, true rewards: #0: 4.000
12785
+ [2024-11-07 16:39:03,345][14395] Avg episode reward: 4.389, avg true_objective: 4.000
12786
+ [2024-11-07 16:39:03,567][14395] Num frames 14500...
12787
+ [2024-11-07 16:39:03,933][14395] Num frames 14600...
12788
+ [2024-11-07 16:39:04,176][14395] Num frames 14700...
12789
+ [2024-11-07 16:39:04,535][14395] Num frames 14800...
12790
+ [2024-11-07 16:39:04,912][14395] Avg episode rewards: #0: 4.419, true rewards: #0: 4.013
12791
+ [2024-11-07 16:39:04,916][14395] Avg episode reward: 4.419, avg true_objective: 4.013
12792
+ [2024-11-07 16:39:05,060][14395] Num frames 14900...
12793
+ [2024-11-07 16:39:05,399][14395] Num frames 15000...
12794
+ [2024-11-07 16:39:05,686][14395] Num frames 15100...
12795
+ [2024-11-07 16:39:05,937][14395] Num frames 15200...
12796
+ [2024-11-07 16:39:06,198][14395] Num frames 15300...
12797
+ [2024-11-07 16:39:06,315][14395] Avg episode rewards: #0: 4.481, true rewards: #0: 4.034
12798
+ [2024-11-07 16:39:06,318][14395] Avg episode reward: 4.481, avg true_objective: 4.034
12799
+ [2024-11-07 16:39:06,589][14395] Num frames 15400...
12800
+ [2024-11-07 16:39:07,037][14395] Num frames 15500...
12801
+ [2024-11-07 16:39:07,414][14395] Num frames 15600...
12802
+ [2024-11-07 16:39:07,686][14395] Num frames 15700...
12803
+ [2024-11-07 16:39:07,784][14395] Avg episode rewards: #0: 4.465, true rewards: #0: 4.029
12804
+ [2024-11-07 16:39:07,785][14395] Avg episode reward: 4.465, avg true_objective: 4.029
12805
+ [2024-11-07 16:39:08,002][14395] Num frames 15800...
12806
+ [2024-11-07 16:39:08,364][14395] Num frames 15900...
12807
+ [2024-11-07 16:39:08,577][14395] Num frames 16000...
12808
+ [2024-11-07 16:39:08,843][14395] Avg episode rewards: #0: 4.449, true rewards: #0: 4.024
12809
+ [2024-11-07 16:39:08,844][14395] Avg episode reward: 4.449, avg true_objective: 4.024
12810
+ [2024-11-07 16:39:08,850][14395] Num frames 16100...
12811
+ [2024-11-07 16:39:09,086][14395] Num frames 16200...
12812
+ [2024-11-07 16:39:09,331][14395] Num frames 16300...
12813
+ [2024-11-07 16:39:09,547][14395] Num frames 16400...
12814
+ [2024-11-07 16:39:09,812][14395] Avg episode rewards: #0: 4.434, true rewards: #0: 4.020
12815
+ [2024-11-07 16:39:09,813][14395] Avg episode reward: 4.434, avg true_objective: 4.020
12816
+ [2024-11-07 16:39:09,865][14395] Num frames 16500...
12817
+ [2024-11-07 16:39:10,164][14395] Num frames 16600...
12818
+ [2024-11-07 16:39:10,397][14395] Num frames 16700...
12819
+ [2024-11-07 16:39:10,635][14395] Num frames 16800...
12820
+ [2024-11-07 16:39:10,850][14395] Avg episode rewards: #0: 4.420, true rewards: #0: 4.015
12821
+ [2024-11-07 16:39:10,852][14395] Avg episode reward: 4.420, avg true_objective: 4.015
12822
+ [2024-11-07 16:39:10,932][14395] Num frames 16900...
12823
+ [2024-11-07 16:39:11,120][14395] Num frames 17000...
12824
+ [2024-11-07 16:39:11,327][14395] Num frames 17100...
12825
+ [2024-11-07 16:39:11,536][14395] Num frames 17200...
12826
+ [2024-11-07 16:39:11,706][14395] Avg episode rewards: #0: 4.407, true rewards: #0: 4.011
12827
+ [2024-11-07 16:39:11,710][14395] Avg episode reward: 4.407, avg true_objective: 4.011
12828
+ [2024-11-07 16:39:11,828][14395] Num frames 17300...
12829
+ [2024-11-07 16:39:12,118][14395] Num frames 17400...
12830
+ [2024-11-07 16:39:12,362][14395] Num frames 17500...
12831
+ [2024-11-07 16:39:12,625][14395] Num frames 17600...
12832
+ [2024-11-07 16:39:12,782][14395] Avg episode rewards: #0: 4.394, true rewards: #0: 4.007
12833
+ [2024-11-07 16:39:12,783][14395] Avg episode reward: 4.394, avg true_objective: 4.007
12834
+ [2024-11-07 16:39:12,967][14395] Num frames 17700...
12835
+ [2024-11-07 16:39:13,262][14395] Num frames 17800...
12836
+ [2024-11-07 16:39:13,527][14395] Num frames 17900...
12837
+ [2024-11-07 16:39:13,757][14395] Num frames 18000...
12838
+ [2024-11-07 16:39:13,857][14395] Avg episode rewards: #0: 4.382, true rewards: #0: 4.004
12839
+ [2024-11-07 16:39:13,858][14395] Avg episode reward: 4.382, avg true_objective: 4.004
12840
+ [2024-11-07 16:39:14,068][14395] Num frames 18100...
12841
+ [2024-11-07 16:39:14,367][14395] Num frames 18200...
12842
+ [2024-11-07 16:39:14,748][14395] Num frames 18300...
12843
+ [2024-11-07 16:39:15,078][14395] Num frames 18400...
12844
+ [2024-11-07 16:39:15,375][14395] Avg episode rewards: #0: 4.405, true rewards: #0: 4.014
12845
+ [2024-11-07 16:39:15,376][14395] Avg episode reward: 4.405, avg true_objective: 4.014
12846
+ [2024-11-07 16:39:15,488][14395] Num frames 18500...
12847
+ [2024-11-07 16:39:15,784][14395] Num frames 18600...
12848
+ [2024-11-07 16:39:16,189][14395] Num frames 18700...
12849
+ [2024-11-07 16:39:16,627][14395] Num frames 18800...
12850
+ [2024-11-07 16:39:16,901][14395] Avg episode rewards: #0: 4.393, true rewards: #0: 4.010
12851
+ [2024-11-07 16:39:16,906][14395] Avg episode reward: 4.393, avg true_objective: 4.010
12852
+ [2024-11-07 16:39:17,078][14395] Num frames 18900...
12853
+ [2024-11-07 16:39:17,411][14395] Num frames 19000...
12854
+ [2024-11-07 16:39:17,647][14395] Num frames 19100...
12855
+ [2024-11-07 16:39:17,911][14395] Num frames 19200...
12856
+ [2024-11-07 16:39:18,070][14395] Avg episode rewards: #0: 4.382, true rewards: #0: 4.007
12857
+ [2024-11-07 16:39:18,076][14395] Avg episode reward: 4.382, avg true_objective: 4.007
12858
+ [2024-11-07 16:39:18,259][14395] Num frames 19300...
12859
+ [2024-11-07 16:39:18,513][14395] Num frames 19400...
12860
+ [2024-11-07 16:39:18,735][14395] Num frames 19500...
12861
+ [2024-11-07 16:39:18,987][14395] Num frames 19600...
12862
+ [2024-11-07 16:39:19,085][14395] Avg episode rewards: #0: 4.371, true rewards: #0: 4.003
12863
+ [2024-11-07 16:39:19,089][14395] Avg episode reward: 4.371, avg true_objective: 4.003
12864
+ [2024-11-07 16:39:19,305][14395] Num frames 19700...
12865
+ [2024-11-07 16:39:19,719][14395] Num frames 19800...
12866
+ [2024-11-07 16:39:20,099][14395] Num frames 19900...
12867
+ [2024-11-07 16:39:20,664][14395] Num frames 20000...
12868
+ [2024-11-07 16:39:20,730][14395] Avg episode rewards: #0: 4.360, true rewards: #0: 4.000
12869
+ [2024-11-07 16:39:20,732][14395] Avg episode reward: 4.360, avg true_objective: 4.000
12870
+ [2024-11-07 16:39:21,128][14395] Num frames 20100...
12871
+ [2024-11-07 16:39:21,371][14395] Num frames 20200...
12872
+ [2024-11-07 16:39:21,611][14395] Num frames 20300...
12873
+ [2024-11-07 16:39:21,862][14395] Avg episode rewards: #0: 4.350, true rewards: #0: 3.997
12874
+ [2024-11-07 16:39:21,866][14395] Avg episode reward: 4.350, avg true_objective: 3.997
12875
+ [2024-11-07 16:39:21,916][14395] Num frames 20400...
12876
+ [2024-11-07 16:39:22,240][14395] Num frames 20500...
12877
+ [2024-11-07 16:39:22,541][14395] Num frames 20600...
12878
+ [2024-11-07 16:39:23,043][14395] Num frames 20700...
12879
+ [2024-11-07 16:39:23,315][14395] Avg episode rewards: #0: 4.340, true rewards: #0: 3.994
12880
+ [2024-11-07 16:39:23,318][14395] Avg episode reward: 4.340, avg true_objective: 3.994
12881
+ [2024-11-07 16:39:23,427][14395] Num frames 20800...
12882
+ [2024-11-07 16:39:23,736][14395] Num frames 20900...
12883
+ [2024-11-07 16:39:24,070][14395] Num frames 21000...
12884
+ [2024-11-07 16:39:24,348][14395] Num frames 21100...
12885
+ [2024-11-07 16:39:24,598][14395] Avg episode rewards: #0: 4.331, true rewards: #0: 3.991
12886
+ [2024-11-07 16:39:24,602][14395] Avg episode reward: 4.331, avg true_objective: 3.991
12887
+ [2024-11-07 16:39:24,779][14395] Num frames 21200...
12888
+ [2024-11-07 16:39:25,208][14395] Num frames 21300...
12889
+ [2024-11-07 16:39:25,518][14395] Num frames 21400...
12890
+ [2024-11-07 16:39:25,784][14395] Num frames 21500...
12891
+ [2024-11-07 16:39:25,942][14395] Avg episode rewards: #0: 4.322, true rewards: #0: 3.988
12892
+ [2024-11-07 16:39:25,946][14395] Avg episode reward: 4.322, avg true_objective: 3.988
12893
+ [2024-11-07 16:39:26,106][14395] Num frames 21600...
12894
+ [2024-11-07 16:39:26,340][14395] Num frames 21700...
12895
+ [2024-11-07 16:39:26,591][14395] Num frames 21800...
12896
+ [2024-11-07 16:39:26,827][14395] Num frames 21900...
12897
+ [2024-11-07 16:39:26,926][14395] Avg episode rewards: #0: 4.313, true rewards: #0: 3.986
12898
+ [2024-11-07 16:39:26,929][14395] Avg episode reward: 4.313, avg true_objective: 3.986
12899
+ [2024-11-07 16:39:27,107][14395] Num frames 22000...
12900
+ [2024-11-07 16:39:27,377][14395] Num frames 22100...
12901
+ [2024-11-07 16:39:27,590][14395] Num frames 22200...
12902
+ [2024-11-07 16:39:27,791][14395] Num frames 22300...
12903
+ [2024-11-07 16:39:27,863][14395] Avg episode rewards: #0: 4.304, true rewards: #0: 3.983
12904
+ [2024-11-07 16:39:27,867][14395] Avg episode reward: 4.304, avg true_objective: 3.983
12905
+ [2024-11-07 16:39:28,125][14395] Num frames 22400...
12906
+ [2024-11-07 16:39:28,399][14395] Num frames 22500...
12907
+ [2024-11-07 16:39:28,632][14395] Num frames 22600...
12908
+ [2024-11-07 16:39:28,893][14395] Num frames 22700...
12909
+ [2024-11-07 16:39:29,126][14395] Num frames 22800...
12910
+ [2024-11-07 16:39:29,221][14395] Avg episode rewards: #0: 4.354, true rewards: #0: 4.003
12911
+ [2024-11-07 16:39:29,223][14395] Avg episode reward: 4.354, avg true_objective: 4.003
12912
+ [2024-11-07 16:39:29,412][14395] Num frames 22900...
12913
+ [2024-11-07 16:39:29,687][14395] Num frames 23000...
12914
+ [2024-11-07 16:39:29,913][14395] Num frames 23100...
12915
+ [2024-11-07 16:39:30,127][14395] Num frames 23200...
12916
+ [2024-11-07 16:39:30,187][14395] Avg episode rewards: #0: 4.345, true rewards: #0: 4.000
12917
+ [2024-11-07 16:39:30,190][14395] Avg episode reward: 4.345, avg true_objective: 4.000
12918
+ [2024-11-07 16:39:30,418][14395] Num frames 23300...
12919
+ [2024-11-07 16:39:30,678][14395] Num frames 23400...
12920
+ [2024-11-07 16:39:31,046][14395] Num frames 23500...
12921
+ [2024-11-07 16:39:31,323][14395] Num frames 23600...
12922
+ [2024-11-07 16:39:31,595][14395] Avg episode rewards: #0: 4.387, true rewards: #0: 4.014
12923
+ [2024-11-07 16:39:31,600][14395] Avg episode reward: 4.387, avg true_objective: 4.014
12924
+ [2024-11-07 16:39:31,658][14395] Num frames 23700...
12925
+ [2024-11-07 16:39:31,882][14395] Num frames 23800...
12926
+ [2024-11-07 16:39:32,118][14395] Num frames 23900...
12927
+ [2024-11-07 16:39:34,685][14395] Num frames 24000...
12928
+ [2024-11-07 16:39:35,123][14395] Num frames 24100...
12929
+ [2024-11-07 16:39:35,397][14395] Avg episode rewards: #0: 4.405, true rewards: #0: 4.021
12930
+ [2024-11-07 16:39:35,398][14395] Avg episode reward: 4.405, avg true_objective: 4.021
12931
+ [2024-11-07 16:39:35,593][14395] Num frames 24200...
12932
+ [2024-11-07 16:39:35,804][14395] Num frames 24300...
12933
+ [2024-11-07 16:39:36,056][14395] Avg episode rewards: #0: 4.375, true rewards: #0: 3.998
12934
+ [2024-11-07 16:39:36,060][14395] Avg episode reward: 4.375, avg true_objective: 3.998
12935
+ [2024-11-07 16:39:36,124][14395] Num frames 24400...
12936
+ [2024-11-07 16:39:36,407][14395] Num frames 24500...
12937
+ [2024-11-07 16:39:36,665][14395] Num frames 24600...
12938
+ [2024-11-07 16:39:36,938][14395] Num frames 24700...
12939
+ [2024-11-07 16:39:37,227][14395] Avg episode rewards: #0: 4.366, true rewards: #0: 3.995
12940
+ [2024-11-07 16:39:37,232][14395] Avg episode reward: 4.366, avg true_objective: 3.995
12941
+ [2024-11-07 16:39:37,316][14395] Num frames 24800...
12942
+ [2024-11-07 16:39:37,636][14395] Num frames 24900...
12943
+ [2024-11-07 16:39:37,890][14395] Num frames 25000...
12944
+ [2024-11-07 16:39:38,104][14395] Num frames 25100...
12945
+ [2024-11-07 16:39:38,283][14395] Avg episode rewards: #0: 4.358, true rewards: #0: 3.993
12946
+ [2024-11-07 16:39:38,288][14395] Avg episode reward: 4.358, avg true_objective: 3.993
12947
+ [2024-11-07 16:39:38,414][14395] Num frames 25200...
12948
+ [2024-11-07 16:39:38,651][14395] Num frames 25300...
12949
+ [2024-11-07 16:39:38,850][14395] Num frames 25400...
12950
+ [2024-11-07 16:39:39,267][14395] Num frames 25500...
12951
+ [2024-11-07 16:39:39,442][14395] Avg episode rewards: #0: 4.350, true rewards: #0: 3.990
12952
+ [2024-11-07 16:39:39,444][14395] Avg episode reward: 4.350, avg true_objective: 3.990
12953
+ [2024-11-07 16:39:39,601][14395] Num frames 25600...
12954
+ [2024-11-07 16:39:39,848][14395] Num frames 25700...
12955
+ [2024-11-07 16:39:40,110][14395] Num frames 25800...
12956
+ [2024-11-07 16:39:40,372][14395] Num frames 25900...
12957
+ [2024-11-07 16:39:40,685][14395] Avg episode rewards: #0: 4.367, true rewards: #0: 3.998
12958
+ [2024-11-07 16:39:40,692][14395] Avg episode reward: 4.367, avg true_objective: 3.998
12959
+ [2024-11-07 16:39:40,739][14395] Num frames 26000...
12960
+ [2024-11-07 16:39:40,934][14395] Num frames 26100...
12961
+ [2024-11-07 16:39:41,155][14395] Num frames 26200...
12962
+ [2024-11-07 16:39:41,343][14395] Num frames 26300...
12963
+ [2024-11-07 16:39:41,608][14395] Avg episode rewards: #0: 4.359, true rewards: #0: 3.995
12964
+ [2024-11-07 16:39:41,609][14395] Avg episode reward: 4.359, avg true_objective: 3.995
12965
+ [2024-11-07 16:39:41,674][14395] Num frames 26400...
12966
+ [2024-11-07 16:39:41,938][14395] Num frames 26500...
12967
+ [2024-11-07 16:39:42,164][14395] Num frames 26600...
12968
+ [2024-11-07 16:39:42,367][14395] Num frames 26700...
12969
+ [2024-11-07 16:39:42,604][14395] Avg episode rewards: #0: 4.371, true rewards: #0: 3.998
12970
+ [2024-11-07 16:39:42,606][14395] Avg episode reward: 4.371, avg true_objective: 3.998
12971
+ [2024-11-07 16:39:42,637][14395] Num frames 26800...
12972
+ [2024-11-07 16:39:42,901][14395] Num frames 26900...
12973
+ [2024-11-07 16:39:43,149][14395] Num frames 27000...
12974
+ [2024-11-07 16:39:43,543][14395] Num frames 27100...
12975
+ [2024-11-07 16:39:43,856][14395] Avg episode rewards: #0: 4.363, true rewards: #0: 3.995
12976
+ [2024-11-07 16:39:43,858][14395] Avg episode reward: 4.363, avg true_objective: 3.995
12977
+ [2024-11-07 16:39:43,969][14395] Num frames 27200...
12978
+ [2024-11-07 16:39:44,161][14395] Num frames 27300...
12979
+ [2024-11-07 16:39:44,367][14395] Num frames 27400...
12980
+ [2024-11-07 16:39:44,563][14395] Num frames 27500...
12981
+ [2024-11-07 16:39:44,719][14395] Avg episode rewards: #0: 4.356, true rewards: #0: 3.993
12982
+ [2024-11-07 16:39:44,721][14395] Avg episode reward: 4.356, avg true_objective: 3.993
12983
+ [2024-11-07 16:39:44,918][14395] Num frames 27600...
12984
+ [2024-11-07 16:39:45,159][14395] Num frames 27700...
12985
+ [2024-11-07 16:39:45,420][14395] Num frames 27800...
12986
+ [2024-11-07 16:39:45,648][14395] Num frames 27900...
12987
+ [2024-11-07 16:39:45,787][14395] Avg episode rewards: #0: 4.348, true rewards: #0: 3.991
12988
+ [2024-11-07 16:39:45,789][14395] Avg episode reward: 4.348, avg true_objective: 3.991
12989
+ [2024-11-07 16:39:45,893][14395] Num frames 28000...
12990
+ [2024-11-07 16:39:46,089][14395] Num frames 28100...
12991
+ [2024-11-07 16:39:46,262][14395] Num frames 28200...
12992
+ [2024-11-07 16:39:46,507][14395] Num frames 28300...
12993
+ [2024-11-07 16:39:46,614][14395] Avg episode rewards: #0: 4.341, true rewards: #0: 3.989
12994
+ [2024-11-07 16:39:46,617][14395] Avg episode reward: 4.341, avg true_objective: 3.989
12995
+ [2024-11-07 16:39:46,786][14395] Num frames 28400...
12996
+ [2024-11-07 16:39:47,018][14395] Num frames 28500...
12997
+ [2024-11-07 16:39:47,255][14395] Num frames 28600...
12998
+ [2024-11-07 16:39:47,508][14395] Num frames 28700...
12999
+ [2024-11-07 16:39:47,653][14395] Avg episode rewards: #0: 4.352, true rewards: #0: 3.991
13000
+ [2024-11-07 16:39:47,656][14395] Avg episode reward: 4.352, avg true_objective: 3.991
13001
+ [2024-11-07 16:39:47,833][14395] Num frames 28800...
13002
+ [2024-11-07 16:39:48,046][14395] Num frames 28900...
13003
+ [2024-11-07 16:39:48,254][14395] Num frames 29000...
13004
+ [2024-11-07 16:39:48,448][14395] Num frames 29100...
13005
+ [2024-11-07 16:39:48,546][14395] Avg episode rewards: #0: 4.345, true rewards: #0: 3.989
13006
+ [2024-11-07 16:39:48,551][14395] Avg episode reward: 4.345, avg true_objective: 3.989
13007
+ [2024-11-07 16:39:48,718][14395] Num frames 29200...
13008
+ [2024-11-07 16:39:48,889][14395] Num frames 29300...
13009
+ [2024-11-07 16:39:49,149][14395] Num frames 29400...
13010
+ [2024-11-07 16:39:49,366][14395] Num frames 29500...
13011
+ [2024-11-07 16:39:49,555][14395] Num frames 29600...
13012
+ [2024-11-07 16:39:49,806][14395] Avg episode rewards: #0: 4.387, true rewards: #0: 4.009
13013
+ [2024-11-07 16:39:49,808][14395] Avg episode reward: 4.387, avg true_objective: 4.009
13014
+ [2024-11-07 16:39:49,890][14395] Num frames 29700...
13015
+ [2024-11-07 16:39:50,069][14395] Num frames 29800...
13016
+ [2024-11-07 16:39:50,284][14395] Num frames 29900...
13017
+ [2024-11-07 16:39:50,557][14395] Num frames 30000...
13018
+ [2024-11-07 16:39:50,739][14395] Avg episode rewards: #0: 4.380, true rewards: #0: 4.007
13019
+ [2024-11-07 16:39:50,740][14395] Avg episode reward: 4.380, avg true_objective: 4.007
13020
+ [2024-11-07 16:39:50,848][14395] Num frames 30100...
13021
+ [2024-11-07 16:39:51,022][14395] Num frames 30200...
13022
+ [2024-11-07 16:39:51,203][14395] Num frames 30300...
13023
+ [2024-11-07 16:39:51,366][14395] Num frames 30400...
13024
+ [2024-11-07 16:39:51,481][14395] Avg episode rewards: #0: 4.373, true rewards: #0: 4.004
13025
+ [2024-11-07 16:39:51,484][14395] Avg episode reward: 4.373, avg true_objective: 4.004
13026
+ [2024-11-07 16:39:51,621][14395] Num frames 30500...
13027
+ [2024-11-07 16:39:51,804][14395] Num frames 30600...
13028
+ [2024-11-07 16:39:52,052][14395] Num frames 30700...
13029
+ [2024-11-07 16:39:52,262][14395] Num frames 30800...
13030
+ [2024-11-07 16:39:52,357][14395] Avg episode rewards: #0: 4.366, true rewards: #0: 4.002
13031
+ [2024-11-07 16:39:52,358][14395] Avg episode reward: 4.366, avg true_objective: 4.002
13032
+ [2024-11-07 16:39:52,517][14395] Num frames 30900...
13033
+ [2024-11-07 16:39:52,741][14395] Num frames 31000...
13034
+ [2024-11-07 16:39:53,089][14395] Num frames 31100...
13035
+ [2024-11-07 16:39:53,295][14395] Num frames 31200...
13036
+ [2024-11-07 16:39:53,485][14395] Num frames 31300...
13037
+ [2024-11-07 16:39:53,775][14395] Avg episode rewards: #0: 4.405, true rewards: #0: 4.021
13038
+ [2024-11-07 16:39:53,777][14395] Avg episode reward: 4.405, avg true_objective: 4.021
13039
+ [2024-11-07 16:39:53,869][14395] Num frames 31400...
13040
+ [2024-11-07 16:39:54,091][14395] Num frames 31500...
13041
+ [2024-11-07 16:39:54,310][14395] Num frames 31600...
13042
+ [2024-11-07 16:39:54,516][14395] Num frames 31700...
13043
+ [2024-11-07 16:39:54,660][14395] Avg episode rewards: #0: 4.398, true rewards: #0: 4.018
13044
+ [2024-11-07 16:39:54,665][14395] Avg episode reward: 4.398, avg true_objective: 4.018
13045
+ [2024-11-07 16:39:54,782][14395] Num frames 31800...
13046
+ [2024-11-07 16:39:54,990][14395] Num frames 31900...
13047
+ [2024-11-07 16:39:55,192][14395] Num frames 32000...
13048
+ [2024-11-07 16:39:55,507][14395] Num frames 32100...
13049
+ [2024-11-07 16:39:55,636][14395] Avg episode rewards: #0: 4.391, true rewards: #0: 4.016
13050
+ [2024-11-07 16:39:55,640][14395] Avg episode reward: 4.391, avg true_objective: 4.016
13051
+ [2024-11-07 16:39:55,832][14395] Num frames 32200...
13052
+ [2024-11-07 16:39:56,036][14395] Num frames 32300...
13053
+ [2024-11-07 16:39:56,348][14395] Num frames 32400...
13054
+ [2024-11-07 16:39:56,573][14395] Num frames 32500...
13055
+ [2024-11-07 16:39:56,777][14395] Avg episode rewards: #0: 4.403, true rewards: #0: 4.021
13056
+ [2024-11-07 16:39:56,779][14395] Avg episode reward: 4.403, avg true_objective: 4.021
13057
+ [2024-11-07 16:39:56,996][14395] Num frames 32600...
13058
+ [2024-11-07 16:39:57,670][14395] Num frames 32700...
13059
+ [2024-11-07 16:39:58,204][14395] Num frames 32800...
13060
+ [2024-11-07 16:39:58,506][14395] Num frames 32900...
13061
+ [2024-11-07 16:39:58,702][14395] Avg episode rewards: #0: 4.397, true rewards: #0: 4.019
13062
+ [2024-11-07 16:39:58,707][14395] Avg episode reward: 4.397, avg true_objective: 4.019
13063
+ [2024-11-07 16:39:58,833][14395] Num frames 33000...
13064
+ [2024-11-07 16:39:59,141][14395] Num frames 33100...
13065
+ [2024-11-07 16:39:59,354][14395] Num frames 33200...
13066
+ [2024-11-07 16:39:59,585][14395] Num frames 33300...
13067
+ [2024-11-07 16:39:59,816][14395] Num frames 33400...
13068
+ [2024-11-07 16:39:59,869][14395] Avg episode rewards: #0: 4.410, true rewards: #0: 4.024
13069
+ [2024-11-07 16:39:59,870][14395] Avg episode reward: 4.410, avg true_objective: 4.024
13070
+ [2024-11-07 16:40:00,204][14395] Num frames 33500...
13071
+ [2024-11-07 16:40:00,654][14395] Num frames 33600...
13072
+ [2024-11-07 16:40:00,974][14395] Num frames 33700...
13073
+ [2024-11-07 16:40:01,320][14395] Num frames 33800...
13074
+ [2024-11-07 16:40:01,422][14395] Avg episode rewards: #0: 4.419, true rewards: #0: 4.026
13075
+ [2024-11-07 16:40:01,427][14395] Avg episode reward: 4.419, avg true_objective: 4.026
13076
+ [2024-11-07 16:40:01,660][14395] Num frames 33900...
13077
+ [2024-11-07 16:40:01,907][14395] Num frames 34000...
13078
+ [2024-11-07 16:40:02,119][14395] Num frames 34100...
13079
+ [2024-11-07 16:40:02,335][14395] Num frames 34200...
13080
+ [2024-11-07 16:40:02,540][14395] Avg episode rewards: #0: 4.431, true rewards: #0: 4.031
13081
+ [2024-11-07 16:40:02,543][14395] Avg episode reward: 4.431, avg true_objective: 4.031
13082
+ [2024-11-07 16:40:02,672][14395] Num frames 34300...
13083
+ [2024-11-07 16:40:02,934][14395] Num frames 34400...
13084
+ [2024-11-07 16:40:03,197][14395] Num frames 34500...
13085
+ [2024-11-07 16:40:03,733][14395] Num frames 34600...
13086
+ [2024-11-07 16:40:04,095][14395] Num frames 34700...
13087
+ [2024-11-07 16:40:04,187][14395] Avg episode rewards: #0: 4.455, true rewards: #0: 4.036
13088
+ [2024-11-07 16:40:04,188][14395] Avg episode reward: 4.455, avg true_objective: 4.036
13089
+ [2024-11-07 16:40:04,493][14395] Num frames 34800...
13090
+ [2024-11-07 16:40:04,896][14395] Num frames 34900...
13091
+ [2024-11-07 16:40:05,192][14395] Num frames 35000...
13092
+ [2024-11-07 16:40:05,461][14395] Avg episode rewards: #0: 4.448, true rewards: #0: 4.034
13093
+ [2024-11-07 16:40:05,466][14395] Avg episode reward: 4.448, avg true_objective: 4.034
13094
+ [2024-11-07 16:40:05,482][14395] Num frames 35100...
13095
+ [2024-11-07 16:40:05,706][14395] Num frames 35200...
13096
+ [2024-11-07 16:40:05,892][14395] Num frames 35300...
13097
+ [2024-11-07 16:40:06,089][14395] Num frames 35400...
13098
+ [2024-11-07 16:40:06,285][14395] Num frames 35500...
13099
+ [2024-11-07 16:40:06,427][14395] Avg episode rewards: #0: 4.460, true rewards: #0: 4.039
13100
+ [2024-11-07 16:40:06,429][14395] Avg episode reward: 4.460, avg true_objective: 4.039
13101
+ [2024-11-07 16:40:06,546][14395] Num frames 35600...
13102
+ [2024-11-07 16:40:06,759][14395] Num frames 35700...
13103
+ [2024-11-07 16:40:09,287][14395] Num frames 35800...
13104
+ [2024-11-07 16:40:09,491][14395] Num frames 35900...
13105
+ [2024-11-07 16:40:09,723][14395] Avg episode rewards: #0: 4.471, true rewards: #0: 4.044
13106
+ [2024-11-07 16:40:09,724][14395] Avg episode reward: 4.471, avg true_objective: 4.044
13107
+ [2024-11-07 16:40:09,742][14395] Num frames 36000...
13108
+ [2024-11-07 16:40:09,955][14395] Num frames 36100...
13109
+ [2024-11-07 16:40:10,158][14395] Num frames 36200...
13110
+ [2024-11-07 16:40:10,359][14395] Num frames 36300...
13111
+ [2024-11-07 16:40:10,557][14395] Avg episode rewards: #0: 4.464, true rewards: #0: 4.042
13112
+ [2024-11-07 16:40:10,560][14395] Avg episode reward: 4.464, avg true_objective: 4.042
13113
+ [2024-11-07 16:40:10,634][14395] Num frames 36400...
13114
+ [2024-11-07 16:40:10,829][14395] Num frames 36500...
13115
+ [2024-11-07 16:40:11,031][14395] Num frames 36600...
13116
+ [2024-11-07 16:40:11,241][14395] Num frames 36700...
13117
+ [2024-11-07 16:40:11,436][14395] Avg episode rewards: #0: 4.457, true rewards: #0: 4.040
13118
+ [2024-11-07 16:40:11,441][14395] Avg episode reward: 4.457, avg true_objective: 4.040
13119
+ [2024-11-07 16:40:11,565][14395] Num frames 36800...
13120
+ [2024-11-07 16:40:11,797][14395] Num frames 36900...
13121
+ [2024-11-07 16:40:12,052][14395] Num frames 37000...
13122
+ [2024-11-07 16:40:12,278][14395] Num frames 37100...
13123
+ [2024-11-07 16:40:12,530][14395] Avg episode rewards: #0: 4.465, true rewards: #0: 4.041
13124
+ [2024-11-07 16:40:12,532][14395] Avg episode reward: 4.465, avg true_objective: 4.041
13125
+ [2024-11-07 16:40:12,613][14395] Num frames 37200...
13126
+ [2024-11-07 16:40:12,878][14395] Num frames 37300...
13127
+ [2024-11-07 16:40:13,126][14395] Num frames 37400...
13128
+ [2024-11-07 16:40:13,376][14395] Num frames 37500...
13129
+ [2024-11-07 16:40:13,563][14395] Avg episode rewards: #0: 4.458, true rewards: #0: 4.039
13130
+ [2024-11-07 16:40:13,567][14395] Avg episode reward: 4.458, avg true_objective: 4.039
13131
+ [2024-11-07 16:40:13,736][14395] Num frames 37600...
13132
+ [2024-11-07 16:40:14,160][14395] Num frames 37700...
13133
+ [2024-11-07 16:40:14,618][14395] Num frames 37800...
13134
+ [2024-11-07 16:40:15,004][14395] Num frames 37900...
13135
+ [2024-11-07 16:40:15,217][14395] Avg episode rewards: #0: 4.451, true rewards: #0: 4.037
13136
+ [2024-11-07 16:40:15,219][14395] Avg episode reward: 4.451, avg true_objective: 4.037
13137
+ [2024-11-07 16:40:15,421][14395] Num frames 38000...
13138
+ [2024-11-07 16:40:15,751][14395] Num frames 38100...
13139
+ [2024-11-07 16:40:16,085][14395] Num frames 38200...
13140
+ [2024-11-07 16:40:16,413][14395] Num frames 38300...
13141
+ [2024-11-07 16:40:16,628][14395] Avg episode rewards: #0: 4.445, true rewards: #0: 4.035
13142
+ [2024-11-07 16:40:16,630][14395] Avg episode reward: 4.445, avg true_objective: 4.035
13143
+ [2024-11-07 16:40:16,869][14395] Num frames 38400...
13144
+ [2024-11-07 16:40:17,155][14395] Num frames 38500...
13145
+ [2024-11-07 16:40:17,590][14395] Num frames 38600...
13146
+ [2024-11-07 16:40:17,879][14395] Num frames 38700...
13147
+ [2024-11-07 16:40:18,116][14395] Avg episode rewards: #0: 4.439, true rewards: #0: 4.032
13148
+ [2024-11-07 16:40:18,119][14395] Avg episode reward: 4.439, avg true_objective: 4.032
13149
+ [2024-11-07 16:40:18,451][14395] Num frames 38800...
13150
+ [2024-11-07 16:40:18,914][14395] Num frames 38900...
13151
+ [2024-11-07 16:40:19,263][14395] Num frames 39000...
13152
+ [2024-11-07 16:40:19,348][14395] Avg episode rewards: #0: 4.423, true rewards: #0: 4.021
13153
+ [2024-11-07 16:40:19,352][14395] Avg episode reward: 4.423, avg true_objective: 4.021
13154
+ [2024-11-07 16:40:19,652][14395] Num frames 39100...
13155
+ [2024-11-07 16:40:20,207][14395] Num frames 39200...
13156
+ [2024-11-07 16:40:20,672][14395] Num frames 39300...
13157
+ [2024-11-07 16:40:21,081][14395] Avg episode rewards: #0: 4.417, true rewards: #0: 4.019
13158
+ [2024-11-07 16:40:21,084][14395] Avg episode reward: 4.417, avg true_objective: 4.019
13159
+ [2024-11-07 16:40:21,151][14395] Num frames 39400...
13160
+ [2024-11-07 16:40:21,469][14395] Num frames 39500...
13161
+ [2024-11-07 16:40:21,902][14395] Num frames 39600...
13162
+ [2024-11-07 16:40:22,256][14395] Num frames 39700...
13163
+ [2024-11-07 16:40:22,517][14395] Avg episode rewards: #0: 4.418, true rewards: #0: 4.014
13164
+ [2024-11-07 16:40:22,522][14395] Avg episode reward: 4.418, avg true_objective: 4.014
13165
+ [2024-11-07 16:40:23,010][14395] Num frames 39800...
13166
+ [2024-11-07 16:40:23,597][14395] Num frames 39900...
13167
+ [2024-11-07 16:40:24,040][14395] Num frames 40000...
13168
+ [2024-11-07 16:40:24,480][14395] Num frames 40100...
13169
+ [2024-11-07 16:40:24,664][14395] Avg episode rewards: #0: 4.412, true rewards: #0: 4.012
13170
+ [2024-11-07 16:40:24,668][14395] Avg episode reward: 4.412, avg true_objective: 4.012
13171
+ [2024-11-07 16:42:52,173][14395] Replay video saved to /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/replay.mp4!
13172
+ [2024-11-07 16:42:52,298][14395] Loading existing experiment configuration from /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/config.json
13173
+ [2024-11-07 16:42:52,301][14395] Overriding arg 'num_workers' with value 1 passed from command line
13174
+ [2024-11-07 16:42:52,303][14395] Adding new argument 'no_render'=True that is not in the saved config file!
13175
+ [2024-11-07 16:42:52,304][14395] Adding new argument 'save_video'=True that is not in the saved config file!
13176
+ [2024-11-07 16:42:52,307][14395] Adding new argument 'video_frames'=1000000000.0 that is not in the saved config file!
13177
+ [2024-11-07 16:42:52,309][14395] Adding new argument 'video_name'=None that is not in the saved config file!
13178
+ [2024-11-07 16:42:52,311][14395] Adding new argument 'max_num_frames'=100000 that is not in the saved config file!
13179
+ [2024-11-07 16:42:52,313][14395] Adding new argument 'max_num_episodes'=100 that is not in the saved config file!
13180
+ [2024-11-07 16:42:52,313][14395] Adding new argument 'push_to_hub'=True that is not in the saved config file!
13181
+ [2024-11-07 16:42:52,316][14395] Adding new argument 'hf_repository'='alidenewade/rl_course_vizdoom_health_gathering_supreme' that is not in the saved config file!
13182
+ [2024-11-07 16:42:52,319][14395] Adding new argument 'policy_index'=0 that is not in the saved config file!
13183
+ [2024-11-07 16:42:52,320][14395] Adding new argument 'eval_deterministic'=False that is not in the saved config file!
13184
+ [2024-11-07 16:42:52,321][14395] Adding new argument 'train_script'=None that is not in the saved config file!
13185
+ [2024-11-07 16:42:52,326][14395] Adding new argument 'enjoy_script'=None that is not in the saved config file!
13186
+ [2024-11-07 16:42:52,333][14395] Using frameskip 1 and render_action_repeat=4 for evaluation
13187
+ [2024-11-07 16:42:52,377][14395] RunningMeanStd input shape: (3, 72, 128)
13188
+ [2024-11-07 16:42:52,379][14395] RunningMeanStd input shape: (1,)
13189
+ [2024-11-07 16:42:52,432][14395] ConvEncoder: input_channels=3
13190
+ [2024-11-07 16:42:52,500][14395] Conv encoder output size: 512
13191
+ [2024-11-07 16:42:52,502][14395] Policy head output size: 512
13192
+ [2024-11-07 16:42:52,549][14395] Loading state from checkpoint /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/checkpoint_p0/checkpoint_000004884_20004864.pth...
13193
+ [2024-11-07 16:42:53,432][14395] Num frames 100...
13194
+ [2024-11-07 16:42:53,681][14395] Num frames 200...
13195
+ [2024-11-07 16:42:53,926][14395] Num frames 300...
13196
+ [2024-11-07 16:42:54,198][14395] Num frames 400...
13197
+ [2024-11-07 16:42:54,426][14395] Avg episode rewards: #0: 6.600, true rewards: #0: 4.600
13198
+ [2024-11-07 16:42:54,427][14395] Avg episode reward: 6.600, avg true_objective: 4.600
13199
+ [2024-11-07 16:42:54,524][14395] Num frames 500...
13200
+ [2024-11-07 16:42:54,766][14395] Num frames 600...
13201
+ [2024-11-07 16:42:55,021][14395] Num frames 700...
13202
+ [2024-11-07 16:42:55,280][14395] Num frames 800...
13203
+ [2024-11-07 16:42:55,441][14395] Avg episode rewards: #0: 5.220, true rewards: #0: 4.220
13204
+ [2024-11-07 16:42:55,444][14395] Avg episode reward: 5.220, avg true_objective: 4.220
13205
+ [2024-11-07 16:42:55,579][14395] Num frames 900...
13206
+ [2024-11-07 16:42:55,815][14395] Num frames 1000...
13207
+ [2024-11-07 16:42:56,071][14395] Num frames 1100...
13208
+ [2024-11-07 16:42:56,364][14395] Num frames 1200...
13209
+ [2024-11-07 16:42:56,569][14395] Avg episode rewards: #0: 4.867, true rewards: #0: 4.200
13210
+ [2024-11-07 16:42:56,572][14395] Avg episode reward: 4.867, avg true_objective: 4.200
13211
+ [2024-11-07 16:42:56,665][14395] Num frames 1300...
13212
+ [2024-11-07 16:42:56,904][14395] Num frames 1400...
13213
+ [2024-11-07 16:42:57,165][14395] Num frames 1500...
13214
+ [2024-11-07 16:42:57,419][14395] Num frames 1600...
13215
+ [2024-11-07 16:42:57,572][14395] Avg episode rewards: #0: 4.610, true rewards: #0: 4.110
13216
+ [2024-11-07 16:42:57,578][14395] Avg episode reward: 4.610, avg true_objective: 4.110
13217
+ [2024-11-07 16:42:57,716][14395] Num frames 1700...
13218
+ [2024-11-07 16:42:57,969][14395] Num frames 1800...
13219
+ [2024-11-07 16:42:58,220][14395] Num frames 1900...
13220
+ [2024-11-07 16:42:58,458][14395] Num frames 2000...
13221
+ [2024-11-07 16:42:58,585][14395] Avg episode rewards: #0: 4.456, true rewards: #0: 4.056
13222
+ [2024-11-07 16:42:58,586][14395] Avg episode reward: 4.456, avg true_objective: 4.056
13223
+ [2024-11-07 16:42:58,763][14395] Num frames 2100...
13224
+ [2024-11-07 16:42:59,029][14395] Num frames 2200...
13225
+ [2024-11-07 16:42:59,309][14395] Num frames 2300...
13226
+ [2024-11-07 16:42:59,669][14395] Num frames 2400...
13227
+ [2024-11-07 16:42:59,882][14395] Avg episode rewards: #0: 4.573, true rewards: #0: 4.073
13228
+ [2024-11-07 16:42:59,885][14395] Avg episode reward: 4.573, avg true_objective: 4.073
13229
+ [2024-11-07 16:43:00,091][14395] Num frames 2500...
13230
+ [2024-11-07 16:43:03,038][14395] Num frames 2600...
13231
+ [2024-11-07 16:43:03,323][14395] Num frames 2700...
13232
+ [2024-11-07 16:43:03,597][14395] Num frames 2800...
13233
+ [2024-11-07 16:43:03,909][14395] Avg episode rewards: #0: 4.703, true rewards: #0: 4.131
13234
+ [2024-11-07 16:43:03,913][14395] Avg episode reward: 4.703, avg true_objective: 4.131
13235
+ [2024-11-07 16:43:03,943][14395] Num frames 2900...
13236
+ [2024-11-07 16:43:04,216][14395] Num frames 3000...
13237
+ [2024-11-07 16:43:04,504][14395] Num frames 3100...
13238
+ [2024-11-07 16:43:04,783][14395] Num frames 3200...
13239
+ [2024-11-07 16:43:05,053][14395] Avg episode rewards: #0: 4.595, true rewards: #0: 4.095
13240
+ [2024-11-07 16:43:05,057][14395] Avg episode reward: 4.595, avg true_objective: 4.095
13241
+ [2024-11-07 16:43:05,120][14395] Num frames 3300...
13242
+ [2024-11-07 16:43:05,404][14395] Num frames 3400...
13243
+ [2024-11-07 16:43:05,702][14395] Num frames 3500...
13244
+ [2024-11-07 16:43:06,017][14395] Num frames 3600...
13245
+ [2024-11-07 16:43:06,280][14395] Num frames 3700...
13246
+ [2024-11-07 16:43:06,396][14395] Avg episode rewards: #0: 4.693, true rewards: #0: 4.138
13247
+ [2024-11-07 16:43:06,404][14395] Avg episode reward: 4.693, avg true_objective: 4.138
13248
+ [2024-11-07 16:43:06,606][14395] Num frames 3800...
13249
+ [2024-11-07 16:43:06,884][14395] Num frames 3900...
13250
+ [2024-11-07 16:43:07,163][14395] Num frames 4000...
13251
+ [2024-11-07 16:43:07,433][14395] Num frames 4100...
13252
+ [2024-11-07 16:43:07,514][14395] Avg episode rewards: #0: 4.608, true rewards: #0: 4.108
13253
+ [2024-11-07 16:43:07,515][14395] Avg episode reward: 4.608, avg true_objective: 4.108
13254
+ [2024-11-07 16:43:07,760][14395] Num frames 4200...
13255
+ [2024-11-07 16:43:08,040][14395] Num frames 4300...
13256
+ [2024-11-07 16:43:08,325][14395] Num frames 4400...
13257
+ [2024-11-07 16:43:08,632][14395] Avg episode rewards: #0: 4.538, true rewards: #0: 4.084
13258
+ [2024-11-07 16:43:08,634][14395] Avg episode reward: 4.538, avg true_objective: 4.084
13259
+ [2024-11-07 16:43:08,668][14395] Num frames 4500...
13260
+ [2024-11-07 16:43:09,113][14395] Num frames 4600...
13261
+ [2024-11-07 16:43:09,391][14395] Num frames 4700...
13262
+ [2024-11-07 16:43:09,686][14395] Num frames 4800...
13263
+ [2024-11-07 16:43:09,976][14395] Num frames 4900...
13264
+ [2024-11-07 16:43:10,262][14395] Num frames 5000...
13265
+ [2024-11-07 16:43:10,587][14395] Num frames 5100...
13266
+ [2024-11-07 16:43:10,639][14395] Avg episode rewards: #0: 4.917, true rewards: #0: 4.250
13267
+ [2024-11-07 16:43:10,642][14395] Avg episode reward: 4.917, avg true_objective: 4.250
13268
+ [2024-11-07 16:43:10,931][14395] Num frames 5200...
13269
+ [2024-11-07 16:43:11,227][14395] Num frames 5300...
13270
+ [2024-11-07 16:43:11,517][14395] Num frames 5400...
13271
+ [2024-11-07 16:43:11,783][14395] Avg episode rewards: #0: 4.834, true rewards: #0: 4.218
13272
+ [2024-11-07 16:43:11,788][14395] Avg episode reward: 4.834, avg true_objective: 4.218
13273
+ [2024-11-07 16:43:11,847][14395] Num frames 5500...
13274
+ [2024-11-07 16:43:12,083][14395] Num frames 5600...
13275
+ [2024-11-07 16:43:12,373][14395] Num frames 5700...
13276
+ [2024-11-07 16:43:12,715][14395] Num frames 5800...
13277
+ [2024-11-07 16:43:12,965][14395] Avg episode rewards: #0: 4.763, true rewards: #0: 4.191
13278
+ [2024-11-07 16:43:12,966][14395] Avg episode reward: 4.763, avg true_objective: 4.191
13279
+ [2024-11-07 16:43:13,050][14395] Num frames 5900...
13280
+ [2024-11-07 16:43:13,375][14395] Num frames 6000...
13281
+ [2024-11-07 16:43:13,662][14395] Num frames 6100...
13282
+ [2024-11-07 16:43:13,901][14395] Num frames 6200...
13283
+ [2024-11-07 16:43:14,078][14395] Avg episode rewards: #0: 4.701, true rewards: #0: 4.168
13284
+ [2024-11-07 16:43:14,080][14395] Avg episode reward: 4.701, avg true_objective: 4.168
13285
+ [2024-11-07 16:43:14,198][14395] Num frames 6300...
13286
+ [2024-11-07 16:43:14,440][14395] Num frames 6400...
13287
+ [2024-11-07 16:43:14,687][14395] Num frames 6500...
13288
+ [2024-11-07 16:43:14,918][14395] Num frames 6600...
13289
+ [2024-11-07 16:43:15,066][14395] Avg episode rewards: #0: 4.648, true rewards: #0: 4.147
13290
+ [2024-11-07 16:43:15,067][14395] Avg episode reward: 4.648, avg true_objective: 4.147
13291
+ [2024-11-07 16:43:15,237][14395] Num frames 6700...
13292
+ [2024-11-07 16:43:15,491][14395] Num frames 6800...
13293
+ [2024-11-07 16:43:15,713][14395] Num frames 6900...
13294
+ [2024-11-07 16:43:15,943][14395] Num frames 7000...
13295
+ [2024-11-07 16:43:16,047][14395] Avg episode rewards: #0: 4.600, true rewards: #0: 4.129
13296
+ [2024-11-07 16:43:16,054][14395] Avg episode reward: 4.600, avg true_objective: 4.129
13297
+ [2024-11-07 16:43:16,296][14395] Num frames 7100...
13298
+ [2024-11-07 16:43:16,650][14395] Num frames 7200...
13299
+ [2024-11-07 16:43:16,964][14395] Num frames 7300...
13300
+ [2024-11-07 16:43:17,229][14395] Num frames 7400...
13301
+ [2024-11-07 16:43:17,387][14395] Avg episode rewards: #0: 4.631, true rewards: #0: 4.131
13302
+ [2024-11-07 16:43:17,389][14395] Avg episode reward: 4.631, avg true_objective: 4.131
13303
+ [2024-11-07 16:43:17,632][14395] Num frames 7500...
13304
+ [2024-11-07 16:43:17,974][14395] Num frames 7600...
13305
+ [2024-11-07 16:43:18,230][14395] Num frames 7700...
13306
+ [2024-11-07 16:43:18,591][14395] Num frames 7800...
13307
+ [2024-11-07 16:43:18,759][14395] Avg episode rewards: #0: 4.589, true rewards: #0: 4.116
13308
+ [2024-11-07 16:43:18,761][14395] Avg episode reward: 4.589, avg true_objective: 4.116
13309
+ [2024-11-07 16:43:19,087][14395] Num frames 7900...
13310
+ [2024-11-07 16:43:19,439][14395] Num frames 8000...
13311
+ [2024-11-07 16:43:19,872][14395] Num frames 8100...
13312
+ [2024-11-07 16:43:20,248][14395] Num frames 8200...
13313
+ [2024-11-07 16:43:20,327][14395] Avg episode rewards: #0: 4.552, true rewards: #0: 4.102
13314
+ [2024-11-07 16:43:20,329][14395] Avg episode reward: 4.552, avg true_objective: 4.102
13315
+ [2024-11-07 16:43:20,662][14395] Num frames 8300...
13316
+ [2024-11-07 16:43:21,000][14395] Num frames 8400...
13317
+ [2024-11-07 16:43:21,438][14395] Num frames 8500...
13318
+ [2024-11-07 16:43:21,712][14395] Num frames 8600...
13319
+ [2024-11-07 16:43:21,920][14395] Avg episode rewards: #0: 4.596, true rewards: #0: 4.120
13320
+ [2024-11-07 16:43:21,923][14395] Avg episode reward: 4.596, avg true_objective: 4.120
13321
+ [2024-11-07 16:43:22,187][14395] Num frames 8700...
13322
+ [2024-11-07 16:43:22,633][14395] Num frames 8800...
13323
+ [2024-11-07 16:43:22,980][14395] Num frames 8900...
13324
+ [2024-11-07 16:43:23,540][14395] Num frames 9000...
13325
+ [2024-11-07 16:43:23,760][14395] Avg episode rewards: #0: 4.562, true rewards: #0: 4.107
13326
+ [2024-11-07 16:43:23,764][14395] Avg episode reward: 4.562, avg true_objective: 4.107
13327
+ [2024-11-07 16:43:24,011][14395] Num frames 9100...
13328
+ [2024-11-07 16:43:24,506][14395] Num frames 9200...
13329
+ [2024-11-07 16:43:24,865][14395] Num frames 9300...
13330
+ [2024-11-07 16:43:25,201][14395] Num frames 9400...
13331
+ [2024-11-07 16:43:25,481][14395] Avg episode rewards: #0: 4.544, true rewards: #0: 4.110
13332
+ [2024-11-07 16:43:25,482][14395] Avg episode reward: 4.544, avg true_objective: 4.110
13333
+ [2024-11-07 16:43:25,653][14395] Num frames 9500...
13334
+ [2024-11-07 16:43:25,932][14395] Num frames 9600...
13335
+ [2024-11-07 16:43:26,183][14395] Num frames 9700...
13336
+ [2024-11-07 16:43:26,425][14395] Num frames 9800...
13337
+ [2024-11-07 16:43:26,571][14395] Avg episode rewards: #0: 4.515, true rewards: #0: 4.098
13338
+ [2024-11-07 16:43:26,574][14395] Avg episode reward: 4.515, avg true_objective: 4.098
13339
+ [2024-11-07 16:43:26,816][14395] Num frames 9900...
13340
+ [2024-11-07 16:43:27,096][14395] Num frames 10000...
13341
+ [2024-11-07 16:43:27,339][14395] Num frames 10100...
13342
+ [2024-11-07 16:43:27,661][14395] Num frames 10200...
13343
+ [2024-11-07 16:43:27,836][14395] Avg episode rewards: #0: 4.488, true rewards: #0: 4.088
13344
+ [2024-11-07 16:43:27,839][14395] Avg episode reward: 4.488, avg true_objective: 4.088
13345
+ [2024-11-07 16:43:28,120][14395] Num frames 10300...
13346
+ [2024-11-07 16:43:28,477][14395] Num frames 10400...
13347
+ [2024-11-07 16:43:28,758][14395] Num frames 10500...
13348
+ [2024-11-07 16:43:29,031][14395] Num frames 10600...
13349
+ [2024-11-07 16:43:29,183][14395] Avg episode rewards: #0: 4.514, true rewards: #0: 4.091
13350
+ [2024-11-07 16:43:29,189][14395] Avg episode reward: 4.514, avg true_objective: 4.091
13351
+ [2024-11-07 16:43:29,399][14395] Num frames 10700...
13352
+ [2024-11-07 16:43:29,793][14395] Num frames 10800...
13353
+ [2024-11-07 16:43:30,114][14395] Num frames 10900...
13354
+ [2024-11-07 16:43:30,450][14395] Num frames 11000...
13355
+ [2024-11-07 16:43:30,750][14395] Avg episode rewards: #0: 4.550, true rewards: #0: 4.105
13356
+ [2024-11-07 16:43:30,786][14395] Avg episode reward: 4.550, avg true_objective: 4.105
13357
+ [2024-11-07 16:43:30,847][14395] Num frames 11100...
13358
+ [2024-11-07 16:43:31,099][14395] Num frames 11200...
13359
+ [2024-11-07 16:43:31,355][14395] Num frames 11300...
13360
+ [2024-11-07 16:43:31,591][14395] Num frames 11400...
13361
+ [2024-11-07 16:43:31,830][14395] Avg episode rewards: #0: 4.524, true rewards: #0: 4.096
13362
+ [2024-11-07 16:43:31,832][14395] Avg episode reward: 4.524, avg true_objective: 4.096
13363
+ [2024-11-07 16:43:31,909][14395] Num frames 11500...
13364
+ [2024-11-07 16:43:32,177][14395] Num frames 11600...
13365
+ [2024-11-07 16:43:32,444][14395] Num frames 11700...
13366
+ [2024-11-07 16:43:32,687][14395] Num frames 11800...
13367
+ [2024-11-07 16:43:32,945][14395] Num frames 11900...
13368
+ [2024-11-07 16:43:33,042][14395] Avg episode rewards: #0: 4.592, true rewards: #0: 4.109
13369
+ [2024-11-07 16:43:33,050][14395] Avg episode reward: 4.592, avg true_objective: 4.109
13370
+ [2024-11-07 16:43:33,303][14395] Num frames 12000...
13371
+ [2024-11-07 16:43:33,606][14395] Num frames 12100...
13372
+ [2024-11-07 16:43:33,849][14395] Num frames 12200...
13373
+ [2024-11-07 16:43:34,120][14395] Num frames 12300...
13374
+ [2024-11-07 16:43:34,248][14395] Avg episode rewards: #0: 4.577, true rewards: #0: 4.111
13375
+ [2024-11-07 16:43:34,251][14395] Avg episode reward: 4.577, avg true_objective: 4.111
13376
+ [2024-11-07 16:43:34,442][14395] Num frames 12400...
13377
+ [2024-11-07 16:43:34,696][14395] Num frames 12500...
13378
+ [2024-11-07 16:43:34,937][14395] Num frames 12600...
13379
+ [2024-11-07 16:43:37,515][14395] Num frames 12700...
13380
+ [2024-11-07 16:43:37,627][14395] Avg episode rewards: #0: 4.554, true rewards: #0: 4.102
13381
+ [2024-11-07 16:43:37,632][14395] Avg episode reward: 4.554, avg true_objective: 4.102
13382
+ [2024-11-07 16:43:37,883][14395] Num frames 12800...
13383
+ [2024-11-07 16:43:38,153][14395] Num frames 12900...
13384
+ [2024-11-07 16:43:38,417][14395] Num frames 13000...
13385
+ [2024-11-07 16:43:38,772][14395] Num frames 13100...
13386
+ [2024-11-07 16:43:38,825][14395] Avg episode rewards: #0: 4.531, true rewards: #0: 4.094
13387
+ [2024-11-07 16:43:38,829][14395] Avg episode reward: 4.531, avg true_objective: 4.094
13388
+ [2024-11-07 16:43:39,125][14395] Num frames 13200...
13389
+ [2024-11-07 16:43:39,466][14395] Num frames 13300...
13390
+ [2024-11-07 16:43:39,754][14395] Num frames 13400...
13391
+ [2024-11-07 16:43:40,055][14395] Avg episode rewards: #0: 4.510, true rewards: #0: 4.086
13392
+ [2024-11-07 16:43:40,062][14395] Avg episode reward: 4.510, avg true_objective: 4.086
13393
+ [2024-11-07 16:43:40,114][14395] Num frames 13500...
13394
+ [2024-11-07 16:43:40,366][14395] Num frames 13600...
13395
+ [2024-11-07 16:43:40,631][14395] Num frames 13700...
13396
+ [2024-11-07 16:43:40,882][14395] Num frames 13800...
13397
+ [2024-11-07 16:43:41,119][14395] Avg episode rewards: #0: 4.491, true rewards: #0: 4.079
13398
+ [2024-11-07 16:43:41,125][14395] Avg episode reward: 4.491, avg true_objective: 4.079
13399
+ [2024-11-07 16:43:41,221][14395] Num frames 13900...
13400
+ [2024-11-07 16:43:41,452][14395] Num frames 14000...
13401
+ [2024-11-07 16:43:41,783][14395] Num frames 14100...
13402
+ [2024-11-07 16:43:42,099][14395] Num frames 14200...
13403
+ [2024-11-07 16:43:42,325][14395] Avg episode rewards: #0: 4.472, true rewards: #0: 4.072
13404
+ [2024-11-07 16:43:42,327][14395] Avg episode reward: 4.472, avg true_objective: 4.072
13405
+ [2024-11-07 16:43:42,479][14395] Num frames 14300...
13406
+ [2024-11-07 16:43:42,827][14395] Num frames 14400...
13407
+ [2024-11-07 16:43:43,136][14395] Num frames 14500...
13408
+ [2024-11-07 16:43:43,429][14395] Num frames 14600...
13409
+ [2024-11-07 16:43:43,732][14395] Num frames 14700...
13410
+ [2024-11-07 16:43:44,094][14395] Avg episode rewards: #0: 4.554, true rewards: #0: 4.110
13411
+ [2024-11-07 16:43:44,096][14395] Avg episode reward: 4.554, avg true_objective: 4.110
13412
+ [2024-11-07 16:43:44,118][14395] Num frames 14800...
13413
+ [2024-11-07 16:43:44,402][14395] Num frames 14900...
13414
+ [2024-11-07 16:43:44,664][14395] Num frames 15000...
13415
+ [2024-11-07 16:43:44,944][14395] Num frames 15100...
13416
+ [2024-11-07 16:43:45,199][14395] Num frames 15200...
13417
+ [2024-11-07 16:43:45,394][14395] Avg episode rewards: #0: 4.579, true rewards: #0: 4.120
13418
+ [2024-11-07 16:43:45,395][14395] Avg episode reward: 4.579, avg true_objective: 4.120
13419
+ [2024-11-07 16:43:45,560][14395] Num frames 15300...
13420
+ [2024-11-07 16:43:45,872][14395] Num frames 15400...
13421
+ [2024-11-07 16:43:46,141][14395] Num frames 15500...
13422
+ [2024-11-07 16:43:46,193][14395] Avg episode rewards: #0: 4.526, true rewards: #0: 4.079
13423
+ [2024-11-07 16:43:46,195][14395] Avg episode reward: 4.526, avg true_objective: 4.079
13424
+ [2024-11-07 16:43:46,470][14395] Num frames 15600...
13425
+ [2024-11-07 16:43:46,712][14395] Num frames 15700...
13426
+ [2024-11-07 16:43:46,968][14395] Num frames 15800...
13427
+ [2024-11-07 16:43:47,285][14395] Num frames 15900...
13428
+ [2024-11-07 16:43:47,461][14395] Avg episode rewards: #0: 4.551, true rewards: #0: 4.089
13429
+ [2024-11-07 16:43:47,466][14395] Avg episode reward: 4.551, avg true_objective: 4.089
13430
+ [2024-11-07 16:43:47,613][14395] Num frames 16000...
13431
+ [2024-11-07 16:43:47,932][14395] Num frames 16100...
13432
+ [2024-11-07 16:43:48,189][14395] Num frames 16200...
13433
+ [2024-11-07 16:43:48,417][14395] Num frames 16300...
13434
+ [2024-11-07 16:43:48,557][14395] Avg episode rewards: #0: 4.533, true rewards: #0: 4.083
13435
+ [2024-11-07 16:43:48,561][14395] Avg episode reward: 4.533, avg true_objective: 4.083
13436
+ [2024-11-07 16:43:48,731][14395] Num frames 16400...
13437
+ [2024-11-07 16:43:48,971][14395] Num frames 16500...
13438
+ [2024-11-07 16:43:49,208][14395] Num frames 16600...
13439
+ [2024-11-07 16:43:49,448][14395] Num frames 16700...
13440
+ [2024-11-07 16:43:49,545][14395] Avg episode rewards: #0: 4.516, true rewards: #0: 4.077
13441
+ [2024-11-07 16:43:49,547][14395] Avg episode reward: 4.516, avg true_objective: 4.077
13442
+ [2024-11-07 16:43:49,738][14395] Num frames 16800...
13443
+ [2024-11-07 16:43:49,989][14395] Num frames 16900...
13444
+ [2024-11-07 16:43:50,222][14395] Num frames 17000...
13445
+ [2024-11-07 16:43:50,479][14395] Num frames 17100...
13446
+ [2024-11-07 16:43:50,532][14395] Avg episode rewards: #0: 4.500, true rewards: #0: 4.071
13447
+ [2024-11-07 16:43:50,533][14395] Avg episode reward: 4.500, avg true_objective: 4.071
13448
+ [2024-11-07 16:43:50,799][14395] Num frames 17200...
13449
+ [2024-11-07 16:43:51,077][14395] Num frames 17300...
13450
+ [2024-11-07 16:43:51,330][14395] Num frames 17400...
13451
+ [2024-11-07 16:43:51,589][14395] Avg episode rewards: #0: 4.485, true rewards: #0: 4.066
13452
+ [2024-11-07 16:43:51,591][14395] Avg episode reward: 4.485, avg true_objective: 4.066
13453
+ [2024-11-07 16:43:51,650][14395] Num frames 17500...
13454
+ [2024-11-07 16:43:51,906][14395] Num frames 17600...
13455
+ [2024-11-07 16:43:52,141][14395] Num frames 17700...
13456
+ [2024-11-07 16:43:52,376][14395] Num frames 17800...
13457
+ [2024-11-07 16:43:52,604][14395] Avg episode rewards: #0: 4.470, true rewards: #0: 4.061
13458
+ [2024-11-07 16:43:52,605][14395] Avg episode reward: 4.470, avg true_objective: 4.061
13459
+ [2024-11-07 16:43:52,706][14395] Num frames 17900...
13460
+ [2024-11-07 16:43:52,985][14395] Num frames 18000...
13461
+ [2024-11-07 16:43:53,239][14395] Num frames 18100...
13462
+ [2024-11-07 16:43:53,504][14395] Num frames 18200...
13463
+ [2024-11-07 16:43:53,718][14395] Avg episode rewards: #0: 4.456, true rewards: #0: 4.056
13464
+ [2024-11-07 16:43:53,721][14395] Avg episode reward: 4.456, avg true_objective: 4.056
13465
+ [2024-11-07 16:43:53,867][14395] Num frames 18300...
13466
+ [2024-11-07 16:43:54,129][14395] Num frames 18400...
13467
+ [2024-11-07 16:43:54,374][14395] Num frames 18500...
13468
+ [2024-11-07 16:43:54,639][14395] Num frames 18600...
13469
+ [2024-11-07 16:43:54,779][14395] Avg episode rewards: #0: 4.443, true rewards: #0: 4.051
13470
+ [2024-11-07 16:43:54,781][14395] Avg episode reward: 4.443, avg true_objective: 4.051
13471
+ [2024-11-07 16:43:54,947][14395] Num frames 18700...
13472
+ [2024-11-07 16:43:55,188][14395] Num frames 18800...
13473
+ [2024-11-07 16:43:55,428][14395] Num frames 18900...
13474
+ [2024-11-07 16:43:55,675][14395] Num frames 19000...
13475
+ [2024-11-07 16:43:55,775][14395] Avg episode rewards: #0: 4.430, true rewards: #0: 4.047
13476
+ [2024-11-07 16:43:55,777][14395] Avg episode reward: 4.430, avg true_objective: 4.047
13477
+ [2024-11-07 16:43:55,989][14395] Num frames 19100...
13478
+ [2024-11-07 16:43:56,239][14395] Num frames 19200...
13479
+ [2024-11-07 16:43:56,477][14395] Num frames 19300...
13480
+ [2024-11-07 16:43:56,717][14395] Num frames 19400...
13481
+ [2024-11-07 16:43:56,786][14395] Avg episode rewards: #0: 4.418, true rewards: #0: 4.042
13482
+ [2024-11-07 16:43:56,793][14395] Avg episode reward: 4.418, avg true_objective: 4.042
13483
+ [2024-11-07 16:43:57,047][14395] Num frames 19500...
13484
+ [2024-11-07 16:43:57,271][14395] Num frames 19600...
13485
+ [2024-11-07 16:43:57,515][14395] Num frames 19700...
13486
+ [2024-11-07 16:43:57,801][14395] Avg episode rewards: #0: 4.406, true rewards: #0: 4.038
13487
+ [2024-11-07 16:43:57,805][14395] Avg episode reward: 4.406, avg true_objective: 4.038
13488
+ [2024-11-07 16:43:57,845][14395] Num frames 19800...
13489
+ [2024-11-07 16:43:58,084][14395] Num frames 19900...
13490
+ [2024-11-07 16:43:58,338][14395] Num frames 20000...
13491
+ [2024-11-07 16:43:58,516][14395] Avg episode rewards: #0: 4.369, true rewards: #0: 4.009
13492
+ [2024-11-07 16:43:58,519][14395] Avg episode reward: 4.369, avg true_objective: 4.009
13493
+ [2024-11-07 16:43:58,691][14395] Num frames 20100...
13494
+ [2024-11-07 16:43:58,939][14395] Num frames 20200...
13495
+ [2024-11-07 16:43:59,190][14395] Num frames 20300...
13496
+ [2024-11-07 16:43:59,448][14395] Num frames 20400...
13497
+ [2024-11-07 16:43:59,712][14395] Num frames 20500...
13498
+ [2024-11-07 16:44:00,013][14395] Avg episode rewards: #0: 4.429, true rewards: #0: 4.037
13499
+ [2024-11-07 16:44:00,014][14395] Avg episode reward: 4.429, avg true_objective: 4.037
13500
+ [2024-11-07 16:44:00,064][14395] Num frames 20600...
13501
+ [2024-11-07 16:44:00,491][14395] Num frames 20700...
13502
+ [2024-11-07 16:44:00,759][14395] Num frames 20800...
13503
+ [2024-11-07 16:44:01,052][14395] Num frames 20900...
13504
+ [2024-11-07 16:44:01,278][14395] Num frames 21000...
13505
+ [2024-11-07 16:44:01,422][14395] Avg episode rewards: #0: 4.449, true rewards: #0: 4.045
13506
+ [2024-11-07 16:44:01,425][14395] Avg episode reward: 4.449, avg true_objective: 4.045
13507
+ [2024-11-07 16:44:01,586][14395] Num frames 21100...
13508
+ [2024-11-07 16:44:01,818][14395] Num frames 21200...
13509
+ [2024-11-07 16:44:02,029][14395] Num frames 21300...
13510
+ [2024-11-07 16:44:02,277][14395] Num frames 21400...
13511
+ [2024-11-07 16:44:02,395][14395] Avg episode rewards: #0: 4.438, true rewards: #0: 4.042
13512
+ [2024-11-07 16:44:02,397][14395] Avg episode reward: 4.438, avg true_objective: 4.042
13513
+ [2024-11-07 16:44:02,581][14395] Num frames 21500...
13514
+ [2024-11-07 16:44:02,813][14395] Num frames 21600...
13515
+ [2024-11-07 16:44:03,051][14395] Num frames 21700...
13516
+ [2024-11-07 16:44:03,323][14395] Num frames 21800...
13517
+ [2024-11-07 16:44:03,393][14395] Avg episode rewards: #0: 4.427, true rewards: #0: 4.038
13518
+ [2024-11-07 16:44:03,396][14395] Avg episode reward: 4.427, avg true_objective: 4.038
13519
+ [2024-11-07 16:44:03,673][14395] Num frames 21900...
13520
+ [2024-11-07 16:44:03,922][14395] Num frames 22000...
13521
+ [2024-11-07 16:44:04,176][14395] Num frames 22100...
13522
+ [2024-11-07 16:44:04,474][14395] Avg episode rewards: #0: 4.416, true rewards: #0: 4.034
13523
+ [2024-11-07 16:44:04,480][14395] Avg episode reward: 4.416, avg true_objective: 4.034
13524
+ [2024-11-07 16:44:04,534][14395] Num frames 22200...
13525
+ [2024-11-07 16:44:04,779][14395] Num frames 22300...
13526
+ [2024-11-07 16:44:05,020][14395] Num frames 22400...
13527
+ [2024-11-07 16:44:05,312][14395] Num frames 22500...
13528
+ [2024-11-07 16:44:05,648][14395] Num frames 22600...
13529
+ [2024-11-07 16:44:05,715][14395] Avg episode rewards: #0: 4.429, true rewards: #0: 4.036
13530
+ [2024-11-07 16:44:05,722][14395] Avg episode reward: 4.429, avg true_objective: 4.036
13531
+ [2024-11-07 16:44:05,998][14395] Num frames 22700...
13532
+ [2024-11-07 16:44:06,261][14395] Num frames 22800...
13533
+ [2024-11-07 16:44:06,520][14395] Num frames 22900...
13534
+ [2024-11-07 16:44:06,805][14395] Avg episode rewards: #0: 4.419, true rewards: #0: 4.033
13535
+ [2024-11-07 16:44:06,806][14395] Avg episode reward: 4.419, avg true_objective: 4.033
13536
+ [2024-11-07 16:44:06,842][14395] Num frames 23000...
13537
+ [2024-11-07 16:44:07,202][14395] Num frames 23100...
13538
+ [2024-11-07 16:44:07,464][14395] Num frames 23200...
13539
+ [2024-11-07 16:44:07,718][14395] Avg episode rewards: #0: 4.410, true rewards: #0: 4.013
13540
+ [2024-11-07 16:44:07,721][14395] Avg episode reward: 4.410, avg true_objective: 4.013
13541
+ [2024-11-07 16:44:07,781][14395] Num frames 23300...
13542
+ [2024-11-07 16:44:08,040][14395] Num frames 23400...
13543
+ [2024-11-07 16:44:08,289][14395] Num frames 23500...
13544
+ [2024-11-07 16:44:08,540][14395] Num frames 23600...
13545
+ [2024-11-07 16:44:08,767][14395] Avg episode rewards: #0: 4.400, true rewards: #0: 4.010
13546
+ [2024-11-07 16:44:08,773][14395] Avg episode reward: 4.400, avg true_objective: 4.010
13547
+ [2024-11-07 16:44:08,893][14395] Num frames 23700...
13548
+ [2024-11-07 16:44:09,156][14395] Num frames 23800...
13549
+ [2024-11-07 16:44:09,432][14395] Num frames 23900...
13550
+ [2024-11-07 16:44:09,734][14395] Num frames 24000...
13551
+ [2024-11-07 16:44:12,442][14395] Avg episode rewards: #0: 4.391, true rewards: #0: 4.007
13552
+ [2024-11-07 16:44:12,444][14395] Avg episode reward: 4.391, avg true_objective: 4.007
13553
+ [2024-11-07 16:44:12,599][14395] Num frames 24100...
13554
+ [2024-11-07 16:44:12,987][14395] Num frames 24200...
13555
+ [2024-11-07 16:44:13,304][14395] Num frames 24300...
13556
+ [2024-11-07 16:44:13,577][14395] Num frames 24400...
13557
+ [2024-11-07 16:44:13,704][14395] Avg episode rewards: #0: 4.382, true rewards: #0: 4.005
13558
+ [2024-11-07 16:44:13,705][14395] Avg episode reward: 4.382, avg true_objective: 4.005
13559
+ [2024-11-07 16:44:13,918][14395] Num frames 24500...
13560
+ [2024-11-07 16:44:14,202][14395] Num frames 24600...
13561
+ [2024-11-07 16:44:14,478][14395] Num frames 24700...
13562
+ [2024-11-07 16:44:14,767][14395] Num frames 24800...
13563
+ [2024-11-07 16:44:14,859][14395] Avg episode rewards: #0: 4.373, true rewards: #0: 4.002
13564
+ [2024-11-07 16:44:14,861][14395] Avg episode reward: 4.373, avg true_objective: 4.002
13565
+ [2024-11-07 16:44:15,126][14395] Num frames 24900...
13566
+ [2024-11-07 16:44:15,486][14395] Num frames 25000...
13567
+ [2024-11-07 16:44:15,818][14395] Num frames 25100...
13568
+ [2024-11-07 16:44:16,166][14395] Avg episode rewards: #0: 4.364, true rewards: #0: 3.999
13569
+ [2024-11-07 16:44:16,167][14395] Avg episode reward: 4.364, avg true_objective: 3.999
13570
+ [2024-11-07 16:44:16,178][14395] Num frames 25200...
13571
+ [2024-11-07 16:44:16,580][14395] Num frames 25300...
13572
+ [2024-11-07 16:44:16,919][14395] Num frames 25400...
13573
+ [2024-11-07 16:44:17,364][14395] Num frames 25500...
13574
+ [2024-11-07 16:44:17,700][14395] Avg episode rewards: #0: 4.356, true rewards: #0: 3.997
13575
+ [2024-11-07 16:44:17,702][14395] Avg episode reward: 4.356, avg true_objective: 3.997
13576
+ [2024-11-07 16:44:17,798][14395] Num frames 25600...
13577
+ [2024-11-07 16:44:18,151][14395] Num frames 25700...
13578
+ [2024-11-07 16:44:18,704][14395] Num frames 25800...
13579
+ [2024-11-07 16:44:19,117][14395] Num frames 25900...
13580
+ [2024-11-07 16:44:19,540][14395] Avg episode rewards: #0: 4.348, true rewards: #0: 3.994
13581
+ [2024-11-07 16:44:19,543][14395] Avg episode reward: 4.348, avg true_objective: 3.994
13582
+ [2024-11-07 16:44:19,699][14395] Num frames 26000...
13583
+ [2024-11-07 16:44:20,171][14395] Num frames 26100...
13584
+ [2024-11-07 16:44:20,540][14395] Num frames 26200...
13585
+ [2024-11-07 16:44:20,908][14395] Num frames 26300...
13586
+ [2024-11-07 16:44:21,272][14395] Num frames 26400...
13587
+ [2024-11-07 16:44:21,449][14395] Avg episode rewards: #0: 4.370, true rewards: #0: 4.007
13588
+ [2024-11-07 16:44:21,451][14395] Avg episode reward: 4.370, avg true_objective: 4.007
13589
+ [2024-11-07 16:44:21,678][14395] Num frames 26500...
13590
+ [2024-11-07 16:44:21,991][14395] Num frames 26600...
13591
+ [2024-11-07 16:44:22,365][14395] Num frames 26700...
13592
+ [2024-11-07 16:44:22,667][14395] Num frames 26800...
13593
+ [2024-11-07 16:44:22,806][14395] Avg episode rewards: #0: 4.362, true rewards: #0: 4.004
13594
+ [2024-11-07 16:44:22,810][14395] Avg episode reward: 4.362, avg true_objective: 4.004
13595
+ [2024-11-07 16:44:23,012][14395] Num frames 26900...
13596
+ [2024-11-07 16:44:23,261][14395] Num frames 27000...
13597
+ [2024-11-07 16:44:23,569][14395] Num frames 27100...
13598
+ [2024-11-07 16:44:23,896][14395] Num frames 27200...
13599
+ [2024-11-07 16:44:23,980][14395] Avg episode rewards: #0: 4.355, true rewards: #0: 4.002
13600
+ [2024-11-07 16:44:23,982][14395] Avg episode reward: 4.355, avg true_objective: 4.002
13601
+ [2024-11-07 16:44:24,216][14395] Num frames 27300...
13602
+ [2024-11-07 16:44:24,494][14395] Num frames 27400...
13603
+ [2024-11-07 16:44:24,759][14395] Num frames 27500...
13604
+ [2024-11-07 16:44:25,063][14395] Avg episode rewards: #0: 4.347, true rewards: #0: 3.999
13605
+ [2024-11-07 16:44:25,067][14395] Avg episode reward: 4.347, avg true_objective: 3.999
13606
+ [2024-11-07 16:44:25,085][14395] Num frames 27600...
13607
+ [2024-11-07 16:44:25,412][14395] Num frames 27700...
13608
+ [2024-11-07 16:44:25,712][14395] Num frames 27800...
13609
+ [2024-11-07 16:44:26,010][14395] Num frames 27900...
13610
+ [2024-11-07 16:44:26,296][14395] Num frames 28000...
13611
+ [2024-11-07 16:44:26,392][14395] Avg episode rewards: #0: 4.345, true rewards: #0: 4.002
13612
+ [2024-11-07 16:44:26,398][14395] Avg episode reward: 4.345, avg true_objective: 4.002
13613
+ [2024-11-07 16:44:26,641][14395] Num frames 28100...
13614
+ [2024-11-07 16:44:26,941][14395] Num frames 28200...
13615
+ [2024-11-07 16:44:27,337][14395] Avg episode rewards: #0: 4.319, true rewards: #0: 3.981
13616
+ [2024-11-07 16:44:27,340][14395] Avg episode reward: 4.319, avg true_objective: 3.981
13617
+ [2024-11-07 16:44:27,445][14395] Num frames 28300...
13618
+ [2024-11-07 16:44:27,743][14395] Num frames 28400...
13619
+ [2024-11-07 16:44:28,014][14395] Num frames 28500...
13620
+ [2024-11-07 16:44:28,293][14395] Num frames 28600...
13621
+ [2024-11-07 16:44:28,510][14395] Avg episode rewards: #0: 4.313, true rewards: #0: 3.979
13622
+ [2024-11-07 16:44:28,512][14395] Avg episode reward: 4.313, avg true_objective: 3.979
13623
+ [2024-11-07 16:44:28,668][14395] Num frames 28700...
13624
+ [2024-11-07 16:44:28,941][14395] Num frames 28800...
13625
+ [2024-11-07 16:44:29,250][14395] Num frames 28900...
13626
+ [2024-11-07 16:44:29,540][14395] Num frames 29000...
13627
+ [2024-11-07 16:44:29,823][14395] Num frames 29100...
13628
+ [2024-11-07 16:44:29,989][14395] Avg episode rewards: #0: 4.333, true rewards: #0: 3.991
13629
+ [2024-11-07 16:44:29,992][14395] Avg episode reward: 4.333, avg true_objective: 3.991
13630
+ [2024-11-07 16:44:30,187][14395] Num frames 29200...
13631
+ [2024-11-07 16:44:30,469][14395] Num frames 29300...
13632
+ [2024-11-07 16:44:30,745][14395] Num frames 29400...
13633
+ [2024-11-07 16:44:31,040][14395] Num frames 29500...
13634
+ [2024-11-07 16:44:31,340][14395] Avg episode rewards: #0: 4.349, true rewards: #0: 3.997
13635
+ [2024-11-07 16:44:31,347][14395] Avg episode reward: 4.349, avg true_objective: 3.997
13636
+ [2024-11-07 16:44:31,409][14395] Num frames 29600...
13637
+ [2024-11-07 16:44:31,707][14395] Num frames 29700...
13638
+ [2024-11-07 16:44:31,972][14395] Num frames 29800...
13639
+ [2024-11-07 16:44:32,277][14395] Num frames 29900...
13640
+ [2024-11-07 16:44:32,550][14395] Num frames 30000...
13641
+ [2024-11-07 16:44:32,694][14395] Avg episode rewards: #0: 4.364, true rewards: #0: 4.004
13642
+ [2024-11-07 16:44:32,699][14395] Avg episode reward: 4.364, avg true_objective: 4.004
13643
+ [2024-11-07 16:44:32,912][14395] Num frames 30100...
13644
+ [2024-11-07 16:44:33,168][14395] Num frames 30200...
13645
+ [2024-11-07 16:44:33,449][14395] Num frames 30300...
13646
+ [2024-11-07 16:44:33,713][14395] Num frames 30400...
13647
+ [2024-11-07 16:44:33,982][14395] Avg episode rewards: #0: 4.378, true rewards: #0: 4.010
13648
+ [2024-11-07 16:44:33,985][14395] Avg episode reward: 4.378, avg true_objective: 4.010
13649
+ [2024-11-07 16:44:34,071][14395] Num frames 30500...
13650
+ [2024-11-07 16:44:34,342][14395] Num frames 30600...
13651
+ [2024-11-07 16:44:34,647][14395] Num frames 30700...
13652
+ [2024-11-07 16:44:34,928][14395] Num frames 30800...
13653
+ [2024-11-07 16:44:35,212][14395] Num frames 30900...
13654
+ [2024-11-07 16:44:35,341][14395] Avg episode rewards: #0: 4.393, true rewards: #0: 4.016
13655
+ [2024-11-07 16:44:35,347][14395] Avg episode reward: 4.393, avg true_objective: 4.016
13656
+ [2024-11-07 16:44:35,553][14395] Num frames 31000...
13657
+ [2024-11-07 16:44:35,821][14395] Num frames 31100...
13658
+ [2024-11-07 16:44:36,079][14395] Num frames 31200...
13659
+ [2024-11-07 16:44:36,388][14395] Num frames 31300...
13660
+ [2024-11-07 16:44:36,467][14395] Avg episode rewards: #0: 4.386, true rewards: #0: 4.014
13661
+ [2024-11-07 16:44:36,471][14395] Avg episode reward: 4.386, avg true_objective: 4.014
13662
+ [2024-11-07 16:44:36,735][14395] Num frames 31400...
13663
+ [2024-11-07 16:44:37,030][14395] Num frames 31500...
13664
+ [2024-11-07 16:44:37,358][14395] Num frames 31600...
13665
+ [2024-11-07 16:44:37,714][14395] Num frames 31700...
13666
+ [2024-11-07 16:44:38,059][14395] Avg episode rewards: #0: 4.400, true rewards: #0: 4.020
13667
+ [2024-11-07 16:44:38,062][14395] Avg episode reward: 4.400, avg true_objective: 4.020
13668
+ [2024-11-07 16:44:38,226][14395] Num frames 31800...
13669
+ [2024-11-07 16:44:38,478][14395] Num frames 31900...
13670
+ [2024-11-07 16:44:38,768][14395] Num frames 32000...
13671
+ [2024-11-07 16:44:39,165][14395] Num frames 32100...
13672
+ [2024-11-07 16:44:39,378][14395] Avg episode rewards: #0: 4.393, true rewards: #0: 4.017
13673
+ [2024-11-07 16:44:39,379][14395] Avg episode reward: 4.393, avg true_objective: 4.017
13674
+ [2024-11-07 16:44:39,571][14395] Num frames 32200...
13675
+ [2024-11-07 16:44:39,866][14395] Num frames 32300...
13676
+ [2024-11-07 16:44:40,201][14395] Num frames 32400...
13677
+ [2024-11-07 16:44:40,509][14395] Num frames 32500...
13678
+ [2024-11-07 16:44:40,812][14395] Num frames 32600...
13679
+ [2024-11-07 16:44:41,190][14395] Avg episode rewards: #0: 4.430, true rewards: #0: 4.035
13680
+ [2024-11-07 16:44:41,195][14395] Avg episode reward: 4.430, avg true_objective: 4.035
13681
+ [2024-11-07 16:44:41,325][14395] Num frames 32700...
13682
+ [2024-11-07 16:44:41,967][14395] Num frames 32800...
13683
+ [2024-11-07 16:44:42,269][14395] Num frames 32900...
13684
+ [2024-11-07 16:44:42,746][14395] Num frames 33000...
13685
+ [2024-11-07 16:44:43,030][14395] Avg episode rewards: #0: 4.423, true rewards: #0: 4.033
13686
+ [2024-11-07 16:44:43,032][14395] Avg episode reward: 4.423, avg true_objective: 4.033
13687
+ [2024-11-07 16:44:43,130][14395] Num frames 33100...
13688
+ [2024-11-07 16:44:43,516][14395] Num frames 33200...
13689
+ [2024-11-07 16:44:43,768][14395] Num frames 33300...
13690
+ [2024-11-07 16:44:44,043][14395] Num frames 33400...
13691
+ [2024-11-07 16:44:44,361][14395] Num frames 33500...
13692
+ [2024-11-07 16:44:44,467][14395] Avg episode rewards: #0: 4.436, true rewards: #0: 4.038
13693
+ [2024-11-07 16:44:44,469][14395] Avg episode reward: 4.436, avg true_objective: 4.038
13694
+ [2024-11-07 16:44:47,173][14395] Num frames 33600...
13695
+ [2024-11-07 16:44:47,501][14395] Num frames 33700...
13696
+ [2024-11-07 16:44:47,873][14395] Num frames 33800...
13697
+ [2024-11-07 16:44:48,210][14395] Num frames 33900...
13698
+ [2024-11-07 16:44:48,264][14395] Avg episode rewards: #0: 4.429, true rewards: #0: 4.036
13699
+ [2024-11-07 16:44:48,265][14395] Avg episode reward: 4.429, avg true_objective: 4.036
13700
+ [2024-11-07 16:44:48,594][14395] Num frames 34000...
13701
+ [2024-11-07 16:44:48,920][14395] Num frames 34100...
13702
+ [2024-11-07 16:44:49,191][14395] Avg episode rewards: #0: 4.407, true rewards: #0: 4.018
13703
+ [2024-11-07 16:44:49,195][14395] Avg episode reward: 4.407, avg true_objective: 4.018
13704
+ [2024-11-07 16:44:49,349][14395] Num frames 34200...
13705
+ [2024-11-07 16:44:49,705][14395] Num frames 34300...
13706
+ [2024-11-07 16:44:50,038][14395] Num frames 34400...
13707
+ [2024-11-07 16:44:50,382][14395] Num frames 34500...
13708
+ [2024-11-07 16:44:50,680][14395] Avg episode rewards: #0: 4.415, true rewards: #0: 4.020
13709
+ [2024-11-07 16:44:50,683][14395] Avg episode reward: 4.415, avg true_objective: 4.020
13710
+ [2024-11-07 16:44:50,784][14395] Num frames 34600...
13711
+ [2024-11-07 16:44:51,097][14395] Num frames 34700...
13712
+ [2024-11-07 16:44:51,386][14395] Num frames 34800...
13713
+ [2024-11-07 16:44:51,634][14395] Num frames 34900...
13714
+ [2024-11-07 16:44:51,857][14395] Avg episode rewards: #0: 4.409, true rewards: #0: 4.018
13715
+ [2024-11-07 16:44:51,860][14395] Avg episode reward: 4.409, avg true_objective: 4.018
13716
+ [2024-11-07 16:44:52,012][14395] Num frames 35000...
13717
+ [2024-11-07 16:44:52,334][14395] Num frames 35100...
13718
+ [2024-11-07 16:44:52,625][14395] Num frames 35200...
13719
+ [2024-11-07 16:44:52,923][14395] Num frames 35300...
13720
+ [2024-11-07 16:44:53,201][14395] Num frames 35400...
13721
+ [2024-11-07 16:44:53,271][14395] Avg episode rewards: #0: 4.421, true rewards: #0: 4.023
13722
+ [2024-11-07 16:44:53,276][14395] Avg episode reward: 4.421, avg true_objective: 4.023
13723
+ [2024-11-07 16:44:53,503][14395] Num frames 35500...
13724
+ [2024-11-07 16:44:53,754][14395] Num frames 35600...
13725
+ [2024-11-07 16:44:53,966][14395] Num frames 35700...
13726
+ [2024-11-07 16:44:54,252][14395] Avg episode rewards: #0: 4.414, true rewards: #0: 4.021
13727
+ [2024-11-07 16:44:54,257][14395] Avg episode reward: 4.414, avg true_objective: 4.021
13728
+ [2024-11-07 16:44:54,295][14395] Num frames 35800...
13729
+ [2024-11-07 16:44:54,535][14395] Num frames 35900...
13730
+ [2024-11-07 16:44:54,775][14395] Num frames 36000...
13731
+ [2024-11-07 16:44:55,023][14395] Num frames 36100...
13732
+ [2024-11-07 16:44:55,342][14395] Avg episode rewards: #0: 4.408, true rewards: #0: 4.019
13733
+ [2024-11-07 16:44:55,348][14395] Avg episode reward: 4.408, avg true_objective: 4.019
13734
+ [2024-11-07 16:44:55,434][14395] Num frames 36200...
13735
+ [2024-11-07 16:44:55,655][14395] Num frames 36300...
13736
+ [2024-11-07 16:44:55,910][14395] Num frames 36400...
13737
+ [2024-11-07 16:44:56,158][14395] Num frames 36500...
13738
+ [2024-11-07 16:44:56,335][14395] Avg episode rewards: #0: 4.402, true rewards: #0: 4.017
13739
+ [2024-11-07 16:44:56,339][14395] Avg episode reward: 4.402, avg true_objective: 4.017
13740
+ [2024-11-07 16:44:56,474][14395] Num frames 36600...
13741
+ [2024-11-07 16:44:56,741][14395] Num frames 36700...
13742
+ [2024-11-07 16:44:57,056][14395] Num frames 36800...
13743
+ [2024-11-07 16:44:57,337][14395] Num frames 36900...
13744
+ [2024-11-07 16:44:57,490][14395] Avg episode rewards: #0: 4.396, true rewards: #0: 4.015
13745
+ [2024-11-07 16:44:57,492][14395] Avg episode reward: 4.396, avg true_objective: 4.015
13746
+ [2024-11-07 16:44:57,627][14395] Num frames 37000...
13747
+ [2024-11-07 16:44:57,823][14395] Num frames 37100...
13748
+ [2024-11-07 16:44:58,048][14395] Num frames 37200...
13749
+ [2024-11-07 16:44:58,242][14395] Num frames 37300...
13750
+ [2024-11-07 16:44:58,361][14395] Avg episode rewards: #0: 4.390, true rewards: #0: 4.013
13751
+ [2024-11-07 16:44:58,364][14395] Avg episode reward: 4.390, avg true_objective: 4.013
13752
+ [2024-11-07 16:44:58,588][14395] Num frames 37400...
13753
+ [2024-11-07 16:44:58,811][14395] Num frames 37500...
13754
+ [2024-11-07 16:44:59,038][14395] Num frames 37600...
13755
+ [2024-11-07 16:44:59,304][14395] Num frames 37700...
13756
+ [2024-11-07 16:44:59,453][14395] Avg episode rewards: #0: 4.387, true rewards: #0: 4.015
13757
+ [2024-11-07 16:44:59,458][14395] Avg episode reward: 4.387, avg true_objective: 4.015
13758
+ [2024-11-07 16:44:59,614][14395] Num frames 37800...
13759
+ [2024-11-07 16:44:59,838][14395] Num frames 37900...
13760
+ [2024-11-07 16:45:00,073][14395] Num frames 38000...
13761
+ [2024-11-07 16:45:00,297][14395] Num frames 38100...
13762
+ [2024-11-07 16:45:00,413][14395] Avg episode rewards: #0: 4.381, true rewards: #0: 4.013
13763
+ [2024-11-07 16:45:00,417][14395] Avg episode reward: 4.381, avg true_objective: 4.013
13764
+ [2024-11-07 16:45:00,627][14395] Num frames 38200...
13765
+ [2024-11-07 16:45:00,938][14395] Num frames 38300...
13766
+ [2024-11-07 16:45:01,301][14395] Num frames 38400...
13767
+ [2024-11-07 16:45:01,644][14395] Num frames 38500...
13768
+ [2024-11-07 16:45:01,736][14395] Avg episode rewards: #0: 4.376, true rewards: #0: 4.011
13769
+ [2024-11-07 16:45:01,740][14395] Avg episode reward: 4.376, avg true_objective: 4.011
13770
+ [2024-11-07 16:45:02,065][14395] Num frames 38600...
13771
+ [2024-11-07 16:45:02,308][14395] Num frames 38700...
13772
+ [2024-11-07 16:45:02,639][14395] Num frames 38800...
13773
+ [2024-11-07 16:45:02,939][14395] Avg episode rewards: #0: 4.370, true rewards: #0: 4.009
13774
+ [2024-11-07 16:45:02,942][14395] Avg episode reward: 4.370, avg true_objective: 4.009
13775
+ [2024-11-07 16:45:02,970][14395] Num frames 38900...
13776
+ [2024-11-07 16:45:03,197][14395] Num frames 39000...
13777
+ [2024-11-07 16:45:03,485][14395] Num frames 39100...
13778
+ [2024-11-07 16:45:03,729][14395] Num frames 39200...
13779
+ [2024-11-07 16:45:03,960][14395] Avg episode rewards: #0: 4.365, true rewards: #0: 4.008
13780
+ [2024-11-07 16:45:03,965][14395] Avg episode reward: 4.365, avg true_objective: 4.008
13781
+ [2024-11-07 16:45:04,025][14395] Num frames 39300...
13782
+ [2024-11-07 16:45:04,280][14395] Num frames 39400...
13783
+ [2024-11-07 16:45:04,562][14395] Num frames 39500...
13784
+ [2024-11-07 16:45:04,828][14395] Num frames 39600...
13785
+ [2024-11-07 16:45:05,100][14395] Num frames 39700...
13786
+ [2024-11-07 16:45:05,365][14395] Num frames 39800...
13787
+ [2024-11-07 16:45:05,471][14395] Avg episode rewards: #0: 4.396, true rewards: #0: 4.022
13788
+ [2024-11-07 16:45:05,472][14395] Avg episode reward: 4.396, avg true_objective: 4.022
13789
+ [2024-11-07 16:45:05,708][14395] Num frames 39900...
13790
+ [2024-11-07 16:45:05,981][14395] Num frames 40000...
13791
+ [2024-11-07 16:45:06,262][14395] Num frames 40100...
13792
+ [2024-11-07 16:45:06,529][14395] Num frames 40200...
13793
+ [2024-11-07 16:45:06,599][14395] Avg episode rewards: #0: 4.390, true rewards: #0: 4.020
13794
+ [2024-11-07 16:45:06,603][14395] Avg episode reward: 4.390, avg true_objective: 4.020
13795
+ [2024-11-07 16:47:35,377][14395] Replay video saved to /root/hfRL/ml/LunarLander-v2/train_dir/default_experiment/replay.mp4!