Analysis of Failed BFB Simulations

[boverhof]

Description

On AWS S3 there are records since 2020 of BFB runs. Some of these runs have failed because of convergence errors. An ability to analyze the inputs that create convergence errors would be useful in determining new parameter ranges/sets to try.

Demonstration

Here are sets of parameters that were used to run the BFB simulation. Parameter values that were associated with an error run are added to the "ERROR" set.

(py3.9) joshuas-mbp:foquscloudstack-blue-bluefoqussession6a558c90-1gzb41km1tzgi boverhof$ python analyze.py 
SAMPLES: total=24 error=2 success=22     session_1ecaa38c-78a7-4c9b-844c-525a2691c2d1_finished.txt
SAMPLES: total=12 error=1 success=11     session_6a3ba68d-1555-47c5-b6dd-584e6fd6a784_finished.txt
SAMPLES: total=20 error=2 success=18     session_5aaca30a-3dfe-4597-b8b9-31d60c1fd84e_finished.txt
SAMPLES: total=21 error=1 success=20     session_72db33ca-8400-4524-9c09-ff962222de39_finished.txt
SAMPLES: total=20 error=3 success=17     session_33615520-46c9-4a91-a466-52994643a57d_finished.txt
SAMPLES: total=20 error=1 success=19     session_a943067f-a483-4a52-848c-b5ddb827be21_finished.txt
TOTAL: 24 24
    BFBadsM.Lb -- {1.972}  ERRORS:{1.972}
       fg_flow -- {90339.3, 80301.6, 110414.7, 70263.9, 100377}  ERRORS:{90339.3, 80301.6, 110414.7, 70263.9}
    BFBadsB.Dt -- {11.897}  ERRORS:{11.897}
 GHXfg.GasIn.T -- {54}  ERRORS:{54}
    BFBadsM.dx -- {0.06695}  ERRORS:{0.06695}
  GHXfg.A_exch -- {16358}  ERRORS:{16358}
            dp -- {0.00015, 0.000174, 0.0001402, 0.0001598, 0.000126}  ERRORS:{0.0001598, 0.000126, 0.000174, 0.0001402}
    BFBadsM.Cr -- {1}  ERRORS:{1}
 GHXfg.GasIn.P -- {1.01325}  ERRORS:{1.01325}
     BFBRGN.Dt -- {9.041}  ERRORS:{9.041}
  BFBRGNTop.Cr -- {1}  ERRORS:{1}
    BFBadsT.Cr -- {1}  ERRORS:{1}
  BFBRGNTop.Lb -- {7.1926}  ERRORS:{7.1926}
     BFBRGN.Lb -- {8.886}  ERRORS:{8.886}
    BFBadsB.Cr -- {1}  ERRORS:{1}
    BFBadsT.Lb -- {2.2029999999999994}  ERRORS:{2.2029999999999994}
     BFBRGN.Cr -- {1}  ERRORS:{1}
    BFBadsM.Dt -- {15}  ERRORS:{15}
    BFBadsT.dx -- {0.06239700000000001}  ERRORS:{0.06239700000000001}
    BFBadsB.Lb -- {2.085}  ERRORS:{2.085}
    BFBadsT.Dt -- {15}  ERRORS:{15}
  BFBRGNTop.Dt -- {9.195}  ERRORS:{9.195}
    BFBadsB.dx -- {0.0127}  ERRORS:{0.0127}
            Kd -- {100}  ERRORS:{100}

[boverhof]

BFB Byron runs

• occurrence of errors by parameter
• with db at 0.00015
• set of variables that succeeded and errored

(py3.9) joshuas-mbp:foqussessiondev1563311335 boverhof$ python analyze.py --summary
JOBS: 20989
FILTER BY VAR: ('dp', 0.00015)
TOTAL: 24 24
    BFBadsM.Lb -- SUCCESS=1055  ERRORS=194
       fg_flow -- SUCCESS=5  ERRORS=5
    BFBadsB.Dt -- SUCCESS=1077  ERRORS=207
 GHXfg.GasIn.T -- SUCCESS=1  ERRORS=1
    BFBadsM.dx -- SUCCESS=975  ERRORS=180
  GHXfg.A_exch -- SUCCESS=1046  ERRORS=197
            dp -- SUCCESS=1  ERRORS=1
    BFBadsM.Cr -- SUCCESS=1  ERRORS=1
 GHXfg.GasIn.P -- SUCCESS=1  ERRORS=1
     BFBRGN.Dt -- SUCCESS=1094  ERRORS=204
  BFBRGNTop.Cr -- SUCCESS=1  ERRORS=1
    BFBadsT.Cr -- SUCCESS=1  ERRORS=1
  BFBRGNTop.Lb -- SUCCESS=1050  ERRORS=197
     BFBRGN.Lb -- SUCCESS=1053  ERRORS=196
    BFBadsB.Cr -- SUCCESS=1  ERRORS=1
    BFBadsT.Lb -- SUCCESS=1039  ERRORS=192
     BFBRGN.Cr -- SUCCESS=1  ERRORS=1
    BFBadsM.Dt -- SUCCESS=491  ERRORS=85
    BFBadsT.dx -- SUCCESS=1079  ERRORS=201
    BFBadsB.Lb -- SUCCESS=1060  ERRORS=200
    BFBadsT.Dt -- SUCCESS=595  ERRORS=108
  BFBRGNTop.Dt -- SUCCESS=1053  ERRORS=194
    BFBadsB.dx -- SUCCESS=649  ERRORS=103
            Kd -- SUCCESS=1  ERRORS=1

[boverhof]

Range of Values Error and Success

(py3.9) joshuas-mbp:foqussessiondev1563311335 boverhof$ python analyze.py 
JOBS: 20989
FILTER BY VAR: ('dp', 0.00015)
TOTAL: 24 24
    BFBadsM.Lb -- RANGE=(1.5345,2.4095)  RANGE ERRORS=(1.5345,2.1031248943341145)
       fg_flow -- RANGE=(70263.9,110414.7)  RANGE ERRORS=(70263.9,110414.7)
    BFBadsB.Dt -- RANGE=(10.647,14.026297553110737)  RANGE ERRORS=(10.647,14.026297553110737)
 GHXfg.GasIn.T -- RANGE=(54,54)  RANGE ERRORS=(54,54)
    BFBadsM.dx -- RANGE=(0.051956667357578534,0.075)  RANGE ERRORS=(0.055544874168780206,0.075)
  GHXfg.A_exch -- RANGE=(15541.651765281696,17000)  RANGE ERRORS=(15715.284569969244,16950.830664530607)
            dp -- RANGE=(0.00015,0.00015)  RANGE ERRORS=(0.00015,0.00015)
    BFBadsM.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
 GHXfg.GasIn.P -- RANGE=(1.01325,1.01325)  RANGE ERRORS=(1.01325,1.01325)
     BFBRGN.Dt -- RANGE=(8.041,10.450362376771725)  RANGE ERRORS=(8.041,10.118615592286677)
  BFBRGNTop.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsT.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
  BFBRGNTop.Lb -- RANGE=(5.4426,8.942599999999999)  RANGE ERRORS=(5.4426,8.942599999999999)
     BFBRGN.Lb -- RANGE=(8.68849218074504,8.971499999999999)  RANGE ERRORS=(8.69678556017329,8.906625648676997)
    BFBadsB.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsT.Lb -- RANGE=(1.7884795890544831,2.42575)  RANGE ERRORS=(1.7884795890544831,2.42575)
     BFBRGN.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsM.Dt -- RANGE=(12.5,15)  RANGE ERRORS=(12.5,15)
    BFBadsT.dx -- RANGE=(0.04616453190727447,0.07184925)  RANGE ERRORS=(0.05227637499275295,0.07184925)
    BFBadsB.Lb -- RANGE=(1.77375,2.3962499999999998)  RANGE ERRORS=(1.77375,2.3962499999999998)
    BFBadsT.Dt -- RANGE=(12.5,15)  RANGE ERRORS=(12.5,15)
  BFBRGNTop.Dt -- RANGE=(8.195,10.195)  RANGE ERRORS=(8.195,10.195)
    BFBadsB.dx -- RANGE=(0.0127,0.04385)  RANGE ERRORS=(0.0127,0.04385)
            Kd -- RANGE=(100,100)  RANGE ERRORS=(100,100)

[boverhof]

OPTIMIZATION

BFBadsM.Lb set outside error range and test

• 2.11, 2.5, 2.2
• RANGE=(1.5345,2.4095)
• RANGE ERRORS=(1.5345,2.1031248943341145)
• result 2 errors, 1 stuck

BFBRGN.Lb

• 8.91, 9.0,8.886
• RANGE=(8.68849218074504,8.971499999999999)
• RANGE ERRORS=(8.69678556017329,8.906625648676997)
• had a couple errors but seems to complete, so no convergence terminations

BFBadsT.dx

• 0.0127, 0.050, 0.048

[boverhof]