Log message about environment variable (NumExpr)
FLomb opened this issue · comments
Problem description
When entering the pre-processing stage 1 (model_run), the log returns a "Note" about not having specified a "NUMEXPR_MAX_THREADS", which is consequently set to a default number. It would be worth checking whether this is an issue or not, and whether it is possible to manually modify the parameter. This is happening when running on the Euler cluster a modified version of Euro-Calliope 2.0 (based on the build dated 25-06-2021).
See below an example full log message:
[2022-01-06 18:59:13] INFO Model: initialising
[2022-01-06 18:59:23] INFO Loading overrides from scenario: industry_fuel_shared
[2022-01-06 18:59:23] INFO Loading overrides from scenario: transport
[2022-01-06 18:59:23] INFO Loading overrides from scenario: heat
[2022-01-06 18:59:23] INFO Loading overrides from scenario: add-biofuel
[2022-01-06 18:59:23] INFO Applying the following overrides from scenario definition: {'transport_demand_exists', 'heat_techs_2030', 'carbon_tax_high', 'monthly_transport_demand_equality', 'renewable_techs_2030', '2030_current', 'high_efficiency', 'brown-field-capacities', 'annual_waste_supply', 'gas_storage', 'fossil-fuel-supply', 'all_transport', 'heat_storage_max', 'transformation_techs_2030', 'heat_tech_grouping', 'industry_techs', 'link_cap_dynamic', 'annual_transport_distance', 'biofuel_maximum', 'transport_ev_exists', 'res_3h', 'coal_supply', 'biofuel-supply', 'config_overrides', 'annual_fuel_demand_shared', 'heat_techs', 'transport_ice_exists', 'freeze-hydro-capacities'}
[2022-01-06 18:59:44] INFO Model: preprocessing stage 1 (model_run)
[2022-01-06 19:01:33] INFO Note: detected 256 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2022-01-06 19:01:33] INFO Note: NumExpr detected 256 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
[2022-01-06 19:06:42] INFO Model: preprocessing stage 2 (model_data)
[2022-01-06 21:02:48] INFO Model: preprocessing complete
[2022-01-06 21:02:49] INFO Backend: starting model run
[2022-01-06 21:03:00] INFO Loading sets
[2022-01-06 21:03:03] INFO Loading parameters
[2022-01-06 21:05:35] INFO constraints are loaded in the following order: ['costs', 'policy', 'capacity', 'eurocalliope', 'energy_balance', 'dispatch', 'network', 'conversion', 'conversion_plus', 'group', 'export', 'milp']
[2022-01-06 21:05:35] INFO creating costs constraints
[2022-01-06 21:19:31] INFO creating policy constraints
[2022-01-06 21:19:32] INFO creating capacity constraints
[2022-01-06 21:19:32] INFO creating eurocalliope constraints
[2022-01-06 21:22:58] INFO creating energy_balance constraints
[2022-01-06 21:34:01] INFO creating dispatch constraints
[2022-01-06 21:44:43] INFO creating network constraints
[2022-01-06 21:44:43] INFO creating conversion constraints
[2022-01-06 21:52:38] INFO creating conversion_plus constraints
[2022-01-06 21:59:47] INFO creating group constraints
[2022-01-06 22:17:57] INFO creating export constraints
[2022-01-06 22:17:58] INFO creating milp constraints
[2022-01-06 22:18:04] INFO Backend: model generated. Time since start of model run: 1:15:15.302139
[2022-01-06 22:18:04] INFO Backend: sending model to solver
[2022-01-06 22:18:08] DEBUG Using license file /cluster/apps/gurobi/8.1.1/x86_64/gurobi.lic
[2022-01-06 22:18:08] DEBUG Set parameter TokenServer to value lic-gurobi.ethz.ch
[2022-01-07 00:11:11] DEBUG Parameter OutputFlag unchanged
[2022-01-07 00:11:11] DEBUG Value: 1 Min: 0 Max: 1 Default: 1
[2022-01-07 00:11:11] DEBUG Changed value of parameter LogFile to /scratch/199603578.tmpdir/tmpq2kh5t7h.log
[2022-01-07 00:11:11] DEBUG Prev: Default:
[2022-01-07 00:11:12] DEBUG Changed value of parameter BarConvTol to 0.0001
[2022-01-07 00:11:12] DEBUG Prev: 1e-08 Min: 0.0 Max: 1.0 Default: 1e-08
[2022-01-07 00:11:12] DEBUG Changed value of parameter Crossover to 0
[2022-01-07 00:11:12] DEBUG Prev: -1 Min: -1 Max: 5 Default: -1
[2022-01-07 00:11:12] DEBUG Changed value of parameter FeasibilityTol to 0.001
[2022-01-07 00:11:12] DEBUG Prev: 1e-06 Min: 1e-09 Max: 0.01 Default: 1e-06
[2022-01-07 00:11:12] DEBUG Changed value of parameter Method to 2
[2022-01-07 00:11:12] DEBUG Prev: -1 Min: -1 Max: 5 Default: -1
[2022-01-07 00:11:12] DEBUG Changed value of parameter OptimalityTol to 0.0001
[2022-01-07 00:11:12] DEBUG Prev: 1e-06 Min: 1e-09 Max: 0.01 Default: 1e-06
[2022-01-07 00:11:12] DEBUG Changed value of parameter Threads to 8
[2022-01-07 00:11:12] DEBUG Prev: 0 Min: 0 Max: 1024 Default: 0
[2022-01-07 00:11:58] DEBUG Gurobi Optimizer version 9.1.2 build v9.1.2rc0 (linux64)
[2022-01-07 00:11:58] DEBUG Thread count: 128 physical cores, 256 logical processors, using up to 8 threads
[2022-01-07 00:11:58] DEBUG Optimize a model with 55670176 rows, 38994855 columns and 153726629 nonzeros
[2022-01-07 00:11:59] DEBUG Model fingerprint: 0xd5585907
[2022-01-07 00:12:00] DEBUG Coefficient statistics:
[2022-01-07 00:12:00] DEBUG Matrix range [5e-06, 7e+03]
[2022-01-07 00:12:00] DEBUG Objective range [4e-05, 9e+01]
[2022-01-07 00:12:00] DEBUG Bounds range [1e-04, 5e+01]
[2022-01-07 00:12:00] DEBUG RHS range [5e-06, 1e+04]
[2022-01-07 00:12:06] DEBUG Presolve removed 0 rows and 0 columns (presolve time = 6s) ...
[2022-01-07 00:12:10] DEBUG Presolve removed 14963740 rows and 3624193 columns (presolve time = 10s) ...
[2022-01-07 00:12:17] DEBUG Presolve removed 15174125 rows and 4252006 columns (presolve time = 17s) ...
[2022-01-07 00:12:36] DEBUG Presolve removed 15174346 rows and 4476870 columns (presolve time = 36s) ...
[2022-01-07 00:12:42] DEBUG Presolve removed 15177476 rows and 4480000 columns (presolve time = 42s) ...
[2022-01-07 00:12:45] DEBUG Presolve removed 25307476 rows and 14610000 columns (presolve time = 45s) ...
[2022-01-07 00:12:54] DEBUG Presolve removed 29832538 rows and 19135062 columns (presolve time = 54s) ...
[2022-01-07 00:12:58] DEBUG Presolve removed 29837476 rows and 19140000 columns (presolve time = 58s) ...
[2022-01-07 00:13:02] DEBUG Presolve removed 30154580 rows and 19457104 columns (presolve time = 63s) ...
[2022-01-07 00:13:39] DEBUG Presolve removed 30155116 rows and 19457640 columns (presolve time = 99s) ...
[2022-01-07 00:13:40] DEBUG Presolve removed 30155116 rows and 19457640 columns (presolve time = 100s) ...
[2022-01-07 00:13:47] DEBUG Presolve removed 30249007 rows and 19487006 columns (presolve time = 107s) ...
[2022-01-07 00:13:59] DEBUG Presolve removed 30559161 rows and 19818428 columns (presolve time = 119s) ...
[2022-01-07 00:14:02] DEBUG Presolve removed 30559161 rows and 19818432 columns (presolve time = 122s) ...
[2022-01-07 00:14:06] DEBUG Presolve removed 30559161 rows and 19818432 columns (presolve time = 127s) ...
[2022-01-07 00:14:16] DEBUG Presolve removed 30579468 rows and 19818432 columns (presolve time = 136s) ...
[2022-01-07 00:14:16] DEBUG Presolve removed 30579468 rows and 19818432 columns
[2022-01-07 00:14:17] DEBUG Presolve time: 138.60s
[2022-01-07 00:14:17] DEBUG Presolved: 25090708 rows, 19196730 columns, 96720307 nonzeros
[2022-01-07 00:14:34] DEBUG Elapsed ordering time = 5s
[2022-01-07 00:14:39] DEBUG Elapsed ordering time = 10s
[2022-01-07 00:14:44] DEBUG Elapsed ordering time = 15s
[2022-01-07 00:16:11] DEBUG Elapsed ordering time = 102s
[2022-01-07 00:16:14] DEBUG Elapsed ordering time = 105s
[2022-01-07 00:16:19] DEBUG Elapsed ordering time = 110s
[2022-01-07 00:16:24] DEBUG Elapsed ordering time = 115s
[2022-01-07 00:16:29] DEBUG Elapsed ordering time = 120s
[2022-01-07 00:16:34] DEBUG Elapsed ordering time = 125s
[2022-01-07 00:19:45] DEBUG Ordering time: 316.58s
[2022-01-07 00:20:23] DEBUG Barrier statistics:
[2022-01-07 00:20:23] DEBUG Dense cols : 4050
[2022-01-07 00:20:23] DEBUG AA' NZ : 1.083e+08
[2022-01-07 00:20:23] DEBUG Factor NZ : 1.495e+09 (roughly 30.0 GBytes of memory)
[2022-01-07 00:20:23] DEBUG Factor Ops : 8.492e+12 (roughly 60 seconds per iteration)
[2022-01-07 00:20:23] DEBUG Threads : 8
[2022-01-07 00:21:24] DEBUG Objective Residual
[2022-01-07 00:21:24] DEBUG Iter Primal Dual Primal Dual Compl Time
[2022-01-07 00:21:26] DEBUG 0 2.39473678e+07 -2.70084371e+07 2.22e+08 6.13e-02 1.37e+03 568s
[2022-01-07 00:22:29] DEBUG 1 2.41399441e+07 -2.67622564e+07 1.74e+08 1.83e+00 8.69e+02 630s
[2022-01-07 00:23:37] DEBUG 2 2.41846640e+07 -2.67984394e+07 1.67e+08 1.76e+00 8.34e+02 699s
[2022-01-07 00:24:46] DEBUG 3 2.40028801e+07 -2.74154392e+07 1.48e+08 8.17e-01 5.78e+02 767s
[2022-01-07 00:26:03] DEBUG 4 2.34957569e+07 -2.79963559e+07 1.02e+08 1.71e-01 3.13e+02 845s
[2022-01-07 00:27:26] DEBUG 5 2.20597921e+07 -2.67163275e+07 5.01e+07 4.09e-02 1.45e+02 927s
[2022-01-07 00:28:58] DEBUG 6 2.11677730e+07 -2.35460277e+07 3.45e+07 9.66e-03 9.00e+01 1019s
[2022-01-07 00:30:24] DEBUG 7 1.90923586e+07 -2.01982096e+07 2.59e+07 3.32e-03 6.18e+01 1106s
[2022-01-07 00:31:45] DEBUG 8 1.65750498e+07 -1.86594562e+07 1.84e+07 1.86e-03 4.37e+01 1187s
[2022-01-07 00:33:03] DEBUG 9 1.27131745e+07 -1.73657308e+07 1.05e+07 1.27e-03 2.53e+01 1264s
[2022-01-07 00:34:16] DEBUG 10 1.07243454e+07 -1.51770221e+07 7.20e+06 7.53e-04 1.73e+01 1337s
[2022-01-07 00:35:17] DEBUG 11 8.74554670e+06 -1.38391423e+07 4.92e+06 5.31e-04 1.19e+01 1398s
[2022-01-07 00:36:22] DEBUG 12 7.41778332e+06 -1.16149803e+07 3.48e+06 3.04e-04 8.37e+00 1464s
[2022-01-07 00:37:39] DEBUG 13 6.21273745e+06 -9.21422150e+06 2.18e+06 1.32e-04 5.44e+00 1540s
[2022-01-07 00:39:02] DEBUG 14 5.28954504e+06 -6.87409389e+06 1.24e+06 4.17e-05 3.14e+00 1624s
[2022-01-07 00:40:27] DEBUG 15 3.80567417e+06 -5.42463718e+06 6.32e+05 2.39e-05 1.66e+00 1709s
[2022-01-07 00:42:10] DEBUG 16 2.33028592e+06 -4.10626792e+06 3.34e+05 1.38e-04 8.70e-01 1812s
[2022-01-07 00:43:42] DEBUG 17 1.53268376e+06 -3.25653913e+06 2.00e+05 6.31e-04 5.20e-01 1903s
[2022-01-07 00:45:03] DEBUG 18 1.30182382e+06 -2.54367124e+06 1.61e+05 6.28e-04 4.03e-01 1985s
[2022-01-07 00:46:26] DEBUG 19 7.23061259e+05 -1.81337270e+06 8.74e+04 5.24e-04 2.13e-01 2067s
[2022-01-07 00:47:41] DEBUG 20 5.74429626e+05 -1.02800179e+06 5.90e+04 1.22e-03 1.25e-01 2142s
[2022-01-07 00:48:45] DEBUG 21 4.55637076e+05 -8.69650439e+05 4.66e+04 1.29e-03 9.66e-02 2207s
[2022-01-07 00:49:45] DEBUG 22 3.69830710e+05 -7.49808337e+05 3.76e+04 9.45e-04 7.70e-02 2266s
[2022-01-07 00:50:49] DEBUG 23 3.06940523e+05 -6.65785448e+05 3.09e+04 8.07e-04 6.24e-02 2330s
[2022-01-07 00:52:05] DEBUG 24 2.43902383e+05 -5.56599239e+05 2.42e+04 6.76e-04 4.72e-02 2406s
[2022-01-07 00:53:26] DEBUG 25 1.80540011e+05 -4.11455300e+05 1.75e+04 5.47e-04 3.23e-02 2487s
[2022-01-07 00:54:56] DEBUG 26 1.37994128e+05 -2.76111221e+05 1.26e+04 3.64e-04 2.05e-02 2577s
[2022-01-07 00:56:32] DEBUG 27 8.96670274e+04 -2.00986216e+05 7.58e+03 3.73e-04 1.26e-02 2674s
[2022-01-07 00:58:07] DEBUG 28 7.00796483e+04 -1.32179706e+05 5.31e+03 2.60e-04 8.24e-03 2769s
[2022-01-07 00:59:33] DEBUG 29 4.06907994e+04 -7.17801511e+04 2.52e+03 1.86e-04 4.09e-03 2855s
[2022-01-07 01:00:45] DEBUG 30 3.11498930e+04 -5.05647937e+04 1.76e+03 1.21e-04 2.83e-03 2926s
[2022-01-07 01:01:54] DEBUG 31 2.08528194e+04 -3.41725351e+04 1.00e+03 7.80e-05 1.76e-03 2995s
[2022-01-07 01:02:57] DEBUG 32 1.79603989e+04 -2.91434307e+04 8.17e+02 6.67e-05 1.46e-03 3058s
[2022-01-07 01:04:06] DEBUG 33 1.50795062e+04 -2.06743332e+04 6.47e+02 4.53e-05 1.09e-03 3127s
[2022-01-07 01:05:23] DEBUG 34 1.16092440e+04 -1.80928600e+04 4.57e+02 3.93e-05 8.63e-04 3205s
[2022-01-07 01:06:34] DEBUG 35 8.77334927e+03 -1.21717455e+04 3.09e+02 2.62e-05 5.88e-04 3275s
[2022-01-07 01:08:04] DEBUG 36 6.87569531e+03 -7.78374178e+03 2.18e+02 1.66e-05 4.01e-04 3365s
[2022-01-07 01:09:44] DEBUG 37 5.53589696e+03 -7.01436682e+03 1.60e+02 1.43e-05 3.34e-04 3466s
[2022-01-07 01:11:32] DEBUG 38 4.73380311e+03 -5.60847168e+03 1.33e+02 1.40e-05 2.73e-04 3574s
[2022-01-07 01:13:11] DEBUG 39 4.07407957e+03 -4.16991591e+03 1.09e+02 1.52e-05 2.15e-04 3673s
[2022-01-07 01:14:38] DEBUG 40 3.62602686e+03 -3.02393900e+03 9.27e+01 1.55e-05 1.72e-04 3759s
[2022-01-07 01:16:14] DEBUG 41 3.03081406e+03 -2.07423949e+03 7.15e+01 1.36e-05 1.31e-04 3855s
[2022-01-07 01:17:47] DEBUG 42 2.79086274e+03 -1.72210904e+03 6.30e+01 1.32e-05 1.15e-04 3949s
[2022-01-07 01:19:05] DEBUG 43 2.63657488e+03 -1.58827884e+03 5.76e+01 1.55e-05 1.07e-04 4027s
[2022-01-07 01:20:32] DEBUG 44 2.53870828e+03 -1.37550924e+03 5.44e+01 1.53e-05 9.91e-05 4113s
[2022-01-07 01:22:07] DEBUG 45 2.36601708e+03 -1.09725200e+03 4.86e+01 1.25e-05 8.73e-05 4209s
[2022-01-07 01:23:41] DEBUG 46 2.15868365e+03 -7.96327125e+02 4.19e+01 1.21e-05 7.41e-05 4303s
[2022-01-07 01:25:14] DEBUG 47 2.02680484e+03 -5.26359172e+02 3.72e+01 1.18e-05 6.38e-05 4396s
[2022-01-07 01:26:38] DEBUG 48 1.79749404e+03 -2.69318583e+02 2.92e+01 1.55e-05 5.13e-05 4479s
[2022-01-07 01:28:08] DEBUG 49 1.68296239e+03 -4.77470700e+00 2.53e+01 1.32e-05 4.17e-05 4570s
[2022-01-07 01:29:48] DEBUG 50 1.57062939e+03 4.65197136e+01 2.14e+01 1.47e-05 3.76e-05 4669s
[2022-01-07 01:31:19] DEBUG 51 1.47904790e+03 2.05204492e+02 1.83e+01 1.43e-05 3.13e-05 4760s
[2022-01-07 01:32:57] DEBUG 52 1.39508456e+03 2.94802074e+02 1.55e+01 1.52e-05 2.70e-05 4858s
[2022-01-07 01:34:28] DEBUG 53 1.31878817e+03 3.61905011e+02 1.31e+01 1.35e-05 2.34e-05 4949s
[2022-01-07 01:36:01] DEBUG 54 1.25529021e+03 4.12164614e+02 1.10e+01 1.41e-05 2.06e-05 5043s
[2022-01-07 01:37:29] DEBUG 55 1.21218803e+03 5.07176968e+02 9.66e+00 1.39e-05 1.72e-05 5130s
[2022-01-07 01:39:02] DEBUG 56 1.15674938e+03 5.32554131e+02 7.83e+00 1.41e-05 1.52e-05 5224s
[2022-01-07 01:40:37] DEBUG 57 1.11265253e+03 5.82760402e+02 6.19e+00 1.26e-05 1.29e-05 5319s
[2022-01-07 01:42:02] DEBUG 58 1.06295723e+03 6.19461536e+02 3.89e+00 1.23e-05 1.08e-05 5404s
[2022-01-07 01:43:35] DEBUG 59 1.03602696e+03 6.61272802e+02 8.65e-01 1.00e-05 9.08e-06 5495s
[2022-01-07 01:45:07] DEBUG 60 1.01386532e+03 6.65536439e+02 2.78e-01 9.96e-06 8.43e-06 5588s
[2022-01-07 01:46:34] DEBUG 61 9.86642429e+02 6.85844260e+02 2.43e-01 8.11e-06 7.27e-06 5675s
[2022-01-07 01:48:06] DEBUG 62 9.62960305e+02 6.98025704e+02 2.01e-01 8.25e-06 6.40e-06 5767s
[2022-01-07 01:49:43] DEBUG 63 9.35540472e+02 7.07593955e+02 4.91e-02 7.34e-06 5.50e-06 5864s
[2022-01-07 01:51:18] DEBUG 64 9.18959981e+02 7.17463730e+02 4.43e-02 7.00e-06 4.86e-06 5960s
[2022-01-07 01:52:52] DEBUG 65 9.05553283e+02 7.24831648e+02 4.03e-02 7.54e-06 4.36e-06 6054s
[2022-01-07 01:54:26] DEBUG 66 8.88736575e+02 7.32801988e+02 3.53e-02 8.01e-06 3.76e-06 6147s
[2022-01-07 01:56:02] DEBUG 67 8.76172844e+02 7.39520123e+02 3.15e-02 8.08e-06 3.29e-06 6244s
[2022-01-07 01:57:29] DEBUG 68 8.72118194e+02 7.41186972e+02 3.03e-02 8.16e-06 3.15e-06 6331s
[2022-01-07 01:58:59] DEBUG 69 8.62598287e+02 7.44472322e+02 2.76e-02 7.95e-06 2.84e-06 6421s
[2022-01-07 02:00:35] DEBUG 70 8.51153798e+02 7.48788185e+02 2.41e-02 7.78e-06 2.46e-06 6516s
[2022-01-07 02:02:08] DEBUG 71 8.41355565e+02 7.51301139e+02 2.13e-02 7.84e-06 2.17e-06 6609s
[2022-01-07 02:03:38] DEBUG 72 8.35351838e+02 7.53326386e+02 1.95e-02 7.37e-06 1.97e-06 6700s
[2022-01-07 02:05:02] DEBUG 73 8.30052074e+02 7.55061297e+02 1.79e-02 7.80e-06 1.80e-06 6783s
[2022-01-07 02:06:27] DEBUG 74 8.23940802e+02 7.57096281e+02 1.60e-02 7.49e-06 1.61e-06 6869s
[2022-01-07 02:07:59] DEBUG 75 8.20598899e+02 7.58877357e+02 1.50e-02 8.56e-06 1.48e-06 6960s
[2022-01-07 02:09:39] DEBUG 76 8.15843005e+02 7.59805792e+02 1.36e-02 9.07e-06 1.35e-06 7061s
[2022-01-07 02:10:57] DEBUG 77 8.14908683e+02 7.60571257e+02 1.33e-02 1.07e-05 1.30e-06 7138s
[2022-01-07 02:12:23] DEBUG 78 8.13523904e+02 7.60936089e+02 1.28e-02 1.06e-05 1.26e-06 7225s
[2022-01-07 02:13:42] DEBUG 79 8.09998933e+02 7.61593175e+02 1.17e-02 1.03e-05 1.16e-06 7304s
[2022-01-07 02:15:22] DEBUG 80 8.08351898e+02 7.62647950e+02 1.12e-02 1.20e-05 1.10e-06 7403s
[2022-01-07 02:16:52] DEBUG 81 8.07103274e+02 7.63778846e+02 1.08e-02 1.22e-05 1.04e-06 7493s
[2022-01-07 02:18:29] DEBUG 82 8.04459305e+02 7.64904624e+02 1.00e-02 1.21e-05 9.49e-07 7591s
[2022-01-07 02:20:00] DEBUG 83 8.01809464e+02 7.65385638e+02 9.18e-03 1.16e-05 8.74e-07 7681s
[2022-01-07 02:21:38] DEBUG 84 8.00000531e+02 7.66131812e+02 8.62e-03 1.12e-05 8.12e-07 7779s
[2022-01-07 02:23:10] DEBUG 85 7.98653342e+02 7.66962290e+02 8.18e-03 9.99e-06 7.60e-07 7871s
[2022-01-07 02:24:43] DEBUG 86 7.97255247e+02 7.67546266e+02 7.74e-03 9.12e-06 7.13e-07 7964s
[2022-01-07 02:26:07] DEBUG 87 7.96121230e+02 7.67737731e+02 7.38e-03 8.96e-06 6.81e-07 8049s
[2022-01-07 02:27:25] DEBUG 88 7.94977845e+02 7.68374960e+02 7.01e-03 1.07e-05 6.38e-07 8127s
[2022-01-07 02:29:04] DEBUG 89 7.93919729e+02 7.68632762e+02 6.69e-03 9.76e-06 6.06e-07 8226s
[2022-01-07 02:30:33] DEBUG 90 7.92573514e+02 7.68994140e+02 6.26e-03 9.74e-06 5.65e-07 8315s
[2022-01-07 02:32:08] DEBUG 91 7.91468387e+02 7.69285309e+02 5.92e-03 1.05e-05 5.32e-07 8409s
[2022-01-07 02:33:39] DEBUG 92 7.90198212e+02 7.69446905e+02 5.53e-03 1.02e-05 4.98e-07 8501s
[2022-01-07 02:35:15] DEBUG 93 7.89153701e+02 7.69705903e+02 5.19e-03 9.84e-06 4.66e-07 8596s
[2022-01-07 02:36:57] DEBUG 94 7.88059358e+02 7.69874229e+02 4.85e-03 9.64e-06 4.36e-07 8698s
[2022-01-07 02:38:23] DEBUG 95 7.87402759e+02 7.70110652e+02 4.63e-03 1.12e-05 4.14e-07 8784s
[2022-01-07 02:39:55] DEBUG 96 7.86645086e+02 7.70285648e+02 4.39e-03 1.10e-05 3.92e-07 8877s
[2022-01-07 02:41:20] DEBUG 97 7.85677213e+02 7.70421170e+02 4.07e-03 1.15e-05 3.66e-07 8962s
[2022-01-07 02:42:46] DEBUG 98 7.85215706e+02 7.70543729e+02 3.92e-03 1.17e-05 3.52e-07 9048s
[2022-01-07 02:44:28] DEBUG 99 7.84815607e+02 7.70754590e+02 3.79e-03 1.05e-05 3.37e-07 9150s
[2022-01-07 02:45:42] DEBUG 100 7.84144707e+02 7.70854638e+02 3.57e-03 1.02e-05 3.18e-07 9223s
[2022-01-07 02:47:06] DEBUG 101 7.83596911e+02 7.70971952e+02 3.39e-03 1.07e-05 3.03e-07 9308s
[2022-01-07 02:48:27] DEBUG 102 7.83279445e+02 7.71068891e+02 3.29e-03 1.07e-05 2.93e-07 9388s
[2022-01-07 02:49:55] DEBUG 103 7.82754287e+02 7.71165737e+02 3.12e-03 1.17e-05 2.78e-07 9476s
[2022-01-07 02:51:21] DEBUG 104 7.82187566e+02 7.71295365e+02 2.94e-03 1.49e-05 2.61e-07 9562s
[2022-01-07 02:52:38] DEBUG 105 7.81813717e+02 7.71380513e+02 2.81e-03 1.43e-05 2.50e-07 9640s
[2022-01-07 02:54:11] DEBUG 106 7.81375471e+02 7.71479877e+02 2.67e-03 1.43e-05 2.37e-07 9732s
[2022-01-07 02:55:44] DEBUG 107 7.80941269e+02 7.71613912e+02 2.53e-03 1.31e-05 2.23e-07 9826s
[2022-01-07 02:57:17] DEBUG 108 7.80699474e+02 7.71668053e+02 2.45e-03 1.20e-05 2.16e-07 9918s
[2022-01-07 02:58:50] DEBUG 109 7.80405120e+02 7.71722371e+02 2.35e-03 1.23e-05 2.08e-07 10011s
[2022-01-07 03:00:26] DEBUG 110 7.80233298e+02 7.71815378e+02 2.29e-03 1.31e-05 2.02e-07 10108s
[2022-01-07 03:01:56] DEBUG 111 7.79898458e+02 7.71910591e+02 2.18e-03 1.37e-05 1.91e-07 10198s
[2022-01-07 03:03:27] DEBUG 112 7.79527933e+02 7.72015455e+02 2.06e-03 1.25e-05 1.80e-07 10289s
[2022-01-07 03:04:36] DEBUG 113 7.79374604e+02 7.72053225e+02 2.00e-03 1.25e-05 1.75e-07 10358s
[2022-01-07 03:06:10] DEBUG 114 7.79066043e+02 7.72148400e+02 1.90e-03 1.47e-05 1.66e-07 10451s
[2022-01-07 03:07:36] DEBUG 115 7.78901525e+02 7.72194675e+02 1.84e-03 1.52e-05 1.61e-07 10537s
[2022-01-07 03:08:54] DEBUG 116 7.78803288e+02 7.72269718e+02 1.81e-03 1.57e-05 1.56e-07 10615s
[2022-01-07 03:10:24] DEBUG 117 7.78614086e+02 7.72352593e+02 1.74e-03 1.72e-05 1.50e-07 10706s
[2022-01-07 03:11:53] DEBUG 118 7.78321385e+02 7.72421235e+02 1.64e-03 1.68e-05 1.41e-07 10794s
[2022-01-07 03:13:19] DEBUG 119 7.78189277e+02 7.72514546e+02 1.60e-03 1.78e-05 1.36e-07 10880s
[2022-01-07 03:14:42] DEBUG 120 7.77836981e+02 7.72559230e+02 1.48e-03 1.87e-05 1.26e-07 10963s
[2022-01-07 03:15:58] DEBUG 121 7.77686420e+02 7.72613141e+02 1.42e-03 1.86e-05 1.22e-07 11039s
[2022-01-07 03:17:13] DEBUG 122 7.77678020e+02 7.72634711e+02 1.42e-03 1.81e-05 1.21e-07 11115s
[2022-01-07 03:18:50] DEBUG 123 7.77462503e+02 7.72682908e+02 1.35e-03 1.71e-05 1.14e-07 11211s
[2022-01-07 03:20:20] DEBUG 124 7.77271740e+02 7.72724436e+02 1.28e-03 1.67e-05 1.09e-07 11301s
[2022-01-07 03:21:27] DEBUG 125 7.77197743e+02 7.72742414e+02 1.25e-03 1.70e-05 1.07e-07 11368s
[2022-01-07 03:22:55] DEBUG 126 7.77062915e+02 7.72818302e+02 1.20e-03 1.53e-05 1.02e-07 11456s
[2022-01-07 03:24:13] DEBUG 127 7.76880517e+02 7.72864093e+02 1.14e-03 1.53e-05 9.62e-08 11534s
[2022-01-07 03:25:39] DEBUG 128 7.76742823e+02 7.72889814e+02 1.09e-03 1.46e-05 9.23e-08 11620s
[2022-01-07 03:27:07] DEBUG 129 7.76569478e+02 7.72921109e+02 1.03e-03 1.47e-05 8.74e-08 11709s
[2022-01-07 03:28:37] DEBUG 130 7.76444402e+02 7.72963244e+02 9.87e-04 1.41e-05 8.34e-08 11799s
[2022-01-07 03:30:08] DEBUG 131 7.76283832e+02 7.72997653e+02 9.31e-04 1.45e-05 7.87e-08 11889s
[2022-01-07 03:31:39] DEBUG 132 7.76250452e+02 7.73049368e+02 9.20e-04 1.43e-05 7.67e-08 11981s
[2022-01-07 03:33:00] DEBUG 133 7.76121818e+02 7.73085749e+02 8.74e-04 1.46e-05 7.27e-08 12062s
[2022-01-07 03:34:29] DEBUG 134 7.75990601e+02 7.73120752e+02 8.28e-04 1.48e-05 6.87e-08 12151s
[2022-01-07 03:36:03] DEBUG 135 7.75826838e+02 7.73159640e+02 7.70e-04 1.64e-05 6.39e-08 12244s
[2022-01-07 03:37:42] DEBUG 136 7.75723789e+02 7.73198235e+02 7.34e-04 1.70e-05 6.05e-08 12343s
[2022-01-07 03:39:17] DEBUG 137 7.75605616e+02 7.73233369e+02 6.93e-04 1.85e-05 5.68e-08 12438s
[2022-01-07 03:40:51] DEBUG 138 7.75512790e+02 7.73248311e+02 6.59e-04 1.78e-05 5.42e-08 12533s
[2022-01-07 03:42:22] DEBUG 139 7.75419679e+02 7.73290460e+02 6.25e-04 1.76e-05 5.10e-08 12623s
[2022-01-07 03:43:48] DEBUG 140 7.75321529e+02 7.73323866e+02 5.89e-04 1.42e-05 4.78e-08 12710s
[2022-01-07 03:45:01] DEBUG 141 7.75254148e+02 7.73338604e+02 5.65e-04 1.36e-05 4.59e-08 12782s
[2022-01-07 03:46:41] DEBUG 142 7.75191370e+02 7.73364906e+02 5.43e-04 1.27e-05 4.37e-08 12882s
[2022-01-07 03:48:12] DEBUG 143 7.75093873e+02 7.73391374e+02 5.08e-04 1.38e-05 4.08e-08 12974s
[2022-01-07 03:49:43] DEBUG 144 7.75019933e+02 7.73402267e+02 4.82e-04 1.37e-05 3.87e-08 13065s
[2022-01-07 03:51:17] DEBUG 145 7.74958368e+02 7.73412261e+02 4.59e-04 1.35e-05 3.70e-08 13159s
[2022-01-07 03:52:52] DEBUG 146 7.74891948e+02 7.73425870e+02 4.35e-04 1.27e-05 3.51e-08 13254s
[2022-01-07 03:54:32] DEBUG 147 7.74845648e+02 7.73454531e+02 4.18e-04 1.42e-05 3.33e-08 13353s
[2022-01-07 03:56:07] DEBUG 148 7.74791960e+02 7.73466750e+02 3.98e-04 1.42e-05 3.17e-08 13448s
[2022-01-07 03:57:46] DEBUG 149 7.74737161e+02 7.73484499e+02 3.78e-04 1.56e-05 3.00e-08 13547s
[2022-01-07 03:59:17] DEBUG 150 7.74689636e+02 7.73497268e+02 3.61e-04 1.56e-05 2.86e-08 13639s
[2022-01-07 04:00:56] DEBUG 151 7.74639517e+02 7.73514000e+02 3.43e-04 1.50e-05 2.70e-08 13738s
[2022-01-07 04:02:35] DEBUG 152 7.74622813e+02 7.73521952e+02 3.36e-04 1.42e-05 2.64e-08 13837s
[2022-01-07 04:04:04] DEBUG 153 7.74565520e+02 7.73533309e+02 3.15e-04 1.34e-05 2.47e-08 13926s
[2022-01-07 04:05:37] DEBUG 154 7.74511753e+02 7.73550316e+02 2.96e-04 1.36e-05 2.30e-08 14019s
[2022-01-07 04:06:57] DEBUG 155 7.74479794e+02 7.73555782e+02 2.84e-04 1.27e-05 2.21e-08 14098s
[2022-01-07 04:08:30] DEBUG 156 7.74470588e+02 7.73562028e+02 2.80e-04 1.23e-05 2.18e-08 14192s
[2022-01-07 04:09:53] DEBUG 157 7.74453196e+02 7.73571639e+02 2.74e-04 1.53e-05 2.11e-08 14275s
[2022-01-07 04:11:14] DEBUG 158 7.74440035e+02 7.73576787e+02 2.69e-04 1.49e-05 2.07e-08 14355s
[2022-01-07 04:12:35] DEBUG 159 7.74407592e+02 7.73586837e+02 2.56e-04 1.58e-05 1.97e-08 14437s
[2022-01-07 04:14:08] DEBUG 160 7.74352173e+02 7.73594875e+02 2.36e-04 1.40e-05 1.81e-08 14530s
[2022-01-07 04:15:34] DEBUG 161 7.74330388e+02 7.73603671e+02 2.28e-04 1.29e-05 1.74e-08 14616s
[2022-01-07 04:16:55] DEBUG 162 7.74311582e+02 7.73608746e+02 2.20e-04 1.25e-05 1.68e-08 14696s
[2022-01-07 04:18:23] DEBUG 163 7.74290498e+02 7.73615280e+02 2.13e-04 1.16e-05 1.62e-08 14784s
[2022-01-07 04:19:56] DEBUG 164 7.74271843e+02 7.73620362e+02 2.06e-04 1.13e-05 1.56e-08 14878s
[2022-01-07 04:21:19] DEBUG 165 7.74246821e+02 7.73624046e+02 1.96e-04 1.10e-05 1.49e-08 14960s
[2022-01-07 04:22:52] DEBUG 166 7.74223720e+02 7.73631599e+02 1.88e-04 1.04e-05 1.42e-08 15054s
[2022-01-07 04:24:32] DEBUG 167 7.74195659e+02 7.73636709e+02 1.77e-04 9.63e-06 1.34e-08 15154s
[2022-01-07 04:26:03] DEBUG 168 7.74170643e+02 7.73644218e+02 1.68e-04 8.87e-06 1.26e-08 15244s
[2022-01-07 04:27:41] DEBUG 169 7.74133589e+02 7.73652395e+02 1.54e-04 8.23e-06 1.15e-08 15342s
[2022-01-07 04:29:10] DEBUG 170 7.74112218e+02 7.73660224e+02 1.46e-04 7.37e-06 1.08e-08 15432s
[2022-01-07 04:30:42] DEBUG 171 7.74097013e+02 7.73662769e+02 1.40e-04 7.60e-06 1.04e-08 15523s
[2022-01-07 04:30:44] DEBUG Barrier solved model in 171 iterations and 15523.78 seconds
[2022-01-07 04:30:44] DEBUG Optimal objective 7.74097013e+02
[2022-01-07 04:30:51] DEBUG Changed value of parameter LogFile to
[2022-01-07 04:30:51] DEBUG Prev: /scratch/199603578.tmpdir/tmpq2kh5t7h.log Default:
[2022-01-07 04:37:00] INFO Backend: solver finished running. Time since start of model run: 7:34:11.659495
[2022-01-07 04:38:37] INFO Backend: loaded results
[2022-01-07 04:59:36] INFO Backend: generated solution array. Time since start of model run: 7:56:46.911763
[2022-01-07 05:11:10] INFO Postprocessing: started
[2022-01-07 05:12:51] INFO Postprocessing: All values < 1e-10 set to 0 in cost_var, system_balance
[2022-01-07 05:12:51] INFO Postprocessing: ended. Time since start of model run: 8:10:02.596982
Steps to reproduce the problem
Run the Euro-Calliope 2.0 build dated 25-06-2021 on the Euler cluster.
Calliope version
- Euro-Calliope 2.0 build dated 25-06-2021
- Calliope's custom branch: https://github.com/FLomb/calliope/tree/euro-calliope-plus-new-spore-scoring
This isn't a Calliope issue, since we no longer require numexpr as a dependency. If you're using numexpr, you can handle this issue by updating your own scripts:
import numexpr
numexpr.set_num_threads(N). # e.g. N = 6