Writing a Custom Plugin
This tutorial walks through building a simple plugin from scratch. We'll create a plugin that counts how many mutations are accepted vs rejected during the search, which is useful for diagnosing whether the search is exploring effectively.
Defining the plugin
A plugin has two parts: an immutable config struct (subtyping AbstractPlugin) and a mutable state object returned by init_plugin_state.
using SymbolicRegression
using SymbolicRegression: AbstractPlugin, MutationEvent, AbstractMutation
using SymbolicRegression: machine, fit!, report
using Test
struct MutationCounterPlugin <: AbstractPlugin end
mutable struct MutationCounterState
accepted::Int
rejected::Int
endImplementing the hooks
Create the state once per output at search start:
function SymbolicRegression.init_plugin_state(::MutationCounterPlugin, options, dataset)
return MutationCounterState(0, 0)
endThe on_mutation_end! hook fires on the worker after each mutation's accept/reject decision. We increment the appropriate counter:
function SymbolicRegression.on_mutation_end!(
state::MutationCounterState,
::MutationCounterPlugin,
::AbstractMutation,
event::MutationEvent,
dataset,
options,
)
if event.accepted
state.accepted += 1
else
state.rejected += 1
end
return nothing
endRunning the search
Pass the plugin to SRRegressor via the plugins keyword. All default plugins (like AdaptiveParsimonyPlugin) are still active alongside yours.
X = 2randn(100, 5)
y = @. cos(X[:, 1]) + X[:, 2]^2
model = SRRegressor(;
binary_operators=[+, -, *, /],
unary_operators=[cos],
plugins=(MutationCounterPlugin(),),
niterations=5,
)
mach = machine(model, X, y)
fit!(mach)SymbolicRegression.MLJInterfaceModule.Machine{SRRegressor{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing}, Tuple{Matrix{Float64}, Vector{Float64}}}(SRRegressor{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing}(nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, false, :log, nothing, true, true, nothing, nothing, nothing, true, Optim.BFGS{LineSearches.InitialStatic{Float64}, LineSearches.BackTracking{Float64, Int64}, Nothing, Nothing, Optim.Flat}(LineSearches.InitialStatic{Float64}(1.0, false), LineSearches.BackTracking{Float64, Int64}(0.0001, 0.5, 0.1, 1000, 3, Inf, nothing), nothing, nothing, Optim.Flat()), 2, 0.14, nothing, nothing, nothing, true, true, true, nothing, nothing, nothing, nothing, nothing, nothing, Base.PipeEndpoint(RawFD(-1) closed, 0 bytes waiting), nothing, nothing, false, false, nothing, false, nothing, nothing, 5, nothing, nothing, true, nothing, nothing, nothing, false, "pysr_trace.jsonl", PopMember, (Main.MutationCounterPlugin(),), nothing, true, nothing, nothing, nothing, nothing, false, nothing, nothing, [cos], Function[+, -, *, /], 5, :multithreading, nothing, nothing, nothing, nothing, nothing, nothing, nothing, true, nothing, Nothing, nothing, SymbolicRegression.MLJInterfaceModule.choose_best, DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}), ([-0.5784768659641302 -1.441735897612078 … -1.4215653849696914 -0.258899169389873; -0.12301555031449185 -1.2884403724461593 … 3.275443283407727 1.4642309349224008; … ; -0.14882326689041983 -2.1814017116211635 … 2.2235695342867916 -1.6315326076749892; 0.20470349457330653 -0.8659144918356279 … 0.09822756293454564 -0.8275186404310692], [2.9158987916960832, 2.652521717494914, 2.41335226733969, 6.861418216389005, 10.616226317140889, -0.24580920735574602, 32.67163248405278, 13.054693923251403, 0.8500319026064185, 6.095409832472744 … 0.9895616992348372, 2.0917584851240236, 4.550325086336402, 2.699206420784661, 1.4590800290838462, -0.5344765893335506, 1.6626795717510379, 0.6527910771516212, 5.747459669581539, 1.7289292074198805]), SymbolicRegression.MLJInterfaceModule.SRFitResult{SRRegressor{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing}, Tuple{Vector{Vector{Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}}, HallOfFame{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}, Options{SymbolicRegression.CoreModule.OptionsStructModule.ComplexityMapping{Int64, Int64, 2}, OperatorEnum, Tuple{Int64, Int64}, Tuple{Vector{Int64}, Vector{Tuple{Int64, Int64}}}, Node{T, 2} where T, Expression, @NamedTuple{}, Tuple{Main.MutationCounterPlugin, SimulatedAnnealingPlugin, AdaptiveParsimonyPlugin, AdaptiveMutationWeightsPlugin}, PopMember, false, false, nothing, Nothing, 5, false, Symbol, Nothing}, Nothing, Nothing, SymbolicRegression.MLJInterfaceModule.SRFitResultTypes{Float64, Matrix{Float64}, Vector{Float64}, Nothing, Tuple{Vector{Vector{Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}}, HallOfFame{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}, Vector{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}}, DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing, Nothing}}(SRRegressor{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing}(nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, false, :log, nothing, true, true, nothing, nothing, nothing, true, Optim.BFGS{LineSearches.InitialStatic{Float64}, LineSearches.BackTracking{Float64, Int64}, Nothing, Nothing, Optim.Flat}(LineSearches.InitialStatic{Float64}(1.0, false), LineSearches.BackTracking{Float64, Int64}(0.0001, 0.5, 0.1, 1000, 3, Inf, nothing), nothing, nothing, Optim.Flat()), 2, 0.14, nothing, nothing, nothing, true, true, true, nothing, nothing, nothing, nothing, nothing, nothing, Base.PipeEndpoint(RawFD(-1) closed, 0 bytes waiting), nothing, nothing, false, false, nothing, false, nothing, nothing, 5, nothing, nothing, true, nothing, nothing, nothing, false, "pysr_trace.jsonl", PopMember, (Main.MutationCounterPlugin(),), nothing, true, nothing, nothing, nothing, nothing, false, nothing, nothing, [cos], Function[+, -, *, /], 5, :multithreading, nothing, nothing, nothing, nothing, nothing, nothing, nothing, true, nothing, Nothing, nothing, SymbolicRegression.MLJInterfaceModule.choose_best, DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}), (Vector{Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}[[Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((((x2 + 0.15287556253130186) - 0.16287436970803493) * x2) + 0.15277497742435087), loss = 0.46077237785658537, cost = 0.010079239397080698), PopMember(tree = (((((x2 + 0.15488184303517583) - 0.13687970390599025) * x2) - 0.023988385301972844) + 0.15488184303517583), loss = 0.4644758542036662, cost = 0.010160251685354784), PopMember(tree = ((((x2 + 0.15488184303517583) - 0.16086808920796308) * x2) + 0.15488184303517583), loss = 0.46083417090827417, cost = 0.01008059109911619), PopMember(tree = ((((x2 + 0.15488184303517583) - 0.11289131860401741) * x2) + 0.15488184303517583), loss = 0.4709570553796089, cost = 0.010302025761606595), PopMember(tree = ((x2 * 0.14889559686238857) + 0.15488184303517583), loss = 45.05137403490141, cost = 0.9854835182992012), PopMember(tree = (((((x2 + 0.15488184303517583) - cos(x3)) - 0.023988385301972844) * x2) + 0.15488184303517583), loss = 2.4681590559796875, cost = 0.05399014175071698), PopMember(tree = ((x2 * 0.130893457733203) + 0.15488184303517583), loss = 44.9780940559843, cost = 0.9838805436288132), PopMember(tree = ((((x2 + -0.0073573393620273144) - (((x2 + 0.15590945140877388) - 0.13585209553016828) * -0.016560291044711375)) * x2) + 0.09074561643730855), loss = 0.45291263621079203, cost = 0.009907310215874847), PopMember(tree = (((((x2 + 0.15488184303517583) - x2) - 0.023988385301972844) * x2) + 0.15488184303517583), loss = 44.9780940559843, cost = 0.9838805436288132), PopMember(tree = (0.29176154694116607), loss = 43.50198023348666, cost = 0.9515910546982845) … PopMember(tree = (((((x2 - 0.13687970390599025) + 0.15488184303517583) - 0.023988385301972844) * x2) + (0.8184890166356172 - x1)), loss = 4.915625376429592, cost = 0.10752763693404342), PopMember(tree = ((((x2 - 0.13687970390599025) + 0.130893457733203) * x2) + 0.15488184303517583), loss = 0.46083417090827417, cost = 0.01008059109911619), PopMember(tree = (((x2 + -0.005986246172787264) * x2) + 0.15488184303517583), loss = 0.4608341709082742, cost = 0.010080591099116193), PopMember(tree = (((((x2 - 0.13687970390599025) + 0.15488184303517583) - 0.023988385301972844) + 0.15488184303517583) * x2), loss = 0.5898664318139386, cost = 0.012903128017810484), PopMember(tree = ((((x2 + 0.15488184303517583) - -0.13471985905269135) * x2) + 0.15488184303517583), loss = 0.8001199456835875, cost = 0.017502352281703347), PopMember(tree = (((x2 - 0.13687970390599025) + 0.2857753007683788) * x2), loss = 0.5898664318139383, cost = 0.012903128017810475), PopMember(tree = (((((x2 - 0.13687970390599025) + x2) - 0.023988385301972844) * x2) + 0.15488184303517583), loss = 43.152102118183436, cost = 0.9439375896612847), PopMember(tree = (0.15488184303517583), loss = 44.51901418084361, cost = 0.973838327154272), PopMember(tree = ((((((x2 - 0.13687970390599025) + 0.15488184303517583) - 0.023988385301972844) * x2) + 0.15488184303517583) - -0.31800757667839946), loss = 0.5627652412751294, cost = 0.012310298671882162), PopMember(tree = (((x2 + 0.15488184303517583) - 0.16086808920796308) * x2), loss = 0.48443182904991144, cost = 0.010596781862821349)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = ((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = ((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = (((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)) + 0.827310025489246), loss = 1.7222509604644134, cost = 0.037673655294015784), PopMember(tree = ((x2 * x2) + cos((x2 * (cos((x2 * (x2 * (x2 * x2))) + x2) * x2)) + x2)), loss = 0.9771602210417609, cost = 0.021375048224461266), PopMember(tree = ((x2 * x2) + cos((x2 * (x2 * (x2 * x2))) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = ((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = ((x2 * x2) + cos((x2 * (cos((x2 * ((x2 * x2) * x2)) + x2) * x2)) + x2)), loss = 0.9771602210417609, cost = 0.021375048224461266), PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * (x2 * x2)) + x2)), loss = 0.8510797549255442, cost = 0.018617080815059823) … PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * (x2 * x2)) + x2)), loss = 0.8510797549255442, cost = 0.018617080815059823), PopMember(tree = ((x2 * x2) + cos((x2 * (((x2 * x2) * x2) * (x2 * x2))) + x2)), loss = 1.0399366578066493, cost = 0.02274826147477018), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = (((x2 * x2) + cos((x2 * (x2 * (x2 * x2))) + x2)) * 1.5346733235614103), loss = 13.499026545324437, cost = 0.2952866246253603), PopMember(tree = (x2 * (x2 * (x2 * x2))), loss = 18917.136022360202, cost = 413.80593073626744), PopMember(tree = ((x2 * x2) + cos((x2 * x2) + x2)), loss = 1.0624933860734618, cost = 0.023241682250715354), PopMember(tree = ((x2 * x2) + cos((x2 * (x2 * (x2 * x2))) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816), PopMember(tree = ((x2 * x2) + cos((x2 * ((x2 * ((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2))) * x2)) + x2)), loss = 0.9718893084305779, cost = 0.021259748799837896), PopMember(tree = ((x2 * x2) + cos((((x2 * x2) + cos((x2 * ((x2 * x2) * x2)) + x2)) * (x2 * (x2 * x2))) + x2)), loss = 0.9718893084305935, cost = 0.02125974879983824), PopMember(tree = ((x2 * x2) + cos((x2 * (x2 * (x2 * x2))) + x2)), loss = 0.851079754925544, cost = 0.018617080815059816)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (4.2399815044699025), loss = 30.295066048665113, cost = 0.6626942888271556), PopMember(tree = (4.2399815044699025), loss = 30.295066048665113, cost = 0.6626942888271556), PopMember(tree = (2.8872610304971995), loss = 31.308971317372972, cost = 0.6848731224994482), PopMember(tree = (2.8872610304971995), loss = 31.308971317372972, cost = 0.6848731224994482), PopMember(tree = (3.9383865230809274), loss = 30.204106515943568, cost = 0.6607045799170603), PopMember(tree = (2.609586597409213), loss = 31.969815758750077, cost = 0.6993288703892296), PopMember(tree = (3.938386524528443), loss = 30.204106515943565, cost = 0.6607045799170603), PopMember(tree = (5.2106391079883805), loss = 31.822733155420437, cost = 0.6961114883556071), PopMember(tree = (2.9628555652568216), loss = 31.15576716586739, cost = 0.6815218336768963), PopMember(tree = (2.8872610304971995), loss = 31.308971317372972, cost = 0.6848731224994482) … PopMember(tree = (6.162639215542131), loss = 35.1514065552931, cost = 0.7689250893533076), PopMember(tree = (0.49463819388475505), loss = 42.06350907166966, cost = 0.9201249861956645), PopMember(tree = (2.3173237933976747), loss = 32.831950889928116, cost = 0.7181877838080407), PopMember(tree = (4.2399815044699025), loss = 30.295066048665113, cost = 0.6626942888271556), PopMember(tree = (5.293401145295664), loss = 32.040171142011225, cost = 0.7008678705221395), PopMember(tree = (3.200966458289903), loss = 30.747894868089404, cost = 0.67259976557927), PopMember(tree = (4.2399815044699025), loss = 30.295066048665113, cost = 0.6626942888271556), PopMember(tree = (3.9383865200077333), loss = 30.20410651594357, cost = 0.6607045799170604), PopMember(tree = (3.9383865231291453), loss = 30.204106515943568, cost = 0.6607045799170603), PopMember(tree = (3.3349475167936498), loss = 30.568245150407567, cost = 0.6686699889712269)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (x2 * -0.22720721189658327), loss = 45.21112334255686, cost = 0.9889779801913555), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.488426234410749, cost = 0.010684158124541177), PopMember(tree = (x2 * ((x2 * (x2 + -0.05332837478313723)) + (x2 + -1.2274862111739))), loss = 736.8261881677955, cost = 16.117822815527305), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.4884262344107489, cost = 0.010684158124541175), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.4884262344107492, cost = 0.010684158124541182), PopMember(tree = (x2 + -1.2274862111739), loss = 64.26845721320335, cost = 1.4058506912810949), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.48842623441074906, cost = 0.010684158124541179), PopMember(tree = (x2 * ((x2 * (x2 + 1.2350461645258988)) + -11.317559400636899)), loss = 339.49875126682593, cost = 7.426419971062914), PopMember(tree = (x2 * (x2 + 1.9738840917410394)), loss = 15.50292574664233, cost = 0.339121239607399), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.4884262344107489, cost = 0.010684158124541175) … PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.4884262344107489, cost = 0.010684158124541175), PopMember(tree = ((x2 * (x2 + -0.05332837478313723)) * (x2 + -0.05332837478313723)), loss = 946.5523084604132, cost = 20.705510523899832), PopMember(tree = (x2 * (x2 + -0.01850717649311212)), loss = 0.48383867503136974, cost = 0.01058380681995955), PopMember(tree = (x2 * ((x2 + (x2 + -0.05332837478313723)) + 0.1738788371134461)), loss = 41.16347878935676, cost = 0.9004371292059442), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.48842623441074906, cost = 0.010684158124541179), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.488426234410749, cost = 0.010684158124541177), PopMember(tree = (x2 * (x2 + -0.05332837478313718)), loss = 0.488426234410749, cost = 0.010684158124541177), PopMember(tree = (x2 + 4.149098106151366), loss = 35.360798291290806, cost = 0.7735054625187062), PopMember(tree = (x2 * (x2 + -0.05332837478313723)), loss = 0.4884262344107489, cost = 0.010684158124541175), PopMember(tree = (x2 * (x2 + -0.01850717649311212)), loss = 0.48383867503136974, cost = 0.01058380681995955)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / (x2 + x2)))), loss = 38.91167645895695, cost = 0.8511797174040846), PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / x2))), loss = 38.93437095926176, cost = 0.8516761518966065), PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / x3))), loss = 40.07676978812121, cost = 0.8766657385914124), PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / x2))), loss = 38.93437095926176, cost = 0.8516761518966065), PopMember(tree = (cos((cos(x3) * (cos(x3) / x2)) / ((x2 + (x2 * -1.0596233315081438)) + x2))), loss = 38.87415005785524, cost = 0.8503588401150108), PopMember(tree = (cos((cos(x3) / (x2 + (x2 + x2))) * (cos(x3) / x2))), loss = 38.773359865088025, cost = 0.8481540888525667), PopMember(tree = (x2 + x2), loss = 67.00364121132958, cost = 1.465681913023209), PopMember(tree = (cos((cos(x2 + (x2 + x2)) / x2) * (cos(x3) / (x2 + (x2 + x2))))), loss = 38.80577213261556, cost = 0.8488630962052469), PopMember(tree = (cos(((cos(x3) / x2) / x2) * (cos(x3) / ((x2 + x2) + x2)))), loss = 38.91235501546551, cost = 0.8511945605974333), PopMember(tree = (cos((cos(x3) / x3) * (cos(x3) / x2))), loss = 40.07676978812121, cost = 0.8766657385914124) … PopMember(tree = (cos((cos(x3) / cos(x3)) * (cos(x3) / ((x2 + x2) + x2)))), loss = 38.866136991097555, cost = 0.850183556999015), PopMember(tree = (cos((cos(x3) * cos(x3 / x2)) / ((x2 + x2) + x2))), loss = 38.82609017302867, cost = 0.8493075464441174), PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / (cos((cos(x3) * (cos(x3) / x2)) / ((x2 + x2) + x2)) + x2)))), loss = 39.204012495662546, cost = 0.8575744689993432), PopMember(tree = (cos((cos(x3) / x2) * (cos(x3) / ((x2 + x2) + x2)))), loss = 38.773359865088025, cost = 0.8481540888525667), PopMember(tree = (cos((cos(x2 + (x2 + x2)) / x2) * (cos(x3) / (x2 + (x2 + x2))))), loss = 38.80577213261556, cost = 0.8488630962052469), PopMember(tree = (cos(((cos(x3) / x2) / (x2 + (x2 + x2))) * (cos(x3) / x2))), loss = 38.9123550154655, cost = 0.851194560597433), PopMember(tree = (cos((cos(x3) / (x2 + (x2 + x2))) * (cos(x3) / ((x2 + x2) + x2)))), loss = 38.771670356909766, cost = 0.8481171314345218), PopMember(tree = (cos((cos(x3) * (cos(x3) / x2)) / ((x2 + x2) + ((x2 + x2) + x2)))), loss = 38.76336041355698, cost = 0.8479353542437568), PopMember(tree = (cos((cos(x3) / (x2 + (x2 + x2))) * cos(x3))), loss = 38.813707342694826, cost = 0.8490366762328239), PopMember(tree = (cos(cos(((cos(x3) / x2) / (x2 + (x2 + x2))) * x3))), loss = 41.76885120906628, cost = 0.913679445446831)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((cos(x1) + -0.3206824279754657) + (x2 * x2)), loss = 0.10283721961223977, cost = 0.0022495292799963418), PopMember(tree = ((x2 * (cos(x1) + x2)) + 0.09859979363379355), loss = 2.3242462770763606, cost = 0.050842098550702826), PopMember(tree = ((x2 * x2) + 0.1548818437676684), loss = 0.4611461991480998, cost = 0.010087416610971919), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.10395663588536043)), loss = 0.010806982144601423, cost = 0.00023639906693651111), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.9484704155156174)), loss = 0.8995961291083678, cost = 0.01967836003570622), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.010250102845159955)), loss = 0.0001050646083363562, cost = 2.2982526524457975e-6), PopMember(tree = (cos(x1) + (((x2 * x2) + 0.10395663588536043) * 0.9484704155156174)), loss = 0.08570604854885873, cost = 0.0018747907266495048), PopMember(tree = (cos(x5) + ((x2 * x2) + 0.09859979363379355)), loss = 0.8399697373108596, cost = 0.018374052950053895), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.9994383238339831)), loss = 0.9988769631480817, cost = 0.02185009458820488), PopMember(tree = (cos(x1) + ((x2 * 0.09859979363379355) + 0.09859979363379355)), loss = 42.68113041633885, cost = 0.9336352435132274) … PopMember(tree = ((cos(x1) + (x2 * x2)) + (cos(x4) * -0.3058087429057552)), loss = 0.05095357674971553, cost = 0.0011145921997037693), PopMember(tree = ((cos(x1) + ((x2 * x2) + -0.4523495946058908)) + x5), loss = 4.599184536207158, cost = 0.10060560094210295), PopMember(tree = (cos(x1) + ((x2 + -3.3094610385475676e-11) * x2)), loss = 4.143845551191842e-21, cost = 9.064521516953919e-23), PopMember(tree = ((x2 * x2) + 0.09859979363379355), loss = 0.46431386819523207, cost = 0.010156708296392147), PopMember(tree = ((cos(x1) + (x2 * x2)) + 0.09859979363379355), loss = 0.00972191930462667, cost = 0.00021266368554091495), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.09859979363379355)), loss = 0.00972191930462667, cost = 0.00021266368554091495), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.9994383238339831)), loss = 0.9988769631480817, cost = 0.02185009458820488), PopMember(tree = (x1 + ((x2 * x2) + 0.09859979363379355)), loss = 4.2674996563774545, cost = 0.09335010675699781), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.09859979363379355)), loss = 0.00972191930462667, cost = 0.00021266368554091495), PopMember(tree = (cos(x1) + ((x2 * x2) + 0.09859979363379355)), loss = 0.00972191930462667, cost = 0.00021266368554091495)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos((x1 - (x2 + x1)) * ((cos(x5) / x2) * (x2 - x2)))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x1 - (x1 / ((x2 + x1) * (x1 + -1.8081059626717022)))) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(((((x2 + x1) - x1) / x2) * x1) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x2 + (x1 - x1)) * ((x1 / x2) * (x2 - x2)))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x1 - (x2 + x1)) * ((x1 / x2) * (((x1 / x2) * ((x1 - (x2 + x1)) * (x2 - x2))) - x2)))), loss = 45.65676221422749, cost = 0.9987261792763521), PopMember(tree = (cos(((x1 - x1) / ((x2 + x1) * x2)) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x1 - (x2 + x1)) * ((((x2 + x1) - x1) / x2) * (x2 - x2)))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x2 + x1) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x2)), loss = 48.46869841749561, cost = 1.0602363294591806), PopMember(tree = (cos((x1 - ((x2 + x1) * (x1 / x2))) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984) … PopMember(tree = (cos((x1 / x2) * (x1 - ((x2 + x1) * (x2 - x2))))), loss = 40.85547479510479, cost = 0.8936996463564647), PopMember(tree = (cos(((x1 - x2) + x1) * ((x1 / x2) * (x2 - x2))) - -0.49991977979994195), loss = 36.15022657465736, cost = 0.790773938315566), PopMember(tree = (cos(((x1 * x1) / x2) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((((x2 + (x1 - x1)) * x1) / x2) * (x2 - x2)) + 0.09221273161273268), loss = 38.304811767915155, cost = 0.8379047582342243), PopMember(tree = (cos((((((x1 - x1) / ((x2 + x1) * x2)) - x1) / x2) * x1) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(((x1 + x1) - x2) * ((x1 / x2) * (x2 - x2)))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(((x2 + ((x1 - x1) * x1)) / x2) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((x1 * (x1 / x2)) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos((((x2 + (x1 - x1)) * x1) / -0.8878536735389764) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(((x1 - x1) / ((x2 + x1) * x2)) * (x2 - x2))), loss = 38.83822187572203, cost = 0.8495729233234984)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((cos((x1 + -2.1154647554694335) * x1) + (x2 * x2)) + (x2 * -0.5181345263231445)), loss = 1.516182901939689, cost = 0.033165986445409586), PopMember(tree = ((cos((x1 + x1) * -2.1154647554694335) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 1.2199118243324547, cost = 0.02668515716583017), PopMember(tree = ((cos((x1 + -2.1154647554694335) * x1) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 0.8566442558278793, cost = 0.0187388023839195), PopMember(tree = ((cos((x1 * -2.1154647554694335) + x1) + (x2 * x2)) + cos(cos((x1 * -2.1154647554694335) + x1) * -2.1154647554694335)), loss = 0.33112548504127254, cost = 0.0072432576139454235), PopMember(tree = ((cos((x1 + -2.1154647554694335) * x1) + (x2 * x2)) + -2.1154647554694335), loss = 4.497568342914641, cost = 0.09838278119848089), PopMember(tree = ((cos(x2 + x1) + (x2 * x2)) + cos(x2 * -3.052074125343667)), loss = 1.2575172459074322, cost = 0.02750776300094018), PopMember(tree = ((cos((x1 * -2.1154647554694335) + x1) + (x2 * x2)) + x2), loss = 3.918697105799065, cost = 0.0857201693333483), PopMember(tree = ((cos((x1 + x1) * -2.1154647554694335) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 1.2199118243324547, cost = 0.02668515716583017), PopMember(tree = ((cos((x1 / x1) * -2.1154647554694335) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 1.4562850817805861, cost = 0.03185574195645979), PopMember(tree = ((x2 + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 4.880480246384632, cost = 0.10675884914122365) … PopMember(tree = (cos((x1 * -2.1154647554694335) + x1) + ((x2 * cos(x2 * -2.1154647554694335)) + cos(x2 * -2.1154647554694335))), loss = 49.81022220318181, cost = 1.0895817070091727), PopMember(tree = (cos((x1 * -2.1154647554694335) + x1) + ((x2 + cos(x2 * -2.1154647554694335)) * x2)), loss = 1.4095455001156463, cost = 0.030833329469166636), PopMember(tree = ((cos((x1 + -2.1154647554694335) * x1) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 0.8566442558278793, cost = 0.0187388023839195), PopMember(tree = ((cos((x1 * -2.1154647554694335) + x1) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 0.4998432895498721, cost = 0.010933902331197395), PopMember(tree = (x1 + cos(x2 * -2.1154647554694335)), loss = 50.99514991715186, cost = 1.1155015986330952), PopMember(tree = ((cos((x1 + -2.1154647554694335) * x1) + (x2 * x2)) + (cos(x2) * -2.1154647554694335)), loss = 2.52557552255702, cost = 0.055246107472142106), PopMember(tree = ((cos(x2 * x1) + x1) + ((x2 * x2) + cos(x2 * -2.1154647554694335))), loss = 5.096994824768611, cost = 0.11149503206660151), PopMember(tree = ((cos((((x1 * -2.1154647554694335) + x1) + -2.1154647554694335) * x1) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 1.052665823544137, cost = 0.02302670765548544), PopMember(tree = ((cos((x1 * -2.1154647554694335) + x1) + (x2 * x2)) + cos(cos(x2 * -2.1154647554694335) * x2)), loss = 0.5427798393562395, cost = 0.01187312478718792), PopMember(tree = ((cos((x1 * -2.1154647554694335) + x1) + (x2 * x2)) + cos(x2 * -2.1154647554694335)), loss = 0.4998432895498721, cost = 0.010933902331197395)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos(-0.26757243894412447 / (((x2 * x2) + 1.0093674012906735) / (x1 + (x1 * 1.7068015007649455))))) + -0.7028911313117) * -2.4694542649543672e-11) + x1)), loss = 3.081439747131492e-22, cost = 6.740544874563867e-24), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.1892995983507576 / ((x2 * x2) + 1.023244941804281)) / (x1 + (x1 * 1.3003669681893841)))) + -1.639675236702823) * 2.2827800851914464e-8) + x1)), loss = 5.548798214445318e-17, cost = 1.2137807789097912e-18), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-1.6269728027187165 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00041454512738873584, cost = 9.06803398085827e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826))) + -1.6269728027187165)) * -0.056146933665149945) + x1)), loss = 0.0007746030695287871, cost = 1.6944179275269477e-5), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos(x1 + ((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.0008509085490989557, cost = 1.8613335745703913e-5), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / (x2 * (x2 + 0.9692259335752826))) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00041712575669559986, cost = 9.124484371178979e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24814026588436422 / ((x2 * x2) + 0.9692978443444477)) / (x1 + cos(x1 * -0.24929697376470925)))) + -1.631571305159199) * -1.143973877713701e-8) + x1)), loss = 1.5477844229099588e-17, cost = 3.385725899228598e-19), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6) … PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6), PopMember(tree = ((x2 * x2) + cos(cos((cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.4573642715370994, cost = 0.010004688227922954), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + cos(x1 * -0.24872963318421684)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.0003801379353638211, cost = 8.315388331799025e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.013634292486540026 / ((x2 * x2) + 0.4997323159441393)) / (x1 + (x1 * 1.142650201341472)))) + -2.3783340627770833) * -1.3359080275217052e-10) + x1)), loss = 6.40670493965906e-22, cost = 1.4014449636428052e-23), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos(((x2 * x2) + -0.2566270923712312) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.0005814103365711909, cost = 1.271815380405087e-5), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.1325617402356625 / ((x2 * x2) + 0.8642992307365638)) / (x1 * (x1 + 1.0262730712730155)))) + -1.2645913855798652) * 3.4289125935960263e-13) + x1)), loss = 3.44034738357404e-26, cost = 7.525643149328677e-28), PopMember(tree = ((x2 * x2) + cos((cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / cos(x1 + (x1 * 0.9692259335752826))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.0009499699529129059, cost = 2.078027033648022e-5), PopMember(tree = ((x2 * x2) + cos((cos(cos(cos((-0.24872963318421684 / ((x2 * x2) + 0.9692259335752826)) / (x1 + (x1 * 0.9692259335752826)))) + -1.6269728027187165) * -0.056146933665149945) + x1)), loss = 0.00035419681592373226, cost = 7.747935147471426e-6)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos(x1 + cos(((x1 + x2) * x2) * x1)) + (x2 * x2)), loss = 0.2849690613246592, cost = 0.0062336015088703955), PopMember(tree = (cos(x1 + ((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.7645866640555112, cost = 0.01672507380472671), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.21894503860055725, cost = 0.004789348417810222), PopMember(tree = (cos(x2) + (x2 * x2)), loss = 0.9016672071323778, cost = 0.019723664164636723), PopMember(tree = (cos(x1 + cos((cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.2864129921051424, cost = 0.006265187004678553), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * (x2 * x2))), loss = 928.2202063786144, cost = 20.30450201207519), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * (x2 * x2))), loss = 928.2202063786144, cost = 20.30450201207519), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.21894503860055725, cost = 0.004789348417810222), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.21894503860055725, cost = 0.004789348417810222), PopMember(tree = (x1 + (x2 * x2)), loss = 4.298310750058382, cost = 0.09402408897516067) … PopMember(tree = (cos(x1 + (((x1 + x2) * x2) * x1)) + (x2 * x2)), loss = 0.8655976920205894, cost = 0.01893465576218103), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = ((cos(x1) + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.5288161988172352, cost = 0.01156767488912304), PopMember(tree = ((cos(x1 + cos((x2 * (x1 + x2)) * x1)) + x2) * x2), loss = 2.2382134356694934, cost = 0.04896015934118539), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * x2)), loss = 0.21894503860055725, cost = 0.004789348417810222), PopMember(tree = (cos(x1 + cos((x1 * x1) + (x2 * x2))) + (x2 * x2)), loss = 0.247891288567506, cost = 0.005422537812586452), PopMember(tree = (cos(x1 + cos((x1 + (x2 - x2)) * x1)) + (x2 * x2)), loss = 0.24310962489480248, cost = 0.005317940542459935), PopMember(tree = (cos(x1 + cos((x1 + (x2 * x2)) * x1)) + (x2 * (x1 + cos((x1 + (x2 * x2)) * x1)))), loss = 54.74528233705074, cost = 1.1975344726667878), PopMember(tree = (cos(x1 + cos((x1 + x2) * x1)) + (x2 * x2)), loss = 0.2751382364279302, cost = 0.006018555550460637), PopMember(tree = (cos(x1 + cos(x1 + ((x2 * x2) * x1))) + (x2 * x2)), loss = 0.24640174069679752, cost = 0.005389954458410314)], 27) … Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.23364064950246083), loss = 7.246205538267457, cost = 0.1585082870644258), PopMember(tree = ((((x1 * x1) * -0.37209632336191745) * (x2 / (x1 * -0.37209632336191745))) + 0.13845567385945662), loss = 53.22331281083404, cost = 1.1642419057790778), PopMember(tree = (((((x1 * x2) / (x1 * -0.37209632336191745)) * x2) * -0.37209632336191745) + 0.13845567385945662), loss = 0.4614160181708899, cost = 0.01009331881052919), PopMember(tree = ((((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919), PopMember(tree = (((x1 * (x2 * (x2 / (x1 * -0.37209632336191745)))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.4614160181708899, cost = 0.01009331881052919), PopMember(tree = (((((x1 / (x1 * -0.36920562572301485)) * x2) * x2) * -0.3753802868985555) + 0.09160582991679998), loss = 0.453096400021498, cost = 0.009911329986871626), PopMember(tree = ((((x1 * (x2 / ((((x1 * x2) / (x1 * -0.37209632336191745)) * x2) * -0.37209632336191745))) * x2) * -0.37209632336191745) + 0.13845567385945662), loss = 44.73783102829225, cost = 0.9786248714341371), PopMember(tree = ((x1 * -0.37209632336191745) + 0.13845567385945662), loss = 44.73783102829225, cost = 0.9786248714341371), PopMember(tree = ((((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919), PopMember(tree = ((((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919) … PopMember(tree = ((((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919), PopMember(tree = ((x1 * ((x2 * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745)) + 0.13845567385945662), loss = 0.4614160181708899, cost = 0.01009331881052919), PopMember(tree = (((x1 * (x2 * (x2 / (x1 * -0.37209632336191745)))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.4614160181708899, cost = 0.01009331881052919), PopMember(tree = (((x1 * (x2 * (-0.4465601121265533 / (x1 * -1.0518131227503307)))) * -0.4464887503707733) + 3.8984435614636364), loss = 30.06974607256931, cost = 0.657765490815047), PopMember(tree = ((((x1 * x2) * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919), PopMember(tree = ((((x1 * x2) * -0.37209632336191745) * (x2 / (x1 * -0.37209632336191745))) + 0.13845567385945662), loss = 0.46141601817088984, cost = 0.01009331881052919), PopMember(tree = ((x1 * ((x2 * (x2 / (x1 * -0.37209632336191745))) * -0.37209632336191745)) + 0.13845567385945662), loss = 0.4614160181708899, cost = 0.01009331881052919), PopMember(tree = ((((x1 * x2) * (x2 / 368.2478651095687)) * -70.53686798477177) + 3.821554741007354), loss = 27.14153866530852, cost = 0.5937119475028811), PopMember(tree = ((x1 * -0.37209632336191745) + ((x1 * (x2 * (x2 / (x1 * -0.37209632336191745)))) * -0.37209632336191745)), loss = 1.0426405978261828, cost = 0.02280740924508359), PopMember(tree = ((((x1 * (x2 / (x1 * -0.36920597537766403))) * x2) * -0.3753806428939352) + 0.09160582793895228), loss = 0.453096400021498, cost = 0.009911329986871626)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x5 - (x5 - x5))), loss = 45.43067313390258, cost = 0.9937805573702363), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (x5 - cos(x5)), loss = 51.42360226752519, cost = 1.1248738483971614), PopMember(tree = (cos(cos(x5 - x5) - x5)), loss = 46.5885247247451, cost = 1.019108167989345), PopMember(tree = (x5), loss = 50.227621969200875, cost = 1.0987121852413142), PopMember(tree = (1.3530371379657258 / cos(x5 - x5)), loss = 36.888137959723274, cost = 0.8069154994449652), PopMember(tree = (cos(x5)), loss = 45.43067313390258, cost = 0.9937805573702363), PopMember(tree = (cos(x5) - x5), loss = 50.44683129881445, cost = 1.103507314935344) … PopMember(tree = (x5), loss = 50.227621969200875, cost = 1.0987121852413142), PopMember(tree = (cos(x5 - cos(x5 - x5))), loss = 46.5885247247451, cost = 1.019108167989345), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(x5 - cos(x5 - x5))), loss = 46.5885247247451, cost = 1.019108167989345), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (x5), loss = 50.227621969200875, cost = 1.0987121852413142), PopMember(tree = (x5 - cos(x5)), loss = 51.42360226752519, cost = 1.1248738483971614), PopMember(tree = (cos(x5 - x5)), loss = 38.83822187572203, cost = 0.8495729233234984)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x2 + -0.08981245120531858) + -0.199301596095417))), loss = 0.19698617774893276, cost = 0.004309005788678936), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x4 * -0.6628930126705475) + -0.199301596095417))), loss = 0.2196489076427645, cost = 0.004804745314242258), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(cos(x2 * -0.6628930126705475) + (x1 - -0.199301596095417))), loss = 0.4181108251283813, cost = 0.009146032408851501), PopMember(tree = ((x2 * (x2 + 0.00032132397827741056)) + cos(x1 - (cos(x2 * -0.0638350632468756) + -0.9936020094135787))), loss = 6.1010136503358164e-5, cost = 1.3345760315027317e-6), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - -0.04622260685663698)), loss = 0.03325093330144287, cost = 0.0007273528818733109), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x3 * -0.6628930126705475) + -0.199301596095417))), loss = 0.2006227300257117, cost = 0.0043885541356266395), PopMember(tree = ((x2 * -0.752705463875866) + cos(x1 - (cos(x2 + -0.08981245120531858) + -0.199301596095417))), loss = 44.07451325583875, cost = 0.9641150202664137), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x2 * x2) + -0.199301596095417))), loss = 0.19871560242976183, cost = 0.004346836366671442), PopMember(tree = (cos(x1 - (cos(x2 * -0.2523007810097074) + -0.9754814447059572)) + 3.778627872262147), loss = 28.413820616614522, cost = 0.6215426834238383), PopMember(tree = ((x2 * (cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417)) + x2)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 2.3297584401337224, cost = 0.050962675246965176) … PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 0.16512529669769804, cost = 0.003612059828048329), PopMember(tree = ((x2 * (x2 + 0.0003110897724379867)) + cos(x1 - (cos(x2 * -0.06951649800698398) + -0.9933403417262264))), loss = 8.68829332154062e-5, cost = 1.900534679340561e-6), PopMember(tree = ((x2 + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))) * (x2 + -0.08981245120531858)), loss = 3.0341358762411037, cost = 0.06637069262303702), PopMember(tree = ((x2 * (x2 * -0.6628930126705475)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 119.08486866825103, cost = 2.6049410892655622), PopMember(tree = ((x2 + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))) * (x2 + -0.08981245120531858)), loss = 3.0341358762411037, cost = 0.06637069262303702), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 0.16512529669769804, cost = 0.003612059828048329), PopMember(tree = ((x2 * ((x2 * (x2 + -0.08981245120531858)) + x2)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 837.6246169999633, cost = 18.322754239097232), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(((x2 * (x2 + -0.08981245120531858)) + cos(x1 - cos((x2 * -0.6628930126705475) + -0.199301596095417))) - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 0.9322907085134426, cost = 0.020393542864901727), PopMember(tree = ((x2 * (x2 + 0.00966196831289757)) + cos(x1 - cos((x2 * -0.8661144864554172) + 0.10444452984906472))), loss = 0.1534025666081296, cost = 0.0033556290855855124), PopMember(tree = ((x2 * (x2 + -0.08981245120531858)) + cos(x1 - (cos(x2 * -0.6628930126705475) + -0.199301596095417))), loss = 0.16512529669769804, cost = 0.003612059828048329)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / 0.06587687524079723) * ((x1 - x1) * x4))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.8276952421735877) + 0.4839460106976645) / 0.06587687524079723) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.8276952421735877) + 0.4839460106976645) / 0.06587687524079723) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / 0.06587687524079723) * ((x1 - x1) * x4))), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x1) + ((x2 * x2) + (((x2 / (x2 * cos(x1))) - ((x2 * (x2 + -1.6486408074999797)) * (x2 * x1))) * ((x1 - x1) * x4)))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + ((((((x2 / -1.8276952421735877) + 0.4839460106976645) / x2) * x1) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + ((x1 - x1) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.8276952421735877) + 0.4839460106976645) / 0.06587687524079723) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1 - x1) + (x2 * x2)) + (((((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / x2) * x1) * (x1 - x1)) * cos(x1))), loss = 1.175370898945625, cost = 0.02571083953848078), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / x2) * x1) * (x1 - x1)) * cos(x1))), loss = 0.0, cost = 0.0) … PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.8276952421735877) + 0.4839460106976645) * (x1 - x1)) / 0.06587687524079723) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos((((x1 - x1) * ((x2 * x1) * -1.6486408074999797)) + x1) * (x2 * ((x1 + (x1 * (x1 * (x1 + 0.4839460106976645)))) / x2)))), loss = 0.640759161213322, cost = 0.014016389202375001), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / 0.06587687524079723) * ((x1 - x1) * x4))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((((x2 / -1.6486408074999797) - 0.17905443467360807) + 0.4839460106976645) / x2) * x1) * (x1 - x1)) * cos(x1))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / -1.6486408074999797) + 0.4839460106976645) - 0.17905443467360807) / 0.06587687524079723) * ((x1 - x1) * x4))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / (cos(x1) - 0.17905443467360807)) + 0.4839460106976645) / 0.06587687524079723) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = (((x2 * x2) + (((0.4839460106976645 / (x2 * x2)) - ((x2 + (x2 * -1.6486408074999797)) * 0.06587687524079723)) * ((x1 - x1) * x4))) + -1.6486408074999797), loss = 3.7138401489337856, cost = 0.08123899292254086), PopMember(tree = ((cos(x1) + (x2 * x2)) + ((((((x2 / -1.8276952421735877) + 0.4839460106976645) / x2) * x1) * x1) * x4)), loss = 188.51547174691976, cost = 4.123711969518728), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((((x1 - x1) - 0.17905443467360807) + 0.4839460106976645) / x2) * x1) * x4) * (x1 - x1))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos((((x1 - x1) * ((x2 * x1) * -1.6486408074999797)) * (((x1 + (x1 * (x1 * (x1 + 0.4839460106976645)))) / x2) * x2)) + x1)), loss = 0.0, cost = 0.0)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((x2 * 0.15524776210554858) + 0.309763683423937), loss = 43.919679546525686, cost = 0.9607280854198328), PopMember(tree = ((((x2 + 1.5701658375465164) - 1.4149180754409678) * 0.1548818417119685) + 0.309763683423937), loss = 43.7426797218561, cost = 0.9568562743221604), PopMember(tree = ((x2 * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.309763683423937), loss = 0.5777993369215497, cost = 0.01263916441215022), PopMember(tree = ((x2 * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + -0.17812272709624521), loss = 0.696622965918096, cost = 0.015238390972252), PopMember(tree = ((x2 * ((x2 + 1.4149180754409678) - 1.4149180754409678)) + 0.309763683423937), loss = 0.4851345837340206, cost = 0.01061215438304816), PopMember(tree = ((((((x2 + 1.8437717737132604) - 1.141312139284183) + 0.4288536982608581) - 1.1413121392933816) * x2) + 0.15277497833345288), loss = 0.46077237785658537, cost = 0.010079239397080698), PopMember(tree = ((x2 * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.309763683423937), loss = 0.5777993369215495, cost = 0.012639164412150216), PopMember(tree = (((x2 * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.309763683423937) + x2), loss = 5.545567672599173, cost = 0.12130741088441711), PopMember(tree = ((x2 * ((x2 + 1.2879377400070269) - 1.297936546608437)) + 0.15277497850907232), loss = 0.4607723778565852, cost = 0.010079239397080695), PopMember(tree = ((x2 * (((x2 + 1.5701658375465164) - 1.4149180754409678) + 0.1548818417119685)) + 0.1548818417119685), loss = 0.8482344609698973, cost = 0.018554840975364053) … PopMember(tree = ((x2 * (((x2 + 1.4149180754409678) - 1.4149180754409678) + 0.15524776210554853)) + 0.309763683423937), loss = 0.5777993369215497, cost = 0.01263916441215022), PopMember(tree = ((x2 * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.309763683423937), loss = 0.5777993369215495, cost = 0.012639164412150216), PopMember(tree = ((((x2 + 1.5701658375465164) - 1.4149180754409678) * x2) + 0.309763683423937), loss = 0.5777993369215497, cost = 0.01263916441215022), PopMember(tree = (x2 + ((((x2 + 1.5701658375465164) - 1.4149180754409678) * x2) + 0.1548818417119685)), loss = 5.596983229126629, cost = 0.12243210873498067), PopMember(tree = ((x2 * ((x2 + 1.5701658375465164) - 0.15524776210554853)) + 0.309763683423937), loss = 8.07313017350012, cost = 0.17659698283352812), PopMember(tree = ((x2 * (((x2 + 1.4149180754409678) - 1.4149180754409678) + 0.15524776210554853)) + 0.309763683423937), loss = 0.5777993369215497, cost = 0.01263916441215022), PopMember(tree = ((((x2 + 1.5701658375465164) - 1.4149180754409678) * x2) + 0.309763683423937), loss = 0.5777993369215495, cost = 0.012639164412150216), PopMember(tree = ((x2 * (((x2 + 1.5701658375465164) - 1.4149180754409678) + 0.1548818417119685)) + 0.1548818417119685), loss = 0.8482344609698973, cost = 0.018554840975364053), PopMember(tree = (((x2 + 0.1548818417119685) * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.1548818417119685), loss = 0.8456700375482579, cost = 0.018498745083282975), PopMember(tree = (((x2 + 0.1548818417119685) * ((x2 + 1.5701658375465164) - 1.4149180754409678)) + 0.1548818417119685), loss = 0.8456700375482579, cost = 0.018498745083282975)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos((x1 - 5.9960167049089335e-18) + 8.257912877758508e-19) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 + 8.257912877758508e-19) * ((x1 - 5.170225417133083e-18) + -4.344434129357232e-18))), loss = 51.89474127101461, cost = 1.135179854211924), PopMember(tree = (cos((x2 - 5.170225417133083e-18) + -4.344434129357232e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.9016672071323778, cost = 0.019723664164636723), PopMember(tree = (cos(x1 + 6.821807992684784e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x2) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.9016672071323778, cost = 0.019723664164636723), PopMember(tree = ((cos(x1 - 5.170225417133083e-18) + (((x2 + -4.344434129357232e-18) * x2) + 5.170225417133083e-18)) + -4.344434129357232e-18), loss = 2.7083389842945503e-37, cost = 5.924399617471777e-39), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.0, cost = 0.0), PopMember(tree = (x1 + -3.518642841581381e-18), loss = 50.787189116040985, cost = 1.1109525266827414), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 + 8.257912877758508e-19) * 8.257912877758508e-19)), loss = 43.09521397662082, cost = 0.9426931808702632) … PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x1 + 6.821807992684784e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(((x1 + 5.170225417133083e-18) + ((cos(x1 - 5.170225417133083e-18) + -4.344434129357232e-18) + (((x2 + -4.344434129357232e-18) * x2) + 5.170225417133083e-18))) + -4.344434129357232e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.8103780117041084, cost = 0.017726743994706747), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x1 + 8.257912877758508e-19) * x2)), loss = 51.89474127101461, cost = 1.135179854211924), PopMember(tree = (cos((x1 - 5.170225417133083e-18) + 1.6515825755517016e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1 + 8.257912877758508e-19) + -4.344434129357232e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.0, cost = 0.0), PopMember(tree = (cos((x1 + x2) + -4.344434129357232e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.9403481933874484, cost = 0.020569797612118232), PopMember(tree = (cos(x1 + -3.518642841581381e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = (cos(x1 + 6.821807992684784e-18) + ((x2 * x2) + 8.257912877758508e-19)), loss = 0.0, cost = 0.0), PopMember(tree = (cos((x1 + (x1 - 5.9960167049089335e-18)) + -4.344434129357232e-18) + ((x2 + 8.257912877758508e-19) * x2)), loss = 0.801009132716898, cost = 0.017521802946300923)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (x2 + cos(((x2 * (x2 + x1)) * x2) + x1)), loss = 54.83644333517216, cost = 1.1995285885641358), PopMember(tree = ((x2 * x2) + cos(((x2 * (x2 + x1)) * (x2 * x2)) + x1)), loss = 0.7964819327597426, cost = 0.017422771983596763), PopMember(tree = ((x2 * x2) + cos(((x2 * (x2 + x1)) * x2) + x1)), loss = 0.6287599944401203, cost = 0.013753911501269752), PopMember(tree = ((x2 * x2) + cos(((x2 * (x2 + x1)) * x2) + x1)), loss = 0.6287599944401203, cost = 0.013753911501269752), PopMember(tree = ((x2 * x2) + cos(((x2 * (x2 + x1)) * x2) + x1)), loss = 0.6287599944401203, cost = 0.013753911501269752), PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * (x2 + x1)) + x1)), loss = 0.6287599944401204, cost = 0.013753911501269754), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = ((x2 * x2) + x2), loss = 4.408683243073432, cost = 0.09643844980365973), PopMember(tree = ((x2 * x2) + cos(((x2 * cos(((x2 * (x2 + x1)) * x2) + x1)) * x2) + x1)), loss = 0.6233961953521167, cost = 0.013636580216488052), PopMember(tree = ((x2 * cos(((x2 * (x2 + x1)) * x2) + x1)) + cos(((x2 * (x2 + x1)) * x2) + x1)), loss = 45.11769115807237, cost = 0.9869341828630693) … PopMember(tree = ((((x2 * x2) + cos(((x2 * (x2 + x1)) * x2) + x1)) * x2) + cos((x2 * ((x2 + x1) * x2)) + x1)), loss = 901.037989812861, cost = 19.709900249304603), PopMember(tree = ((x2 * x2) + cos(((x2 * (cos(((x2 * (x2 + x1)) * x2) + x1) + x1)) * x2) + x1)), loss = 0.8451924216353869, cost = 0.018488297397273507), PopMember(tree = ((x2 * x2) + (x2 + x1)), loss = 8.368444022002935, cost = 0.18305687305129534), PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * (x2 + x1)) + x1)), loss = 0.6287599944401204, cost = 0.013753911501269754), PopMember(tree = ((x2 * x2) + cos((((x2 + -1.1580287870802226) * (x2 + x1)) * x2) + x1)), loss = 0.7112576142936284, cost = 0.01555851893902652), PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * x2) + x1)), loss = 0.8672166251306095, cost = 0.018970069374558706), PopMember(tree = ((x2 * x2) + x2), loss = 4.408683243073432, cost = 0.09643844980365973), PopMember(tree = ((x2 * x2) + cos(((x2 * ((x1 + 2.4900522518100043) + x1)) * x2) + x1)), loss = 1.0469451232689035, cost = 0.02290156927835171), PopMember(tree = ((x2 * x2) + cos(((x2 * x2) * x2) + x1)), loss = 0.8672166251306095, cost = 0.018970069374558706), PopMember(tree = ((x2 * x2) + cos((((x2 + x1) * x2) * 0.9643741522472409) + x1)), loss = 0.6789033102725575, cost = 0.01485077951837964)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = ((x2 * x2) + ((x2 * -1.8323598703531598) + (x5 * x2))), loss = 32.331431302703685, cost = 0.7072390876947219), PopMember(tree = ((x2 * x2) + cos(((x2 * -1.8323598703531598) + ((x2 * -1.8323598703531598) * x2)) + x5)), loss = 0.7929873210160479, cost = 0.017346328537641086), PopMember(tree = ((x2 * x2) + cos((x2 * -1.8323598703531598) + (x5 + (x2 * -1.8323598703531598)))), loss = 0.7485315868423632, cost = 0.0163738744391686), PopMember(tree = ((x2 * x2) + cos(((x2 * -1.8323598703531598) + ((x1 + x2) * -1.8323598703531598)) + x5)), loss = 0.827858838622315, cost = 0.018109131151218063), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = ((x2 * x2) + cos(((x2 * -1.8323598703531598) + (((x2 * x2) + cos(((x2 * -1.8323598703531598) + (x2 * -1.8323598703531598)) + x5)) * -1.8323598703531598)) + x5)), loss = 0.7640115873934821, cost = 0.016712494197903858), PopMember(tree = ((x2 * x2) + cos(((x2 * -1.8323598703531598) + (((x2 * x2) + cos(((x2 * -1.8323598703531598) + (x2 * -1.8323598703531598)) + x5)) * -1.8323598703531598)) + x5)), loss = 0.7640115873934821, cost = 0.016712494197903858), PopMember(tree = (x2), loss = 52.57581338622617, cost = 1.1500780756023348), PopMember(tree = ((x2 * x2) + cos((((x2 * -1.8323598703531598) + -1.8323598703531598) * x2) + x5)), loss = 0.7929873210160479, cost = 0.017346328537641086), PopMember(tree = ((x2 * x2) + cos(((x2 * -0.597111535818185) + (x2 * -1.8323598703531598)) + x5)), loss = 1.0227633601756922, cost = 0.022372601417053762) … PopMember(tree = ((x2 * x2) + cos((x2 * -1.8323598703531598) + ((x2 * -1.8323598703531598) + x5))), loss = 0.7485315868423632, cost = 0.0163738744391686), PopMember(tree = ((x2 * x2) + cos((((x2 * -1.8323598703531598) + -1.8323598703531598) * x2) + x5)), loss = 0.7929873210160479, cost = 0.017346328537641086), PopMember(tree = (x2 * (x2 + cos(((x2 * -1.8323598703531598) + (x2 * -1.8323598703531598)) + x5))), loss = 2.80429931450393, cost = 0.06134309583277994), PopMember(tree = ((x2 * x2) + cos((((x2 * -1.8323598703531598) + -1.8323598703531598) * x2) + x5)), loss = 0.7929873210160479, cost = 0.017346328537641086), PopMember(tree = ((x2 * x2) + cos((x2 * -1.6695456843746403) + ((x2 * -2.3467486324794264) + x5))), loss = 0.691969439209628, cost = 0.015136596654733346), PopMember(tree = ((x2 * x2) + cos((x2 * -1.8323598703531598) + ((x2 * -1.8323598703531598) + x5))), loss = 0.7485315868423632, cost = 0.0163738744391686), PopMember(tree = ((x2 * x2) + cos(((x2 + (x2 * -1.8323598703531598)) * -1.8323598703531598) + x5)), loss = 1.0739274173743103, cost = 0.023491797805148255), PopMember(tree = ((x2 * x2) + cos(cos(((x2 * 0.0821450322435313) + (x2 * -0.16800198484804263)) + x5) + x5)), loss = 0.661510701498306, cost = 0.014470322103829479), PopMember(tree = ((x2 * x2) + cos((x2 * -1.8323598703531598) + ((x2 * -1.8323598703531598) + x5))), loss = 0.7485315868423632, cost = 0.0163738744391686), PopMember(tree = ((((x2 * -1.8323598703531598) + (x2 * -1.8323598703531598)) + x5) + cos(((x2 * -1.8323598703531598) + (x2 * -1.8323598703531598)) + x5)), loss = 86.39898609308925, cost = 1.8899485002730323)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3)))), loss = 39.845472668306925, cost = 0.8716061925888761), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + 0.05452905666480365)) + (x3 + x3)))), loss = 39.9022386821685, cost = 0.8728479298778828), PopMember(tree = (cos(cos(((cos(x3 + x3) / (x3 + x1)) / (x3 + x1)) + (x3 + x3)))), loss = 39.94331643677307, cost = 0.873746491819638), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3)))), loss = 39.845472668306925, cost = 0.8716061925888761), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3))) + -0.03409451985832289), loss = 40.059582637073056, cost = 0.8762897754948962), PopMember(tree = (cos(cos((cos(x3 + x3) / ((cos(x3 + x3) / (x3 + x1)) + (x3 + x3))) + (x3 + x3)))), loss = 39.53750319508891, cost = 0.8648694648752991), PopMember(tree = (cos(cos(x3 + ((cos(x3 + x3) / (x3 + x1)) + (x2 + -0.7266601705066214))))), loss = 40.71171204705572, cost = 0.8905548850304726), PopMember(tree = (cos(cos((x3 + cos((x3 + x3) / (x3 + x1))) + x3))), loss = 40.15886924474854, cost = 0.8784616363437179), PopMember(tree = (cos(cos(x3 + (cos((x3 + x3) / (x3 + x1)) + x3)))), loss = 40.15886924474854, cost = 0.8784616363437179), PopMember(tree = (cos(cos(x3 + (cos(x3 + x3) + x3)))), loss = 39.45547313553817, cost = 0.8630750851604934) … PopMember(tree = (cos(cos((cos(((x3 + (cos(x3 + x3) / (x3 + x1))) + x3) + x3) / (x3 + x1)) + (x3 + x3)))), loss = 40.36041998051854, cost = 0.8828704902900713), PopMember(tree = (cos(cos((x1 / (x3 + x1)) + (x3 + x3)))), loss = 40.106917022480154, cost = 0.8773251991121953), PopMember(tree = (cos(cos(x3))), loss = 40.488296396897994, cost = 0.8856677435020041), PopMember(tree = (cos(cos(((cos(x3) + x3) / (x3 + x1)) + (x3 + x3)))), loss = 40.001770327254405, cost = 0.8750251508369012), PopMember(tree = (cos(cos((x3 + (cos(x3 + x3) / (x3 + x1))) + x3))), loss = 39.84547266830692, cost = 0.871606192588876), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3)))), loss = 39.845472668306925, cost = 0.8716061925888761), PopMember(tree = (cos(cos(x3 + ((cos(x3 + x3) / (x3 + x1)) + (x3 + x3))))), loss = 40.07258887826683, cost = 0.8765742826071887), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3)))), loss = 39.845472668306925, cost = 0.8716061925888761), PopMember(tree = (cos(cos(x3 + ((cos(x3 + x3) / (x3 + x1)) + x3))) * x3), loss = 44.75854280497986, cost = 0.9790779345203934), PopMember(tree = (cos(cos((cos(x3 + x3) / (x3 + x1)) + (x3 + x3)))), loss = 39.845472668306925, cost = 0.8716061925888761)], 27), Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1)) * cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929), PopMember(tree = (cos(((-0.4835353678627422 / x2) * cos(((x1 + x1) + cos(x1 + 1.3181133234564728)) + x1)) * cos((x1 + x1) + (cos(x1 + 1.3181133234564728) + x1)))), loss = 38.75529750333004, cost = 0.847758980818786), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x2) + x1))), loss = 38.78243315119262, cost = 0.8483525639069783), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 / x2) + (cos(x1 + 0.8870972464999711) + x1))) * cos(x1 + (x1 + (cos(x1 + 0.8870972464999711) + x1))))), loss = 38.80117326622158, cost = 0.8487624975635581), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * (((x1 + cos(x1 + 0.8870972464999711)) + x1) + cos(x1)))), loss = 39.41508976262861, cost = 0.8621917125826698), PopMember(tree = (cos(((x1 + x1) * cos(((x1 + x1) + cos(x1 + 0.8870972464999711)) + x1)) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1)))), loss = 43.31986897080161, cost = 0.9476074326286503), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((-0.47977836699429444 / x2) + (cos(x1 + 0.8870972464999711) + x1))) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1)))), loss = 38.80469730759639, cost = 0.8488395847727072), PopMember(tree = (cos(((-0.15681586910326611 / x2) * (cos((x1 + cos(x1 + 1.0737804801931063)) + x1) + x1)) * cos((x1 + (cos(x1 + 0.9628291515549108) + x1)) + x1))), loss = 38.71693480046634, cost = 0.8469198097124775), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1))) * cos((cos(x1 + 0.8870972464999711) + (x1 + x1)) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929) … PopMember(tree = (cos(((cos((x1 + (cos(cos(x1 + -0.507939808544486)) + x1)) + x1) * -0.4792331034045108) / x2) * cos(((x1 + cos(x1 + 1.2974680705605166)) + x1) + x1))), loss = 38.787066254817, cost = 0.8484539114764633), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929), PopMember(tree = (cos(((cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1) * -0.47977836699429444) / x2) * (((x1 + cos(x1 + 0.8870972464999711)) + x1) + cos(x1)))), loss = 39.41508976262861, cost = 0.8621917125826698), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 / x1) + (cos(x1 + 0.8870972464999711) + x1))) * cos(x1 + (x1 + (cos(x1 + 0.8870972464999711) + x1))))), loss = 38.75823579894813, cost = 0.8478232550382865), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1))) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1))) * cos((x1 + ((x1 + 0.6316650194368869) + x1)) + x1))), loss = 38.79712001924006, cost = 0.8486738341613544), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos((x1 + x1) + (x1 + 0.9181862448577496))) * cos((x1 + x1) + (cos(x1 + 0.8870972464999711) + x1)))), loss = 38.81722783493978, cost = 0.8491136858059617), PopMember(tree = (cos(((2.2773451187411502e-10 / x1) * cos((x1 + x1) + (cos(x1 + 0.4181078911339417) + x1))) * cos((x1 + x1) + (cos(x1 + 0.41810789113394164) + x1)))), loss = 38.83822187572203, cost = 0.8495729233234984), PopMember(tree = (cos(((-0.47977836699429444 / x2) * cos(((x1 + cos(x1 + 0.8870972464999711)) + x1) + x1)) * cos((x1 + (cos(x1 + 0.8870972464999711) + x1)) + x1))), loss = 38.76228501071289, cost = 0.8479118301714929)], 27)]], HallOfFame{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}(PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}[PopMember(tree = (3.938386523133328), loss = 30.204106515943558, cost = 0.6607045799170601), PopMember(tree = (cos(-1.7694149099081033e-7)), loss = 38.83822187572213, cost = 0.8495729233235007), PopMember(tree = (x2 * x2), loss = 0.48513458434636136, cost = 0.010612154396442907), PopMember(tree = (cos(x1) + 3.7835046799541896), loss = 28.780306309187278, cost = 0.6295594335776322), PopMember(tree = ((x2 * x2) + 0.1548818417119685), loss = 0.46114619914809973, cost = 0.010087416610971917), PopMember(tree = (cos(x1) + (x2 * x2)), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 / 0.9901484941138012) * (x2 / 0.9901484941138012)), loss = 0.45968054796666863, cost = 0.010055355988764099), PopMember(tree = ((x2 * x2) + (cos(x1) + 0.0)), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos(cos(-1.6269728027187165) + x1)), loss = 0.0016244801855739685, cost = 3.5534952772951025e-5), PopMember(tree = ((0.7177459144878622 - 0.7177459144878622) + ((x2 * x2) + cos(x1))), loss = 0.0, cost = 0.0) … PopMember(tree = ((x2 * x2) + cos((cos(-1.6269728027187165) * cos(cos((cos(-1.6269728027187165) * cos(x1 + x1)) + x1))) + x1)), loss = 0.0012755108862246257, cost = 2.7901367776525067e-5), PopMember(tree = ((x2 * x2) + cos(x1 + ((x1 - x1) * ((x3 + (0.4839460106976645 + (x4 / -1.6486408074999797))) * (x1 * x3))))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + (((((x2 / (cos(x1) - 0.17905443467360807)) + 0.4839460106976645) / 0.06587687524079723) * (x1 - x1)) * x4)), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos(x1 + ((x1 - x1) * ((x3 + (0.4839460106976645 + (x4 / -1.6486408074999797))) * ((x1 - x1) * x3))))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos(x1 + (x2 * ((x1 - x1) * cos(x1 + (x2 * ((x1 - x1) * (x2 * x2)))))))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos(x1 + ((x1 - (x1 + (1.4953040120188075 * (2.154445748121704 * ((x1 - x1) * (x2 * x2)))))) * (x5 / x5)))), loss = 0.0, cost = 0.0), PopMember(tree = ((cos(x1) + (x2 * x2)) + ((((cos(0.7428946358720872) / -1.6486408074999797) + (-1.6486408074999797 * (x2 / (-1.6486408074999797 - -0.10860730479256336)))) * (x1 - x1)) * (1.00060132118989 + 0.8919633321808009))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + (cos(x1) + (((x1 - x1) * (x1 * (((x3 + 0.4839460106976645) * x1) + ((x4 + x5) / -1.6486408074999797)))) * (x2 * -1.6486408074999797)))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + (cos(x1) + (((x1 - x1) * (x1 * (((x3 + (((x4 / x1) + cos(x2)) + 0.4839460106976645)) * -1.6486408074999797) * x1))) * x1))), loss = 0.0, cost = 0.0), PopMember(tree = ((x2 * x2) + cos(x1 + ((x1 - x1) * (((x2 * x2) * (((x3 + ((x4 + x5) / -1.6486408074999797)) * x1) + 0.4839460106976645)) * (x1 * x2))))), loss = 0.0, cost = 0.0)], Bool[1, 1, 1, 1, 1, 1, 1, 1, 1, 1 … 1, 1, 1, 1, 1, 1, 1, 1, 1, 1])), 5, 1, Options{SymbolicRegression.CoreModule.OptionsStructModule.ComplexityMapping{Int64, Int64, 2}, OperatorEnum, Tuple{Int64, Int64}, Tuple{Vector{Int64}, Vector{Tuple{Int64, Int64}}}, Node{T, 2} where T, Expression, @NamedTuple{}, Tuple{Main.MutationCounterPlugin, SimulatedAnnealingPlugin, AdaptiveParsimonyPlugin, AdaptiveMutationWeightsPlugin}, PopMember, false, false, nothing, Nothing, 5, false, Symbol, Nothing}(OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}(((cos,), (+, -, *, /))), ([-1], [(-1, -1), (-1, -1), (-1, -1), (-1, -1)]), nothing, SymbolicRegression.CoreModule.OptionsStructModule.ComplexityMapping{Int64, Int64, 2}(false, (Int64[], Int64[]), 0, 0), 15, 0.982, 0.0, nothing, false, 30, 30, Val{false}(), Val{false}(), true, true, true, true, nothing, 31, 0.129, :auto, nothing, Pair{AbstractMutation, Float64}[ConstantMutation(0.129, 0.00743) => 0.0346, OperatorMutation() => 0.293, FeatureMutation() => 0.1, SwapOperandsMutation() => 0.198, RotateTreeMutation() => 4.26, AddNodeMutation() => 2.47, InsertNodeMutation() => 0.0112, DeleteNodeMutation() => 0.87, SimplifyMutation() => 0.00209, RandomizeMutation() => 0.000502, DoNothingMutation() => 0.273, OptimizeMutation() => 0.0, BacksolveMutation(500, 8, 0.001, 8) => 0.0, FormConnectionMutation() => 0.5, BreakConnectionMutation() => 0.1], Pair{AbstractCrossover, Float64}[SubtreeCrossover() => 1.0], 0.2, 0.0, true, true, 1040.0, 27, 380, 0.00036, 0.0614, 0.001, 12, nothing, Val{5}(), true, 0.00743, (1, 4), nothing, L2DistLoss(), nothing, nothing, :log, Node{T, 2} where T, Expression, NamedTuple(), nothing, nothing, Optim.BFGS{LineSearches.InitialStatic{Float64}, LineSearches.BackTracking{Float64, Int64}, Nothing, Nothing, Optim.Flat}(LineSearches.InitialStatic{Float64}(1.0, false), LineSearches.BackTracking{Float64, Int64}(0.0001, 0.5, 0.1, 1000, 3, Inf, nothing), nothing, nothing, Optim.Flat()), 0.14, 2, Optim.Options(x_abstol = 0.0, x_reltol = 0.0, f_abstol = 0.0, f_reltol = 0.0, g_abstol = 1.0e-8, outer_x_abstol = 0.0, outer_x_reltol = 0.0, outer_f_abstol = 0.0, outer_f_reltol = 0.0, outer_g_abstol = 1.0e-8, f_calls_limit = 10000, g_calls_limit = 0, h_calls_limit = 0, allow_f_increases = true, allow_outer_f_increases = true, successive_f_tol = 1, iterations = 8, outer_iterations = 1000, store_trace = false, trace_simplex = false, show_trace = false, extended_trace = false, show_warnings = false, show_every = 1, time_limit = NaN, )
, nothing, "pysr_trace.jsonl", 0.982, nothing, Val{nothing}(), nothing, nothing, Base.PipeEndpoint(RawFD(-1) closed, 0 bytes waiting), true, false, true, Val{false}(), PopMember, (Main.MutationCounterPlugin(), SimulatedAnnealingPlugin(3.17), AdaptiveParsimonyPlugin(true, true), AdaptiveMutationWeightsPlugin(0.02, 0.05, :cost, 0.5))), ["x1", "x2", "x3", "x4", "x5"], nothing, false, nothing, nothing, SymbolicRegression.MLJInterfaceModule.SRFitResultTypes{Float64, Matrix{Float64}, Vector{Float64}, Nothing, Tuple{Vector{Vector{Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}}, HallOfFame{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}, Vector{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}}, DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing, Nothing}(Float64, Matrix{Float64}, Vector{Float64}, Nothing, Tuple{Vector{Vector{Population{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}}, HallOfFame{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}, PopMember{Float64, Float64, Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}}}}, Vector{DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}}, DynamicQuantities.SymbolicDimensions{DynamicQuantities.FRInt32}, Nothing, Nothing)), nothing, (best_idx = 4, equations = Expression{Float64, Node{Float64, 2}, @NamedTuple{operators::OperatorEnum{Tuple{Tuple{typeof(cos)}, Tuple{typeof(+), typeof(-), typeof(*), typeof(/)}}}, variable_names::Vector{String}}}[3.938386523133328, x2 * x2, (x2 * x2) + 0.1548818417119685, cos(x1) + (x2 * x2)], equation_strings = ["3.938386523133328", "x2 * x2", "(x2 * x2) + 0.1548818417119685", "cos(x1) + (x2 * x2)"], losses = [30.204106515943558, 0.48513458434636136, 0.46114619914809973, 0.0], complexities = [1, 3, 5, 6], scores = [0.0, 2.065653412763532, 0.025355609204703106, 744.4400719213812]))The search ran with our plugin active. Since on_mutation_end! runs on workers against per-dispatch copies of the state (built by fork_plugin_state, which defaults to deepcopy), the head-side state won't reflect worker counts in multithreading mode. For a production version you'd aggregate via on_generation_end! on the head node. But the plugin loaded, the hooks fired, and the search completed — the API works.
@test report(mach).best_idx isa IntTest PassedShow raw source code
#=
# Writing a Custom Plugin
This tutorial walks through building a simple plugin from scratch.
We'll create a plugin that counts how many mutations are accepted vs
rejected during the search, which is useful for diagnosing whether
the search is exploring effectively.
## Defining the plugin
A plugin has two parts: an immutable **config struct** (subtyping
`AbstractPlugin`) and a mutable **state object** returned by
`init_plugin_state`.
=#
using SymbolicRegression
using SymbolicRegression: AbstractPlugin, MutationEvent, AbstractMutation
using SymbolicRegression: machine, fit!, report
using Test
struct MutationCounterPlugin <: AbstractPlugin end
mutable struct MutationCounterState
accepted::Int
rejected::Int
end
#=
## Implementing the hooks
Create the state once per output at search start:
=#
function SymbolicRegression.init_plugin_state(::MutationCounterPlugin, options, dataset)
return MutationCounterState(0, 0)
end
#=
The `on_mutation_end!` hook fires on the worker after each mutation's
accept/reject decision. We increment the appropriate counter:
=#
function SymbolicRegression.on_mutation_end!(
state::MutationCounterState,
::MutationCounterPlugin,
::AbstractMutation,
event::MutationEvent,
dataset,
options,
)
if event.accepted
state.accepted += 1
else
state.rejected += 1
end
return nothing
end
#=
## Running the search
Pass the plugin to `SRRegressor` via the `plugins` keyword.
All default plugins (like `AdaptiveParsimonyPlugin`) are still
active alongside yours.
=#
X = 2randn(100, 5)
y = @. cos(X[:, 1]) + X[:, 2]^2
model = SRRegressor(;
binary_operators=[+, -, *, /],
unary_operators=[cos],
plugins=(MutationCounterPlugin(),),
niterations=5,
)
mach = machine(model, X, y)
fit!(mach)
#=
The search ran with our plugin active. Since `on_mutation_end!` runs on
workers against per-dispatch copies of the state (built by `fork_plugin_state`,
which defaults to `deepcopy`), the head-side state won't reflect worker
counts in multithreading mode. For a production version you'd aggregate
via `on_generation_end!` on the head node. But the plugin loaded, the hooks
fired, and the search completed — the API works.
=#
@test report(mach).best_idx isa Intwhich uses Literate.jl to generate this page.
