Last updated: Jan 18, 2024
The Evaluation node helps to evaluate and compare predictive models. The evaluation chart shows how well models predict particular outcomes. It sorts records based on the predicted value and confidence of the prediction. It splits the records into groups of equal size (quantiles) and then plots the value of the business criterion for each quantile from highest to lowest. Multiple models are shown as separate lines in the plot.
Example
stream = modeler.script.stream()
typenode = stream.findByID("id42KW3MSA94B")
node = stream.create("evaluation", "My node")
stream.link(typenode, node)
# "Plot" tab
node.setPropertyValue("chart_type", "Gains")
node.setPropertyValue("cumulative", False)
node.setPropertyValue("field_detection_method", "Name")
node.setPropertyValue("inc_baseline", True)
node.setPropertyValue("n_tile", "Deciles")
node.setPropertyValue("style", "Point")
node.setPropertyValue("plot_score_fields", True)
node.setPropertyValue("score_fields", ["Na", "K", "Age"])
node.setPropertyValue("use_fixed_cost", True)
node.setPropertyValue("cost_value", 5.0)
node.setPropertyValue("target_field", "Drug")
node.setPropertyValue("cost_field", "Na")
node.setPropertyValue("use_fixed_revenue", True)
node.setPropertyValue("revenue_value", 30.0)
node.setPropertyValue("revenue_field", "Age")
node.setPropertyValue("use_fixed_weight", True)
node.setPropertyValue("weight_value", 2.0)
node.setPropertyValue("weight_field", "K")
evaluationnode properties |
Data type | Property description |
---|---|---|
chart_type |
Gains Response Lift Profit ROI ROC |
|
inc_baseline |
flag | |
field_detection_method |
Metadata
Name
|
|
use_fixed_cost |
flag | |
cost_value |
number | |
cost_field |
string | |
use_fixed_revenue |
flag | |
revenue_value |
number | |
revenue_field |
string | |
use_fixed_weight |
flag | |
weight_value |
number | |
weight_field |
field | |
n_tile |
Quartiles
Quintles
Deciles
Vingtiles
Percentiles
1000-tiles
|
|
cumulative |
flag | |
style |
Line
Point
|
|
point_type |
Rectangle Dot Triangle Hexagon Plus Pentagon Star BowTie HorizontalDash VerticalDash IronCross Factory House Cathedral OnionDome ConcaveTriangle
OblateGlobe CatEye FourSidedPillow RoundRectangle Fan
|
|
export_data
|
flag | |
data_filename
|
string | |
delimiter
|
string | |
new_line
|
flag | |
inc_field_names
|
flag | |
inc_best_line |
flag | |
inc_business_rule |
flag | |
business_rule_condition |
string | |
plot_score_fields |
flag | |
score_fields |
[field1 ... fieldN] | |
target_field |
field | |
use_hit_condition |
flag | |
hit_condition |
string | |
use_score_expression |
flag | |
score_expression |
string | |
caption_auto |
flag | |
split_by_partition |
boolean | If a partition field is used to split records into training, test, and validation samples, use this option to display a separate evaluation chart for each partition. |
use_profit_criteria |
boolean | Enables profit criteria. |
use_grid |
boolean | Displays grid lines. |