Обучение XGBoost продолжает терпеть неудачу - PullRequest
Новая
       15

Обучение XGBoost продолжает терпеть неудачу

0 голосов
/ 25 июня 2018

Я пытаюсь запустить любой код XGBoost с помощью Spark, но безуспешно. Я также пробовал копировать примеры вставки, но они также не работают. Допустим, у нас есть пример кода: https://docs.azuredatabricks.net/_static/notebooks/xgboost-simple-example.html

Всякий раз, когда я запускаю метод XGBoost.trainWithDataFrame, я всегда получаю эту ошибку при использовании двоичного: цель логистики: 

Check failed: base_score > 0.0f && base_score < 1.0f base_score must be in (0,1) for logistic loss

Я получаю эту ошибку все время с данными каждого поезда, также изменение других параметров не помогает вообще.

При использовании устаревшего XGBoost.train я получаю эти ошибки (я увеличил число раундов, чтобы генерировать больше этих ошибок): 

[INFO] [06/25/2018 10:30:46.399] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [17] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.560] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [18] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.720] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [19] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2[10:30:46] /xgboost/src/tree/updater_prune.cc: pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:46.879] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [20] train-error:0.538462
[10:30:46] /xgboost/src/tree/updater_prune.cc:[10:30:46] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.040] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [21] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.199] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [22] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0

[INFO] [06/25/2018 10:30:47.359] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [23] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:47.519] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [24]    train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.679] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [25] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:47.839] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [26] train-error:0.538462
[10:30:47] /xgboost/src/tree/updater_prune.cc:[10:30:47] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.001] [RabitTracker-akka.actor.default-dispatcher-10] [akka://RabitTracker/user/Handler] [27]    train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0:74: tree pruning end, 1 roots, 
0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.160] [RabitTracker-akka.actor.default-dispatcher-6] [akka://RabitTracker/user/Handler] [28] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:4874: tree pruning end, 1 roots, ] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.319] [RabitTracker-akka.actor.default-dispatcher-3] [akka://RabitTracker/user/Handler] [29] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.479] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [30] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 274: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth= pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:48.639] [RabitTracker-akka.actor.default-dispatcher-9] [akka://RabitTracker/user/Handler] [31] train-error:0.538462
[10:30:48[10:30:48] /xgboost/src/tree/updater_prune.cc:] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 174: tree pruning end,  roots, 0 extra nodes, 2 pruned nodes, max_depth=0
1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:48.799] [RabitTracker-akka.actor.default-dispatcher-4] [akka://RabitTracker/user/Handler] [32] train-error:0.538462
[10:30:48] /xgboost/src/tree/updater_prune.cc:[10:30:48] /xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
0
[INFO] [06/25/2018 10:30:48.960] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [33] train-error:0.538462
[10:30:49] [10:30:49] /xgboost/src/tree/updater_prune.cc:/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:49.119] [RabitTracker-akka.actor.default-dispatcher-2] [akka://RabitTracker/user/Handler] [34] train-error:0.538462
[10:30:49] /xgboost/src/tree/updater_prune.cc:[10:30:49] 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
[INFO] [06/25/2018 10:30:49.279] [RabitTracker-akka.actor.default-dispatcher-7] [akka://RabitTracker/user/Handler] [35] train-error:0.538462
[10:30:49] /xgboost/src/tree/updater_prune.cc:[10:30:49] 74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0
/xgboost/src/tree/updater_prune.cc:74: tree pruning end, 1 roots, 0 extra nodes, 2 pruned nodes, max_depth=0

Протестировано на SPark 2.1.0, 2.2.0, 2.3.0, Scala 2.11.

Я использую версию 0.72 xgboost.

Я не смог найти ответа на мою проблему. Что я делаю не так?

1 Ответ

0 голосов
/ 25 июня 2018

Вы используете Mac? У меня была точно такая же проблема с моим Spark xgboost на Mac.

Вот еще немного информации об этом: У xgboost для JVM есть тестовые сбои на OS X

Я применил предложенный патч вручную Убрал специализации для поплавка / двойного разбора , и он заработал.

  1. Клон репо
  2. Измените include/dmlc/parameter.h, как указано в патче
  3. Скомпилируйте ваш код xgboost снова
...