pipeline¶
news_recommendation.pipeline
Rebuild the three article representations, optionally regenerating segmentation and summaries, and train.
python -m news_recommendation.pipeline replay --output runs/replay [--train]
python -m news_recommendation.pipeline regenerate --output runs/regenerated [--train]
replay rebuilds the impression splits and packs the saved segmentation, summaries, and segment selection;
regenerate first segments the full-text catalog and generates both kinds of summary.
Each step runs in its own environment and logs to
steps(output, regenerate, train, segmentation_python, generation_python, summary_gpus, training_gpus)
¶
(name, command) of every step.
Source code in src/news_recommendation/pipeline.py
22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 | |
main()
¶
Source code in src/news_recommendation/pipeline.py
46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | |