training_20250718_011032.log 2.7 KB

1234567891011121314151617181920212223242526272829303132333435363738
  1. /qwen/venv/lib/python3.10/site-packages/transformers/utils/hub.py:111: FutureWarning: Using `TRANSFORMERS_CACHE` is deprecated and will be removed in v5 of Transformers. Use `HF_HOME` instead.
  2. warnings.warn(
  3. 2025-07-18 01:10:37 - root - INFO - 日志系统已初始化,日志文件: /qwen/logs/training_20250718_011037.log
  4. 2025-07-18 01:10:37 - TrainingMonitor - INFO - 训练监控器已初始化,监控间隔: 30秒
  5. 2025-07-18 01:10:37 - SecurityModelApp - INFO - 网络安全模型应用程序已初始化
  6. === 模型选择 ===
  7. 可用的模型:
  8. 1. qwen2.5-1.5b-instruct: Qwen2.5-1.5B-Instruct (qwen2)
  9. 2. qwen2-1.5b-instruct: Qwen2-1.5B-Instruct (qwen2)
  10. 3. qwen2-7b-instruct: Qwen2-7B-Instruct (qwen2)
  11. 4. chatglm3-6b: ChatGLM3-6B (chatglm)
  12. 5. baichuan2-7b-chat: Baichuan2-7B-Chat (baichuan)
  13. 6. llama2-7b-chat: Llama2-7B-Chat (llama)
  14. 默认模型: Qwen2.5-1.5B-Instruct (qwen2.5-1.5b-instruct)
  15. 请选择模型 (输入数字编号,或直接回车使用默认模型):
  16. > 2025-07-18 01:10:39 - SecurityModelApp - INFO - 开始完整训练流程...
  17. 2025-07-18 01:10:39 - SecurityModelApp - INFO - 开始环境检查...
  18. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - 开始环境检查...
  19. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ python_version: Python 3.10.12
  20. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ cuda_availability: CUDA 12.6, 1 GPU(s), NVIDIA P106-100
  21. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ gpu_memory: 总内存: 5.9GB, 可用: 5.9GB
  22. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ disk_space: 总空间: 441.4GB, 可用: 377.7GB
  23. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ system_memory: 总内存: 15.6GB, 可用: 13.3GB
  24. 2025-07-18 01:10:39 - EnvironmentChecker - INFO - ✓ required_packages: 已安装: 8/8
  25. 2025-07-18 01:10:49 - EnvironmentChecker - INFO - ✓ network_connectivity: HuggingFace: ✗, ModelScope: ✓
  26. 2025-07-18 01:10:49 - EnvironmentChecker - INFO - ✓ directory_permissions: 所有目录可写
  27. 2025-07-18 01:10:49 - EnvironmentChecker - INFO -
  28. 环境检查完成: 8/8 项通过
  29. 2025-07-18 01:10:49 - EnvironmentChecker - INFO - ✓ 环境检查全部通过,可以开始训练
  30. 2025-07-18 01:10:49 - SecurityModelApp - INFO - 开始数据准备...
  31. 2025-07-18 01:10:49 - SecurityModelApp - INFO - 发现已处理的数据,跳过数据下载和处理
  32. 2025-07-18 01:10:49 - SecurityModelApp - INFO - 开始新的模型训练...
  33. 2025-07-18 01:10:49 - TrainingMonitor - INFO - 开始训练监控
  34. 2025-07-18 01:10:49 - SecurityModelApp - INFO - 设置模型...
  35. 2025-07-18 01:10:49 - ModelDownloader - INFO - 开始下载模型: qwen2.5-1.5b-instruct
  36. 2025-07-18 01:10:49 - ModelDownloader - INFO - 使用git clone从ModelScope下载: https://www.modelscope.cn/qwen/Qwen2.5-1.5B-Instruct.git