投审稿入口

基于深度强化学习的辊缝智能调控

Intelligent roll gap control based on deep reinforcement learning

  • 摘要: 针对轧机在薄带轧制过程中液压伺服辊缝控制存在的强非线性、参数时变及传统方法自适应能力不足等问题,本文提出了一种融合贝叶斯估计与深度强化学习的智能控制方法。建立了面向控制的多辊轧机液压伺服系统机理模型,采用贝叶斯估计辨识系统关键参数,辨识均方误差达1.788×10-7 mm2。在此基础上,设计了基于多头注意力机制与TD3算法的深度强化学习控制器,通过增量式动作定义及融合历史偏差与工艺参数的状态空间设计,将辊缝控制问题建模为马尔可夫决策过程。仿真结果表明,该方法收敛速度优于标准DDPG算法,跟踪误差波动范围收窄至-3.4×10-3~1.2×10-3 mm,控制精度显著提升,可为多辊轧机薄带高精度轧制提供智能控制技术支撑。

     

    Abstract: To address the challenges of strong nonlinearity, parameter time-variation, and insufficient adaptive capability of traditional methods in hydraulic servo roll gap control during thin strip and ultra-thin strip rolling processes with multi-high mill, this paper proposes an intelligent control method integrating Bayesian estimation with deep reinforcement learning. A control-oriented mechanistic model of the hydraulic servo system for multi-high mills is established. Bayesian estimation is employed to identify key system parameters, achieving a mean square error of 1.788×10-7 mm2. On this basis, a deep reinforcement learning controller based on a multi-head attention mechanism and the TD3 algorithm is designed. The roll gap control problem is formulated as a Markov decision process through incremental action definition and state space construction incorporating historical deviations and process parameters. Simulation results demonstrate that the proposed method converges faster than the standard DDPG algorithm, reduces the tracking error fluctuation range to -3.4×10-3~1.2×10-3 mm, and significantly improves control accuracy. This provides intelligent control technical support for high-precision thin strip and ultra-thin strip rolling in multi-high mills.

     

/

返回文章
返回