---

• Xin Xu, Reinforcement Learning and Approximate Dynamic Programming, Science Press, 2010, Beijing, China

• Xin Xu, Machine Learning for Sequential Behavior Modeling and Prediction, In: Abdelhamid Mellouk and Abdennacer Chebira,ed. Machine Learning, 2009, I-Tech, Vienna, Austria

• Xin Xu, Reinforcement learning and neuro-dynamic programming, In: Dewen Hu, et al., ed. Neural Networks for Adaptive Control, Press of NUDT, 2007, Changsha, China

---

• Xin Xu, Dewen Hu, Xicheng Lu. Kernel-based least squares policy iteration for reinforcement learning. IEEE Transactions on Neural Networks, 2007, 18(4) 973-992   (Google scholar, cited 115 times) (regular paper)

• Xin Xu, Chunming Liu, Simon Yang, Dewen Hu. Hierarchial Approximate Policy Iteration with Binary-tree State Space Decomposition, IEEE Transactions on Neural Networks, 2011, 22(12): 1863-1877 (regular paper)

• Xin Xu, Zhongsheng Hou, Chuanqiang Lian and Haibo He. Online Learning Control Using Adaptive Critic Designs with Sparse Kernel Machines, IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(5):762 -775. (regular paper)

• Xin Xu, H.G. He, D.W. Hu. Efficient reinforcement learning using recursive least-squares methods. Journal of Artificial Intelligence Research, 2002,16: 259-292   (Google scholar, cited 95 times) (regular paper)

• Xin Xu, et al. Kernel-based Approximate Dynamic Programming for Real-time Online Learning Control: An Experimental Study.  IEEE Transactions on Control System Technology, 2014, 22(1): 146-156, (regular paper)

• Xin Xu,  Zhenhua Huang, Daniel Graves, Witold Pedrycz, A Clustering-based Graph Laplacian Framework for Value Function Approximation in Reinforcement Learning. IEEE Transactions on Cybernetics, 2014, 44(12):2613-2625 .

• Xin Xu, Huiyuan Yang, Chuanqiang Lian, Jiahang Liu: Self-Learning Control Using Dual Heuristic Programming with Global Laplacian Eigenmaps. IEEE Trans. Ind. Electron

• Xin Xu, Zhenhua Huang, Lei Zuo, Haibo He: Manifold-Based Reinforcement Learning via Locally Linear Reconstruction. IEEE Transactions on Neural Networks and Learning Systems. 28(4): 934-947 (2017)

• Xin Xu, Lei Zuo, Xin Li, Lilin Qian, Junkai Ren, Zhenping Sun: A Reinforcement Learning Approach to Autonomous Decision Making of Intelligent Vehicles on Highways. IEEE Trans. Syst. Man Cybern. Syst. 50(10): 3884-3897 (2020)

• Xin Xu, Hong Chen, Chuanqiang Lian, Dazi Li: Learning-Based Predictive Control for Discrete-Time Nonlinear Systems With Stochastic Disturbances.IEEE Transactions on Neural Networks and Learning Systems. 29(12): 6202-6213 (2018)

• Luntong Li, Dazi Li, Tianheng Song, Xin Xu: Actor-Critic Learning Control With Regularization and Feature Selection in Policy Gradient Estimation. IEEE Transactions on Neural Networks and Learning Systems. 32(3): 1217-1227 (2021)

• Jiahang Liu, Lei Zuo, Xin Xu, Xinglong Zhang, Junkai Ren, Qiang Fang, Xinwang Liu: Efficient Batch-Mode Reinforcement Learning Using Extreme Learning Machines. IEEE Trans. Syst. Man Cybern. Syst. 51(6): 3664-3677 (2021)

• Jiahang Liu, Zhenhua Huang, Xin Xu, Xinglong Zhang, Shiliang Sun, Dazi Li: Multi-Kernel Online Reinforcement Learning for Path Tracking Control of Intelligent Vehicles. IEEE Trans. Syst. Man Cybern. Syst. 51(11): 6962-6975 (2021)

• Chao Yu, Xin Wang, Xin Xu, Minjie Zhang, Hongwei Ge, Jiankang Ren, Liang Sun, Bingcai Chen, Guozhen Tan: Distributed Multiagent Coordinated Learning for Autonomous Driving in Highways Based on Dynamic Coordination Graphs. IEEE Trans. Intell. Transp. Syst. 21(2): 735-748 (2020)

• Xifeng Guo, Xinwang Liu, En Zhu, Xinzhong Zhu, Miaomiao Li, Xin Xu, Jianping Yin: Adaptive Self-Paced Deep Clustering with Data Augmentation. IEEE Trans. Knowl. Data Eng. 32(9): 1680-1693 (2020)

• Zhenhua Huang, Xin Xu, Haibo He, Jun Tan, Zhenping Sun: Parameterized Batch Reinforcement Learning for Longitudinal Control of Autonomous Land Vehicles. IEEE Trans. Syst. Man Cybern. Syst. 49(4): 730-741 (2019)

• Jian Yang, Xin Xu, Dong Yin, Zhaowei Ma, Lincheng Shen: A Space Mapping Based 0-1 Linear Model for Onboard Conflict Resolution of Heterogeneous Unmanned Aerial Vehicles. IEEE Trans. Veh. Technol. 68(8): 7455-7465 (2019)

• Luntong Li, Dazi Li, Tianheng Song, Xin Xu: Actor-Critic Learning Control Based on l2-Regularized Temporal-Difference Prediction With Gradient Correction. IEEE Transactions on Neural Networks and Learning Systems 29(12): 5899-5909 (2018)

• Yujun Zeng, Xin Xu, Dayong Shen, Yuqiang Fang, Zhipeng Xiao: Traffic Sign Recognition Using Kernel Extreme Learning Machines With Deep Perceptual Features. IEEE Trans. Intell. Transp. Syst. 18(6): 1647-1653 (2017)

• Yifei Shi, Junwen Huang, Hongjia Zhang, Xin Xu, Szymon Rusinkiewicz, Kai Xu: SymmetryNet: learning to predict reflectional and rotational symmetries of 3D shapes from single-view RGB-D images. ACM Trans. Graph. 39(6): 213:1-213:14 (2020)

• Chuanqiang Lian, Xin Xu, Hong Chen, Haibo He: Near-Optimal Tracking Control of Mobile Robots Via Receding-Horizon Dual Heuristic Programming. IEEE Trans. Cybern. 46(11): 2484-2496 (2016)

• Yufei Tang, Haibo He, Zhen Ni, Xiangnan Zhong, Dongbin Zhao, Xin Xu: Fuzzy-Based Goal Representation Adaptive Dynamic Programming. IEEE Trans. Fuzzy Syst. 24(5): 1159-1175 (2016)

• Zhen Ni, Haibo He, Dongbin Zhao, Xin Xu, Danil V. Prokhorov: GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming. IEEE Trans. Neural Networks Learn. Syst. 26(3): 614-627 (2015)

• Shiliang Sun, Xin Xu. Variational Inference for Infinite Mixtures of Gaussian Processes with Applications to Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems,2011, 12(2): 466-475. (regular paper)

• Haibo He, Sheng Chen, Kang Li, and Xin Xu. Incremental learning from stream data. IEEE Transactions on Neural Networks, 2011, 22(12):  1901-1914. (regular paper)

• Junping Zhang, Feiyue Wang, Kungfeng Wang, Weihua Lin, Xin Xu, Cheng Chen. Data-Driven Intelligent Transportation Systems: A Survey.  IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1624-1639. (regular paper)

• Zhongsheng Hou, Xin Xu, Jingwen Yan, Jian-Xin Xu, Gang Xiong: A Complementary Modularized Ramp Metering Approach Based on Iterative Learning Control and ALINEA. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1305-1318.(regular paper)

• Jian Li, Martin D. Levine, Xiangjing An, Xin Xu and Hangen He. Visual Saliency Based on Scale-Space Analysis in the Frequency Domain. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(4): 996-1010. (regular paper) [Html] [Dataset]

• Tianjiang Hu,  K. H. Low, Lincheng Shen, and Xin Xu. Effective Phase Tracking for Bioinspired Undulations of Robotic Fish Models: A Learning Control Approach. IEEE Transactions on Mechatronics, 2014, 19(1): 191-200.  (regular paper)

• Zhen Ni, Haibo He, Jinyu Wen, and Xin Xu, Goal Representation Heuristic Dynamic Programming on Maze Navigation. IEEE Transactions on Neural Networks and Learning Systems,  2013, 24(12): 2038-2050 (regular paper)

• Jian Wang, Xin Xu, et al. Self-learning Cruise Control Using Kernel-Based Least Squares Policy Iteration.  IEEE Transactions on Control System Technology, 2014, 22(3): 1078-1087.

• Chunming Liu, Xin Xu, Dewen Hu: Multiobjective Reinforcement Learning: A Comprehensive Overview. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015, 45(3): 385-398.

• Z. Ni, H. He, D. Zhao, X. Xu, and D. Prokhorov, GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming, IEEE Transactions on Neural Networks and Learning Systems, 2015, vol. 26, issue 3, pp. 614-627, 2015

• Zhao, Chenyang Zhu, Xin Xu, Hui Huang & Kai Xu. Learning Practically Feasible Policies for Online 3D Bin Packing. SCIENCE CHINA Information Sciences. 2021.

• Yan Jiang, Xinglong Zhang, Xin Xu, Xing Zhou, Zhengzheng Dong: Event-triggered shared lateral control for safe-maneuver of intelligent vehicles. Sci. China Inf. Sci. 64(7) (2021)

• Xiaochang Hu, Yujun Zeng, Xin Xu, Sihang Zhou, Li Liu: Robust semi-supervised classification based on data augmented online ELMs with deep features. Knowl. Based Syst. 229: 107307 (2021)

• Ni Xiao, Lei Zhang, Xin Xu, Tan Guo, Huimin Ma: Label Disentangled Analysis for unsupervised visual domain adaptation. Knowl. Based Syst. 229: 107309 (2021)

• Kai Gao, Jianpo Su, Zhongbiao Jiang, Ling-Li Zeng, Zhichao Feng, Hui Shen, Pengfei Rong, Xin Xu, Jian Qin, Yuexiang Yang, Wei Wang, Dewen Hu: Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images. Medical Image Anal. 67: 101836 (2021)

• Junxiang Li, Liang Yao, Xin Xu, Bang Cheng, Junkai Ren: Deep reinforcement learning for pedestrian collision avoidance and human-machine cooperative driving. Inf. Sci. 532: 110-124 (2020)

• Li Wang, Dawei Zhao, Tao Wu, Hao Fu, Zhiyu Wang, Liang Xiao, Xin Xu, Bin Dai: Drosophila-inspired 3D moving object detection based on point clouds. Inf. Sci. 534: 154-171 (2020)

• Junxiang Li, Bin Dai, Xiaohui Li, Ruili Wang, Xin Xu, Bohan Jiang, Yi Di: An Interaction-Aware predictive motion Planner for Unmanned Ground Vehicles in Dynamic Street Scenarios. Int. J. Robotics Autom. 34(3) (2019)

• Dawei Zhao, Liang Xiao, Hao Fu, Tao Wu, Xin Xu, Bin Dai: Augmenting cascaded correlation filters with spatial-temporal saliency for visual tracking. Inf. Sci. 470: 78-93 (2019)

• Jun Wu, Xin Xu: Decentralised grid scheduling approach based on multi-agent reinforcement learning and gossip mechanism. CAAI Trans. Intell. Technol. 3(1): 8-17 (2018)

• Wei Wang, Lei Zuo, Xin Xu: A Learning-based Multi-RRT Approach for Robot Path Planning in Narrow Passages. J. Intell. Robotic Syst. 90(1-2): 81-100 (2018)

• Hao Fu, Rui Yu, Lei Ye, Tao Wu, Xin Xu: An Efficient Scan-to-Map Matching Approach Based on Multi-channel Lidar. J. Intell. Robotic Syst. 91(3-4): 501-513 (2018)

• Jiahang Liu, Xin Xu, Zhenhua Huang, Chuanqiang Lian: Model-Free Multi-Kernel Learning control for nonlinear discrete-Time Systems. Int. J. Robotics Autom. 32(5) (2017)

• Zhenhua Huang, Chuanqiang Lian, Xin Xu, Jian Wang: Lateral control for Autonomous land Vehicles via Dual Heuristic Programming. Int. J. Robotics Autom. 31(6) (2016)

• Lei Ye, Can Wang, Xin Xu, Wei Chen: Multi-class l2-Boost with the scoring coding. Int. J. Wavelets Multiresolution Inf. Process. 14(6): 1650049:1-1650049:16 (2016)

• Daxue Liu, Jun Wu, Xin Xu: Multi-agent reinforcement learning using ordinal action selection and approximate policy iteration. Int. J. Wavelets Multiresolution Inf. Process. 14(6): 1650053:1-1650053:18 (2016)

• Xin Xu,  Zhenhua Huang, Lei Zuo. Reinforcement Learning Algorithms with Function Approximation: Recent Advances and Applications. Information Sciences, 2014, 261:1-31. 

• Tingbo Hu, Tao Wu, Xin Xu, et al. Stereo Matching using Weighted Dynamic Programming on a Single-Direction Four-Connected Tree. Computer Vision and Image Understanding.  2012, 116(8): 908-921  (regular paper)

• Jian Wang, Zhenping Sun, Xin Xu, et al. Adaptive Speed Tracking Control for Autonomous Land Vehicles in All-Terrain Navigation: An Experimental Study. Journal of Field Robotics, 2013, 30(1): 102-128. (regular paper)

• Xin Xu. Sequential Anomaly Detection Based on Temporal-Difference Learning: Principles, Models and Case Studies. Applied Soft Computing, 2010, 10(3): 859-867. (regular paper)

• Xin Xu, Chunming Liu, Dewen Hu. Continuous-Action Reinforcement Learning with Fast Policy Search and Adaptive Basis Function Selection. Soft Computing, 2011, 15(6): 1055-1070.  (regular paper)

• Xin Xu, Rob Law, Tao Wu. Support Vector Machines with Manifold Learning and Probabilistic Space Projection for Tourist Expenditure Analysis. International Journal of Computational Intelligence Systems, 2009, 2(1): 17 - 26

• Zhenhua Huang, Xin Xu, et al. Reinforcement Learning with Automatic Basis Construction Based on Isometric Feature Mapping. Information Sciences, 2014, 286: 209-227.

• Xin Xu, Cong Wang, Frank L. Lewis. Editorial: Some Recent Advances in Learning and Adaptation for Uncertain Feedback Control Systems. International Journal of Adaptive Control and Signal Processing, 2014, 28(3-5): 201-204.

• Xin Xu, et al. Kernel Least-Squares Temporal Difference Learning. International Journal of Information Technology, Institute of Singapore (ICIS), 2005, 11(9): 54-63

• Lei Zuo, Qi Guo, Xin Xu, Hao Fu. A hierarchical path planning approach based on A* and least-squares policy iteration for mobile robots. Neurocomputing, 2015, 170: 257-266.

• Lei Zuo, Xin Xu, Chunming Liu , Zhenhua Huang, A hierarchical reinforcement learning approach for optimal path-tracking of wheeled mobile robots. Neural Computing and Applications, 2013.

• Chuanqiang Lian, Xin Xu, Lei Zuo and Zhenhua Huang, Adaptive critic design with graph Laplacian for online learning control of nonlinear systems. International Journal of Adaptive Control and Signal Processing, 2014, 28(3-5): 290-304.

• Xin Xu. Adaptive Intrusion Detection Based on Machine Learning: Feature Extraction, Classifier Construction and Sequential Pattern Prediction. International Journal of Web Service Practice, 2006, 2(1-2):49-58

• Xin Xu. Intrusion detection based on dynamic behavior modeling: reinforcement learning versus Hidden Markov Models. International Journal of Computational Intelligence Theory and Practice, 2007, 2(1): 57-66

• Qi Wu, Rob Law, Xin Xu. A sparse Gaussian process regression model for tourism demand forecasting in Hong Kong. Expert Systems with Applications. 39(5): 4769-4774.

• Jun Wu, Xin Xu, et al., A Novel Multi-agent Reinforcement Learning Approach for Job Scheduling in Grid Computing. Future Generation Computer Systems, 2011, 27(5): 430-439.

• Wei Wang, Xin Xu, Yan Li, Triple RRTs: An effective method for path planning in narrow passage, Advanced Robotics, 2010, vol. 24, no. 7, pp. 943-962. [pdf]

• Xin Liu, Xin Xu, Bin Dai. Vision-based long-distance lane perception and front vehicle location for full autonomous vehicles on highway roads. Journal of Central South University, 2012,Volume 19, Issue 5, pp 1454-1465.

• Xin Xu, Haibo He, Dongbin Zhao, Shiliang Sun, Lucian Busoniu, and Simon X. Yang. Editorial: Machine Learning with Applications to Autonomous Systems. Mathematical Problems in Engineering, Volume 2015 (2015), Article ID 385028

• Xin Xu. Editorial: Special section on reinforcement learning and approximate dynamic programming. Journal of Intelligent Learning Systems and Applications, 2010, 2(2): 55-56.

• Gang wang, Xin Xu, Dewen Hu, et al. Uniqueness of maximum non-Gaussianity estimation: a revisit from the perspective of contrained cost-function optimization. International Journal of Intelligent Computing and Applications, 2008, 1(1):53-69.

---

• Zhenhua Huang, Xin Xu, Jun Wu, Lei Zuo: Fuzzy C-means method for representation policy iteration in reinforcement learning. ICNSC 2012: 175-180

• Xin Xu, Peng Chengzhang, Bin Dai, Han-gen He. A Kernel-based Reinforcement Learning Approach to Stochastic Pole Balancing Control Systems, IEEE/ASME International Conference on Advanced Intelligent Mechatronics , 2010,

• Yujun Zeng, Xin Xu, Yuqiang Fang, Kun Zhao: Traffic Sign Recognition Using Deep Convolutional Networks and Extreme Learning Machine. IScIDE (1) 2015: 272-280

• Jun Wu, Xin Xu , Zhaobin Li, Yan Huang, and Jian Wang, Adaptive kernel-width selection for kernel-based least-squares policy ieration algorithm, Proceedings of IEEE International Symposium on Neural Networks, 2011

• Wei Wang, Yan Li, Xin Xu, Simon X. Yang: An adaptive roadmap guided Multi-RRTs strategy for single query path planning. International Conference on Robotics and Automation (ICRA), 2010: 2871-2876

• Pengcheng Zhang, Xin Xu, Chunming Liu, and Qiping Yuan. Reinforcement Learning Control of a Real Mobile Robot Using Approximate Policy Iteration. ISNN 2009, Part III, Lecture Notes in Computer Science, LNCS 5553, pp. 278-288, 2009.

• Xin Xu, Hongyu Zhang, Bin Dai, Han-gen He: Self-learning path-tracking control of autonomous vehicles using kernel-based approximate dynamic programming. Proc. of International Joint Conference on Neural Networks, 2008: 2182-2189

• Jun Wu, Xin Xu, Chuan-qiang Lian, Yan Huang. Adaptive dual heuristic programming based on delta-bar-delta learning Rule. Proceedings of International Symposium on Neural Networks, 2011

• Jun Wu, Xin Xu, Zhen-ping Sun, Yan Huang: Cooperative multi-agent reinforcement learning based on online heuristic extraction. ICNC 2011: 1299-1303

• Huiyuan Yang, Qi Guo, Xin Xu, Chuanqiang Lian: Self-learning PD algorithms based on approximate dynamic programming for robot motion planning. IJCNN 2014: 3663-3670

• Chunming Liu, Jinze Song, Xin Xu, and Pengcheng Zhang. Reordering Sparsification of Kernel Machines in Approximate Policy Iteration. ISNN 2009, Part II, Lecture Notes in Computer Science, LNCS 5552, pp. 398-407, 2009

• Xin Xu, Rob Law, Tao Wu: Classification of Business Travelers Using SVMs Combined with Kernel Principal Component Analysis. Lecture Notes in Artificial Intelligence, Proc. of ADMA 2007, LNCS: 524-532

• Chunming Liu, Xin Xu, et al. Adaptive Sample Collection Using Active Learning for Kernel-based Approximate Policy Iteration. In: Proc. of IEEE International Symposium on ADP and RL, Paris, 2011.

• Wei Wang, Xin Xu, Yan Li, Path Planning for Redundant Manipulator without Explicit Inverse Kinematics Solution. Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics, December 19 -23, 2009, Guilin, China

• Xin Xu, Yirong Luo: A Kernel-Based Reinforcement Learning Approach to Dynamic Behavior Modeling of Intrusion Detection. Lecture Notes in Computer Science,Proc. of ISNN (1) 2007: 455-464

• Xin Xu, Yongqiang Sun, Zunguo Huang: Defending DDoS Attacks Using Hidden Markov Models and Cooperative Reinforcement Learning. Lecture Notes in Computer Science, Proc. of PAISI 2007: 196-207

• Wei Chen, Xuening Wang, Tao Wu, Xin Xu: Visual Protractor Based Localization Algorithm for Mobile Robot. Proc. of ISDA (3) 2006: 67-71

• Gang Wang, Xin Xu, Dewen Hu: Local Stability Analysis of Maximum Nongaussianity Estimation in Independent Component Analysis. Lecture Notes in Computer Science, Proc. of ISNN (1) 2006: 1133-1139

• Xin Xu, Xuening Wang. An adaptive network intrusion detection method based on PCA and support vector machines. Lecture Notes in Artificial Intelligence, ADMA 2005: 696-703

• Xin Xu. A sparse kernel-based least-squares temporal difference algorithm for reinforcement learning. Lecture Notes in Computer Science, ICNC (1) 2006: 47-56

• Xin Xu, et al. A reinforcement learning approach for host-based intrusion detection using sequences of system calls. Lecture Notes in Computer Science, ICIC (1) 2005: 995-1003

• Xin Xu, Xuening Wang, Dewen Hu. Mobile robot path-tracking using an adaptive critic learning PD controller. Lecture Notes in Computer Science, ISNN(2), 2004: 25-34

• Xin Xu, et al. Text Categorization Using SVMs with Rocchio Ensemble for Internet Information Classification. Lecture Notes in Computer Science, ICCNMC, 2005, LNCS 3619, pp. 1022-1031,

• Xin Xu, et al. Autonomic Computing for Defense-in-Depth Information Assurance: Architecture and A Case Study, Lecture Notes in Computer Science, GCC, 2004, LNCS 3252, pp: 414-421.

• Xin Xu, et al. A Self-Learning Reactive Navigation Method for Mobile Robots. Proceedings of IEEE Int. Conference on Machine Learning and Cybemetics, 2003

• Gang Wang, Xin Xu, Global Convergence of FastICA: Theoretical Analysis and Practical Considerations. Lecture Notes in Computer Science, ICNC, 2005, 700-705

• Gang Wang, Xin Xu, Self-Adaptive FastICA Based on Generalized Gaussian Model. Lecture Notes in Computer Science, ISNN, 2005, 961-966

• Xin Xu, et al. Residual-gradient-based neural reinforcement learning for the optimal control of an acrobat. Proceedings of the 2002 IEEE International Symposium on Intelligent Control, Canada, 758- 763

---