---

• Xin Xu, Dewen Hu, Xicheng Lu. Kernel-based least squares policy iteration for reinforcement learning. IEEE Transactions on Neural Networks, 2007, 18(4) 973-992   (Google scholar, cited 115 times) (regular paper)

• Xin Xu, Chunming Liu, Simon Yang, Dewen Hu. Hierarchial Approximate Policy Iteration with Binary-tree State Space Decomposition, IEEE Transactions on Neural Networks, 2011, 22(12): 1863-1877 (regular paper)

• Xin Xu. Sequential Anomaly Detection Based on Temporal-Difference Learning: Principles, Models and Case Studies. Applied Soft Computing, 2010, 10(3): 859-867.(regular paper)

• Xin Xu, Chunming Liu, Dewen Hu. Continuous-Action Reinforcement Learning with Fast Policy Search and Adaptive Basis Function Selection. Soft Computing, 2011, 15(6): 1055-1070.  (regular paper)

• Xin Xu, H.G. He, D.W. Hu. Efficient reinforcement learning using recursive least-squares methods. Journal of Artificial Intelligence Research, 2002,16: 259-292   (Google scholar, cited 95 times) (regular paper)

• Xin Xu, Zhongsheng Hou, Chuanqiang Lian and Haibo He. Online Learning Control Using Adaptive Critic Designs with Sparse Kernel Machines, IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(5):762 -775. (regular paper)

• Xin Xu, et al. Kernel-based Approximate Dynamic Programming for Real-time Online Learning Control: An Experimental Study.  IEEE Transactions on Control System Technology, 2014, 22(1): 146-156, (regular paper)

• Xin Xu,  Zhenhua Huang, Daniel Graves, Witold Pedrycz, A Clustering-based Graph Laplacian Framework for Value Function Approximation in Reinforcement Learning. IEEE Transactions on Cybernetics, 2014, 44(12):2613-2625 .

• Xin Xu, et al. Manifold Reinforcement Learning via Locally Linear Reconstruction.  IEEE Transactions on Neural Networks and Learning Systems, 2015, in press.

• Zhen Ni, Haibo He, Jinyu Wen, and Xin Xu, Goal Representation Heuristic Dynamic Programming on Maze Navigation. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(12): 2038-2050 (regular paper)

• C. Lian, Xin Xu, H. Chen, and H. He, "Near-optimal Tracking Control of Mobile Robots via Receding-horizon Dual Heuristic Programming," IEEE Transactions on Cybernetics, 2015 (in press)

• Jian Wang, Xin Xu, et al. Self-learning Cruise Control Using Kernel-Based Least Squares Policy Iteration.  IEEE Transactions on Control System Technology, 2013, in press.

• Zhenhua Huang, Xin Xu, Haibo He, et al. Parameterized Batch Reinforcement Learning for Longitudinal Control of Autonomous Land Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2017, in press.

• Chunming Liu, Xin Xu, Dewen Hu: Multiobjective Reinforcement Learning: A Comprehensive Overview. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015, 45(3): 385-398.

• Z. Ni, H. He, D. Zhao, X. Xu, and D. Prokhorov, GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming, IEEE Transactions on Neural Networks and Learning Systems, 2015, vol. 26, issue 3, pp. 614-627, 2015.

• Xin Xu,  Zhenhua Huang, Lei Zuo. Reinforcement Learning Algorithms with Function Approximation: Recent Advances and Applications. Information Sciences, 2014, 261:1-31.  

• Wei Wang, Lei Zuo, Xin Xu. A Learning-based Multi-RRT Approach for Robot Path Planning in Narrow Passages. Journal of Intelligent & Robotic Systems, 2017, in press.

• Xin Xu, et al. Kernel Least-Squares Temporal Difference Learning. International Journal of Information Technology, Institute of Singapore (ICIS), 2005, 11(9): 54-63

• Yufei Tang,  Haibo He,  Zhen Ni, Xiangnan Zhong, Dongbin Zhao, and Xin Xu, Fuzzy-Based Goal Representation Adaptive Dynamic Programming.  IEEE Transactions on Fuzzy Systems, 2015, regular paper, in press.

• Jun Wu, Xin Xu, et al., A Novel Multi-agent Reinforcement Learning Approach for Job Scheduling in Grid Computing. Future Generation Computer Systems, 2011, 27(5): 430-439. (regular paper)

• Jian Wang, Zhenping Sun, Xin Xu, et al. Adaptive Speed Tracking Control for Autonomous Land Vehicles in All-Terrain Navigation: An Experimental Study. Journal of Field Robotics, 2013, 30(1): 102-128. (regular paper)

• Zhenhua Huang, Xin Xu, et al. Reinforcement Learning with Automatic Basis Construction Based on Isometric Feature Mapping. Information Sciences, 2014, In press.

• Xin Xu, Cong Wang, Frank L. Lewis. Editorial: Some Recent Advances in Learning and Adaptation for Uncertain Feedback Control Systems. International Journal of Adaptive Control and Signal Processing, 2014, 28(3-5): 201-204.

• Lei Zuo, Qi Guo, Xin Xu, Hao Fu. A hierarchical path planning approach based on A* and least-squares policy iteration for mobile robots. Neurocomputing, 2015, 170: 257-266.

• Xin Xu. Editorial: Special section on reinforcement learning and approximate dynamic programming. Journal of Intelligent Learning Systems and Applications, 2010, 2(2): 55-56.

• Xin Xu, Reinforcement Learning and Approximate Dynamic Programming, Science Press, 2010, Beijing, China

• Xin Xu, Machine Learning for Sequential Behavior Modeling and Prediction, In: Abdelhamid Mellouk and Abdennacer Chebira,ed. Machine Learning, 2009, I-Tech, Vienna, Austria

• Xin Xu, Han-gen He, A Gradient Algorithm for Neural-Network-Based Reinforcement Learning, Chinese Journal of Computers, 2003, 26(2): 227-233

• Xuening Wang, Xin Xu, Tao Wu, et al. The Optimal Reward Baseline for Policy-Gradient Reinforcement Learning. Chinese Journal of Computers, 2005, 28(6):1021-1026

• Zhongsheng Hou, Xin Xu, Jingwen Yan, Jian-Xin Xu, Gang Xiong: A Complementary Modularized Ramp Metering Approach Based on Iterative Learning Control and ALINEA. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1305-1318.  (regular paper)

• Xin Xu, Reinforcement learning and neuro-dynamic programming, In: Dewen Hu, et al., ed. Neural Networks for Adaptive Control, Press of NUDT, 2007, Changsha, China

• Tianjiang Hu,  K. H. Low, Lincheng Shen, and Xin Xu. Effective Phase Tracking for Bioinspired Undulations of Robotic Fish Models: A Learning Control Approach. IEEE Transactions on Mechatronics, 2014, 19(1): 191-200.  (regular paper)

• Chuanqiang Lian, Xin Xu, Lei Zuo and Zhenhua Huang, Adaptive critic design with graph Laplacian for online learning control of nonlinear systems. International Journal of Adaptive Control and Signal Processing, 2014, 28(3-5): 290-304.

• Zhenhua Huang, Xin Xu, Jun Wu, Lei Zuo: Fuzzy C-means method for representation policy iteration in reinforcement learning. ICNSC 2012: 175-180

• Xin Xu, Peng Chengzhang, Bin Dai, Han-gen He. A Kernel-based Reinforcement Learning Approach to Stochastic Pole Balancing Control Systems, IEEE/ASME International Conference on Advanced Intelligent Mechatronics , 2010,

• Jun Wu, Xin Xu , Zhaobin Li, Yan Huang, and Jian Wang, Adaptive kernel-width selection for kernel-based least-squares policy ieration algorithm, Proceedings of IEEE International Symposium on Neural Networks, 2011

• Pengcheng Zhang, Xin Xu, Chunming Liu, and Qiping Yuan. Reinforcement Learning Control of a Real Mobile Robot Using Approximate Policy Iteration. ISNN 2009, Part III, Lecture Notes in Computer Science, LNCS 5553, pp. 278-288, 2009.

• Xin Xu, Hongyu Zhang, Bin Dai, Han-gen He: Self-learning path-tracking control of autonomous vehicles using kernel-based approximate dynamic programming. Proc. of International Joint Conference on Neural Networks, 2008: 2182-2189

• Jun Wu, Xin Xu, Chuan-qiang Lian, Yan Huang. Adaptive dual heuristic programming based on delta-bar-delta learning Rule. Proceedings of International Symposium on Neural Networks, 2011

• Jun Wu, Xin Xu, Zhen-ping Sun, Yan Huang: Cooperative multi-agent reinforcement learning based on online heuristic extraction. ICNC 2011: 1299-1303

• Chunming Liu, Jinze Song, Xin Xu, and Pengcheng Zhang. Reordering Sparsification of Kernel Machines in Approximate Policy Iteration. ISNN 2009, Part II, Lecture Notes in Computer Science, LNCS 5552, pp. 398-407, 2009

• Chunming Liu, Xin Xu, et al. Adaptive Sample Collection Using Active Learning for Kernel-based Approximate Policy Iteration. In: Proc. of IEEE International Symposium on ADP and RL, Paris, 2011.

• Xin Xu, Yirong Luo: A Kernel-Based Reinforcement Learning Approach to Dynamic Behavior Modeling of Intrusion Detection. Lecture Notes in Computer Science,Proc. of ISNN (1) 2007: 455-464

• Xin Xu, Yongqiang Sun, Zunguo Huang: Defending DDoS Attacks Using Hidden Markov Models and Cooperative Reinforcement Learning. Lecture Notes in Computer Science, Proc. of PAISI 2007: 196-207

• Xin Xu. A sparse kernel-based least-squares temporal difference algorithm for reinforcement learning. Lecture Notes in Computer Science, ICNC (1) 2006: 47-56

• Xin Xu, et al. A reinforcement learning approach for host-based intrusion detection using sequences of system calls. Lecture Notes in Computer Science, ICIC (1) 2005: 995-1003

• Xin Xu, Xuening Wang, Dewen Hu. Mobile robot path-tracking using an adaptive critic learning PD controller. Lecture Notes in Computer Science, ISNN(2), 2004: 25-34

• Xin Xu, et al. Residual-gradient-based neural reinforcement learning for the optimal control of an acrobat. Proceedings of the 2002 IEEE International Symposium on Intelligent Control, Canada, 758- 763

---

• Yujun Zeng, Xin Xu, Dayong Shen,Yuqiang Fang, Zhipeng Xiao. Deep Convolutional-based Traffic Sign Recognition Using Kernel Extreme Learning Classifier in Informative Color Space. IEEE Transactions on Intelligent Transportation Systems, 2016, in press.

• Jian Li, Martin D. Levine, Xiangjing An, Xin Xu and Hangen He. Visual Saliency Based on Scale-Space Analysis in the Frequency Domain. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(4): 996-1010. (regular paper) [Html] [Dataset]

• Haibo He, Sheng Chen, Kang Li, and Xin Xu. Incremental learning from stream data. IEEE Transactions on Neural Networks, 2011, 22(12): 1901-1914.  (regular paper)

• Junping Zhang, Feiyue Wang, Kungfeng Wang, Weihua Lin, Xin Xu, Cheng Chen. Data-Driven Intelligent Transportation Systems: A Survey.  IEEE Transactions on Intelligent Transportation Systems, 2011, 12(4): 1624-1639.  (regular paper)

• Shiliang Sun, Xin Xu. Variational Inference for Infinite Mixtures of Gaussian Processes with Applications to Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems,2011, 12(2): 466-475.   (regular paper)

• Qi Wu, Rob Law, Xin Xu. A sparse Gaussian process regression model for tourism demand forecasting in Hong Kong. Expert Systems with Applications. 39(5): 4769-4774.

• Wei Wang, Xin Xu, Yan Li, Triple RRTs: An effective method for path planning in narrow passage, Advanced Robotics, 2010, vol. 24, no. 7, pp. 943-962. [pdf]

• Tingbo Hu, Tao Wu, Xin Xu, et al. Stereo Matching using Weighted Dynamic Programming on a Single-Direction Four-Connected Tree. Computer Vision and Image Understanding. 2012, 116(8): 908-921

• Xin Liu, Xin Xu, Bin Dai. Vision-based long-distance lane perception and front vehicle location for full autonomous vehicles on highway roads. Journal of Central South University, 2012,Volume 19, Issue 5, pp 1454-1465. 

• Gang wang, Xin Xu, Dewen Hu, et al. Uniqueness of maximum non-Gaussianity estimation: a revisit from the perspective of contrained cost-function optimization. International Journal of Intelligent Computing and Applications, 2008, 1(1):53-69

• Xin Xu, Rob Law, Tao Wu. Support Vector Machines with Manifold Learning and Probabilistic Space Projection for Tourist Expenditure Analysis. International Journal of Computational Intelligence Systems, 2009, 2(1): 17 - 26

• Xin Xu. Adaptive Intrusion Detection Based on Machine Learning: Feature Extraction, Classifier Construction and Sequential Pattern Prediction. International Journal of Web Service Practice, 2006, 2(1-2):49-58

• Xin Xu. Intrusion detection based on dynamic behavior modeling: reinforcement learning versus Hidden Markov Models. International Journal of Computational Intelligence Theory and Practice, 2007, 2(1): 57-66

• Jinshu Su, Bofeng Zhang, Xin Xu, Advances in Machine Learning Based Text Categorization. Journal of Software, 2006, 17(9):1848-1859

• Wei Wang, Yan Li, Xin Xu, Simon X. Yang: An adaptive roadmap guided Multi-RRTs strategy for single query path planning. International Conference on Robotics and Automation (ICRA), 2010: 2871-2876

• Xin Xu, Rob Law, Tao Wu: Classification of Business Travelers Using SVMs Combined with Kernel Principal Component Analysis. Lecture Notes in Artificial Intelligence, Proc. of ADMA 2007, LNCS: 524-532

• Wei Wang, Xin Xu, Yan Li, Path Planning for Redundant Manipulator without Explicit Inverse Kinematics Solution. Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics, December 19 -23, 2009, Guilin, China

• Wei Chen, Xuening Wang, Tao Wu, Xin Xu: Visual Protractor Based Localization Algorithm for Mobile Robot. Proc. of ISDA (3) 2006: 67-71

• Gang Wang, Xin Xu, Dewen Hu: Local Stability Analysis of Maximum Nongaussianity Estimation in Independent Component Analysis. Lecture Notes in Computer Science, Proc. of ISNN (1) 2006: 1133-1139

• Xin Xu, Xuening Wang. An adaptive network intrusion detection method based on PCA and support vector machines. Lecture Notes in Artificial Intelligence, ADMA 2005: 696-703

• Xin Xu, et al. Text Categorization Using SVMs with Rocchio Ensemble for Internet Information Classification. Lecture Notes in Computer Science, ICCNMC, 2005, LNCS 3619, pp. 1022-1031,

• Xin Xu, et al. Autonomic Computing for Defense-in-Depth Information Assurance: Architecture and A Case Study, Lecture Notes in Computer Science, GCC, 2004, LNCS 3252, pp: 414-421.

• Xin Xu, et al. A Self-Learning Reactive Navigation Method for Mobile Robots. Proceedings of IEEE Int. Conference on Machine Learning and Cybemetics, 2003

• Gang Wang, Xin Xu, Global Convergence of FastICA: Theoretical Analysis and Practical Considerations. Lecture Notes in Computer Science, ICNC, 2005, 700-705

• Gang Wang, Xin Xu, Self-Adaptive FastICA Based on Generalized Gaussian Model. Lecture Notes in Computer Science, ISNN, 2005, 961-966

---