Abstract: Intelligent maintenance of roads and highways requires accurate deterioration evaluation and performance prediction of asphalt pavement. To this end, we develop a time series long short-term memory (LSTM) model to predict key performance indicators (PIs) of pavement, namely the international roughness index (I_RI) and rutting depth (R_D). Subsequently, we propose a performance indicator for the pavement quality index (P_QI-F), which leverages the highway performance assessment standards method, entropy weight method, and fuzzy comprehensive evaluation method. This indicator can evaluate the overall performance condition of pavement. The data used for the model development and analysis are extracted from tests on two full-scale accelerated test tracks, called MnRoad and RIOHTRACK. Six variables are used as the predictors, including temperature, precipitation, total traffic volume, asphalt surface layer thickness, pavement age, and maintenance condition. Furthermore, wavelet denoising is performed to analyze the impact of missing or abnormal data on the LSTM model accuracy. In comparison to a traditional autoregressive integrated moving average (ARIMAX) model, the proposed LSTM model performs better in terms of PI prediction and resiliency to noise. Finally, the overall prediction accuracy of our proposed performance indicator (P_QI-F) is 93.8%.