The emerging high efficiency video cod ing (HEVC) standard uses the structure of coding tree unit (CTU) to compress vid eos.Rate-distortion costs of all the different depths from depth 0to dep th 3are compared transversally to get the optimal coding unit (CU).The encoding efficie ncy is improved significantly by these new added technologies in HEVC.However,greater computation complexity is i ntroduced compared with previous standards,which could limit its practical application.Thus,it is of vital importance for HEVC to increase the encoding speed.A rapid classification decision algorithm on CU dept h based on temporal-spatial correlation is proposed in this paper to solve this problem.First of all,correlation wei ghts of temporal-spatial adjacent CTUs/CUs are analyzed.Then,the possible depth ranges and depth values of current CTU/CU can be predicted in advance via depths of these coded CTUs/CUs.As a result,unnecessary CU size decis ions can be skipped and terminated.According to the simulation results,conclusions are obtained that enc oding complexity on average can be reduced by 40% under condition of different encoding configurations,while ma intaining almost the same RD performance as the original HEVC encoder.Our proposed algorithm reduces the cod ing complexity greatly compared with the original HEVC encoder.