Due to the heavy workload of RSS collection, the instability of WLAN signal strength and the disappearance of signals caused by complex indoor environments, the construction of Radio Map for Wireless local area network (WLAN) fingerprint-based indoor positioning system is time-consuming and laborious. In order to rapidly deploy indoor WLAN positioning system, the Bidirectional Encoder Representation from Transformers (BERT) model is used to fill the missing signal in Radio Map and quickly build Radio Map. The Radio Map is imported into the BERT model in the form of natural language text, the missing signal is filled by the BERT model. Since the number of input data in BERT model cannot exceed 512 words, the structure of BERT model is not suitable for WLAN signals with large data volume. Therefore, we redefine the model structure based on the original BERT model and fill in the missing signals in the radio map in parallel. In addition, the loss function is redefined. Except that each segment has a loss function, the weighted average value of all segment loss functions is defined as the total loss function. The experimental results show that using the improved BERT model to fill the missing signal in Radio Map is much more accurate and time-saving.