Abstract: The integral equation method in layered media is an efficient and accurate method for simulating radio frequency (RF) integrated circuits and planar microwave devices. The efficient evaluation of Green’s functions in layered media or Sommerfeld integrals is still a major challenge in the computational electromagnetics. This paper proposes a fast parameter (frequency, material, thickness, etc.) sweeping algorithm for Green’s function in layered media. By converting the numerical Sommerfeld integral into a matrix multiplication and then using the tensor core in the GPU for hardware acceleration, the Sommerfeld integral at different parameters is achieved. To verify the efficiency of this method, we evaluate Green’s function in various layered media at different frequencies, materials and layered media thicknesses on a commercial NVDIA GPU. Numerical experiments show that the proposed parameter sweeping algorithm is 3 orders of magnitude faster than the traditional method accelerated by OpenMP on a high-end CPU without losing accuracy.