To export images with a transparent background in GIMP, first, ensure your image has an alpha channel by navigating to Layer > Transparency > Add Alpha Channel. Delete the background layer or use the eraser tool. Finally, go to File > Export As, choose a PNG format, and confirm the box for 'Save color values from transparent pixels'. This retains transparency.