What type of needle are you using to stitch it down? If you use a Top stitching needle the needle holes will be smaller. If you are using a Jean needle it will be making holes and might even cutting the fabric.
Happy Stitching!!!!
Thank you . I had that in mind but needed someone to confirm it
Usually needle holes in cotton fabric become much less obvious if you press using lots of steam. It swells up the fibres.