Insects that can affect the health and yield of your potato plants include the Colorado Potato Beetle and various aphids. Beetles can easily be picked off of the plants by hand while aphids can be controlled by introducing ladybugs to your garden. If you choose to use a pesticide to eliminate bugs in your garden, check with a qualified professional to select a product which will not be harmful for later consumption of the produce.