Do you think the mites came with your starter culture of whiteworms? If so, ask the source. It may be that the worms will stay ahead of the mites (or co-exist reasonably), at least under some conditions (like low temp maybe).
To get rid of them, you would either have to "clean off" some worms and start a new culture from them (and you might not really be rid of the mites even then). Or get a fresh culture (from a different source) and start over with sterilized equipment, bedding, etc. The whole area around where you have been keeping the culture will have to be considered "contaminated".