It may have something like 'Protector', 'Defender', 'Spyware Remover' or 'Cleaner' in its name. If it does not help, look for another application on your computer. This why, you need to uninstall them TEMPORARY and check if problem becomes any better. They still have their drivers in memory which do this job in background. Also, please note that some Antiviruses and other security applications keep controlling everything even if you disable them because Maybe you have some application that has such function and you do not even know about it. They always go-between IDM and real file on hard drive two times (for read and write processes) and can slow down the whole process greatly.
Which controls traffic and all files (file parts) that are written on disk. It can be some FireWall/Antivirus/InternetSecurity application for example,
The problem is 100% caused by conflicts between IDM and other applications that try to control all disk activity. When IDM finishes downloading it takes a very long time to rebuild temporary files.