There is a pause button on downloads which can temporarily stop an active download, or an inactive one from becoming active. If you want to make an inactive one become active quicker, right-click on the column headers and choose the 'Priority' column (and sort by it), then highlight it and click the up arrow a bunch of times to move it closer to the top.