Drought fund won't rob infrastructure: PM