Driver window will not go down

My driver side window wont go down most times but last night I left my ignition forward by mistake and when I went out this morning the battery was dead and the window was down. It will go back up but not down. Is this a relay problem? If so what relay do I replace?I first thought it was a switch and replaced that a couple weeks ago and still had the same problem so it shouldn't be the switch. Also I can hear my engine lag a little (while it is running) when I push the window button up but not when I push it down.