Water dispenser problem

If I remove the water filter and put the cover back on I get water flow and it dispenses from the door....for a period of time...about 3 or 4 glasses and then it stops. If I remove and replace the cover again I get water flow again. The same thing happens if I put a filter in as well. The ice maker works fine.

Ideas?

Terry