Replacement tap for on bench gravity purifier