Sometimes, and only if it is a U.S. Postal Service Postmark. Most payments made to the Ulster County Finance Department are considered to be “on time” if the postmark is within the due date. There are certain times of the year and specific taxes that must be received by a certain date. Contact the Ulster County Department of Finance with specific questions.