It's also the oldest federal law-enforcement agency, pre-dating the formation of the United States itself.

(The Post Office was established in colonial times by Benjamin Franklin, the USPSIS precursor was formed in 1772.)