This happened to me when I didn't put the pam_tid.so line right under the first line.

Mine looks like

```

auth sufficient pam_smartcard.so

auth sufficient pam_tid.so

auth required pam_opendirectory.so

account required pam_permit.so

...

```