Do you have an example of such a queue somewhere? I think I have a rough idea ab... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

LunaSea on May 27, 2019 | parent | context | favorite | on: On SQS

Do you have an example of such a queue somewhere?

I think I have a rough idea about how it works because I implemented something similar about four years ago in PostgreSQL but kept getting locking issues I couldn't get out of:

- https://stackoverflow.com/questions/33467813/concurrent-craw...

- https://stackoverflow.com/questions/29807033/postgresql-conc...

Also, what kind of queue size / concurrency on the polling side are you able to sustain for your current hardware?

floatboth on May 27, 2019 | [–]

There's a few libraries implementing this:

https://github.com/mbuhot/ecto_job for Elixir

https://github.com/timgit/pg-boss for Node.js

sorokod on May 27, 2019 | | [–]

Here https://www.2ndquadrant.com/en/blog/what-is-select-skip-lock... is a good discussion.

andrewstuart on May 27, 2019 | [–]

Refer example code above. I don't think Postgres included SKIP LOCKED 4 years ago.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact