Work / Collaborations
Job Board Aggregator
Daily ingester for Hacker News “Who is hiring?” threads with constraint-enforced dedup and a paginated FastAPI API.
- Python
- FastAPI
- SQLAlchemy 2.x
- PostgreSQL
- httpx
- APScheduler
- Hacker News Algolia API
A collaboration with Fluxxion88.
What it does
A FastAPI and PostgreSQL service that finds the latest “Ask HN: Who is hiring?” thread through the Algolia API, pulls every top-level post and stores each one as a job row.
The part that matters
Deduplication lives in the database, not in application code. A UNIQUE constraint on the URL rejects repeats; the scraper catches the IntegrityError, rolls back and counts the skip. So re-running the ingest is always safe.
An APScheduler job inside the FastAPI lifespan re-runs the scrape every 24 hours, and GET /jobs pages through the rows with limit and offset behind a Pydantic response model.
Next
Company and category filters are wired into the query builder; parsing those fields out of each post comes next, then auth and a job-fit endpoint.