Skip to content

Job scrapping - #42

Open
IanniMuliterno wants to merge 11 commits into
ProgramadoresSemPatria:mainfrom
IanniMuliterno:job_scrapping
Open

Job scrapping#42
IanniMuliterno wants to merge 11 commits into
ProgramadoresSemPatria:mainfrom
IanniMuliterno:job_scrapping

Conversation

@IanniMuliterno

@IanniMuliterno IanniMuliterno commented Jun 22, 2026

Copy link
Copy Markdown

Summary

This PR packages the production-ready changes from the local work into atomic commits and leaves out development-only
and smoke-test-only changes.
It adds a "Job scrapping" from the platforms "Himalayas" and "Remote OK" , allows CV upload, calculates CV -> Job fit score and if the user wants to apply, they can pass that job to "Applications" with one click.

Type of Change

  • Feature
  • Fix
  • Improvement
  • Refactor
  • Documentation

Included Changes

Features

  • Web Scrapping (Himalayas, RemoteOK)
  • Hardened the Himalayas scraper with JSON API support, RSS fallback, and better upstream failure handling
  • Standardized scraper output with batch results and warning support
  • Persisted scrape warnings/errors in job source status
  • Added scheduled ingestion on app startup and every day at 3am UTC
  • Reads user CV with pymupdf
  • provides fit score for each job, matching CV and JD content
  • provides Job URL
  • supports CV tailoring
  • sends Job info to "Applications" if the user decides to apply

Fix

Auth/config

  • Fixed the default GitHub callback URI to match the actual auth route:
    • from http://127.0.0.1:8000/api/auth/github/callback
    • to http://127.0.0.1:8000/auth/github/callback

Testing

  • Unit tests
  • Integration tests
  • Manual testing

Notes

  • Validation: npm run lint -- src/components/jobs/job-detail-sheet.tsx
  • Kept the job detail sheet header visible during loading so context and close affordance remain available

Checklist

  • Self-review completed
  • CI passing
  • Ready to merge

@luis0ares

luis0ares commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator

@IanniMuliterno Backend CI is failing

@IanniMuliterno

Copy link
Copy Markdown
Author

@IanniMuliterno Backend CI is failing

tnks, I'm gonna check that out

Ian-Muliterno and others added 2 commits July 3, 2026 12:15
run_job_ingestion.py was never imported — RunIngestionUseCase is called
directly by the scheduler. The planning doc had no place in the repo.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants