Automated Web-Scraping and LLM analytics

We developed automated web scraping and analytics data pipelines to analyze reddit website content. Pipelines were developed using Playwright to scrape public subreddit feeds that are scheduled to run daily using github actions and export and store the data on a supabase PostGRES database. We then applied a large language model (LLM) to the database to discern trends and patterns in the data.