Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• dda1c1fee8 feat: word cloud on stat page Dylan De Faoite 2026-01-27 18:37:42 +00:00
• ecc1a62d24 feat: word frequency endpoint with stop word removal Dylan De Faoite 2026-01-27 18:18:32 +00:00
• dcdeafd7a9 update NPM libraries Dylan De Faoite 2026-01-27 17:41:38 +00:00
• 3fefe4f51e feat: graph showing posts per day in React Dylan De Faoite 2026-01-27 17:41:30 +00:00
• 1234ffde85 add stat page and separate home page and upload Dylan De Faoite 2026-01-27 17:36:24 +00:00
• 2fcb4eabae add react router Dylan De Faoite 2026-01-27 17:32:08 +00:00
• 5c1e65b606 remove unused package.json Dylan De Faoite 2026-01-27 17:29:53 +00:00
• 200645a4e0 update requirements.txt Dylan De Faoite 2026-01-27 15:06:56 +00:00
• 8394673b3c feat: posts_per_day and comments_per_day endpoints in Flask Dylan De Faoite 2026-01-27 13:20:51 +00:00
• 2482c1da1c add error message in React Page Dylan De Faoite 2026-01-27 13:20:07 +00:00
• d78c58a70c fix comment datetime to be parsed to timestamp in YoutubeAPI Dylan De Faoite 2026-01-27 12:37:16 +00:00
• e72d336de4 remove /data subdir Dylan De Faoite 2026-01-27 12:36:01 +00:00
• 2401875a19 combine posts and comments endpoint Dylan De Faoite 2026-01-27 12:14:33 +00:00
• ffba2d78c2 add two inputs for posts and comments Dylan De Faoite 2026-01-27 12:14:22 +00:00
• 322b69825c add package lock Dylan De Faoite 2026-01-27 12:00:06 +00:00
• 82bd9a7a9b add upload post endpoint in flask app Dylan De Faoite 2026-01-27 11:59:01 +00:00
• 524a5d2619 Add react app Dylan De Faoite 2026-01-27 11:58:08 +00:00
• ff2b08fc2d update gitignore Dylan De Faoite 2026-01-27 11:50:56 +00:00
• 7d94494fe2 youtube connector returns posts and comments in a flat manner Dylan De Faoite 2026-01-24 20:19:15 +00:00
• d96845d48b implement pagination to search subreddit method & remove timeframe attr Dylan De Faoite 2026-01-22 17:10:16 +00:00
• 8f504b7d4d updated reddit api to flatten comments and posts into separate data structures Dylan De Faoite 2026-01-22 17:05:32 +00:00
• 79cdb7babf remove unused top subreddit posts method Dylan De Faoite 2026-01-22 15:55:33 +00:00
• 152264bda9 separate comment and post data structures Dylan De Faoite 2026-01-22 15:53:47 +00:00
• 3c4aad77ef update number of fetched comments and videos from youtube Dylan De Faoite 2026-01-22 15:29:55 +00:00
• 501dec9dd5 convert YouTube published_at to timestamp Dylan De Faoite 2026-01-22 15:02:55 +00:00
• 096a415f3b fix datetime from boards.ie not being parsed properly Dylan De Faoite 2026-01-22 14:49:01 +00:00
• a34252deda Add response code 500 error handling in reddit api Dylan De Faoite 2026-01-19 22:55:28 +00:00
• 245ab19183 Add error handling for YouTube comments fetching Dylan De Faoite 2026-01-19 22:54:48 +00:00
• 2243558e56 update gitignore Dylan De Faoite 2026-01-19 20:57:26 +00:00
• 09a7c6fc9f remove debug print Dylan De Faoite 2026-01-19 20:53:56 +00:00
• 187401c5eb Implement YouTube API integration for video and comment fetching Dylan De Faoite 2026-01-19 20:50:17 +00:00
• 2b0aed0f74 add .env to gitignore Dylan De Faoite 2026-01-19 20:33:25 +00:00
• 85388ef6aa Add comment limit to _parse_comments method in BoardsAPI Dylan De Faoite 2026-01-19 20:23:11 +00:00
• 9c66ec8b82 Save to jsonl file after every fetch Dylan De Faoite 2026-01-19 20:22:47 +00:00
• e9cf51731d Add comment parsing functionality to BoardsAPI Dylan De Faoite 2026-01-19 18:24:44 +00:00
• 415b1ca87e update README Dylan De Faoite 2026-01-17 22:16:56 +00:00
• 8088417a37 Remove docker-compose.yml file Dylan De Faoite 2026-01-17 22:16:19 +00:00
• 4ea9bc8b45 Increase max_workers in ThreadPoolExecutor to improve post fetching performance Dylan De Faoite 2026-01-17 22:14:34 +00:00
• d7baf39087 Implement exponential backoff for handling Reddit API rate limits in _fetch_data method Dylan De Faoite 2026-01-17 22:14:26 +00:00
• 193ff43975 Refactor dataset creation to use post_to_dict for improved data structure and limit API calls to 400 Dylan De Faoite 2026-01-17 22:14:15 +00:00
• 1d2865470b Add comment parsing to _parse_posts Dylan De Faoite 2026-01-17 18:20:21 +00:00
• db21e86b8e Fix post ID extraction in _parse_thread method Dylan De Faoite 2026-01-17 16:18:04 +00:00
• 09d12ae173 Add logging to reddit api class Dylan De Faoite 2026-01-17 16:12:18 +00:00
• 38cf57e198 Include Ireland posts in dataset creation Dylan De Faoite 2026-01-17 16:05:42 +00:00
• ed3d89fd27 Refactor post fetching to use ThreadPoolExecutor for improved concurrency Dylan De Faoite 2026-01-17 16:05:37 +00:00
• d44b247bda rename dataset output to "posts.json" Dylan De Faoite 2026-01-17 14:52:32 +00:00
• d5e6b7a895 Refactor post detail fetching into separate _parse_thread method Dylan De Faoite 2026-01-17 14:51:57 +00:00
• 610bab67d5 Add boards.ie to dataset creation & add logging config Dylan De Faoite 2026-01-17 14:43:56 +00:00
• b8ed409e04 implement slight efficiency gain in board.ie pagination Dylan De Faoite 2026-01-17 14:43:14 +00:00
• 0523c1a091 Refactor logging to use class logger in BoardsAPI Dylan De Faoite 2026-01-17 14:37:28 +00:00
• a1c1e1e0d8 patch broken title scrape Dylan De Faoite 2026-01-17 14:28:16 +00:00
• 9eec7b00e3 Implement BoardsAPI to fetch new category posts and their details Dylan De Faoite 2026-01-17 14:25:43 +00:00
• c3a81d8b01 update requirements.txt Dylan De Faoite 2026-01-17 13:59:43 +00:00
• ad416d4966 Add Comment DTO Dylan De Faoite 2026-01-17 13:59:35 +00:00
• 47e71113f6 Merge branch 'main' of github:ThisBirchWood/ethnograph-view Dylan De Faoite 2026-01-15 12:43:53 +00:00
• b0e079599a Rename fetch data script & add check for empty posts Dylan De Faoite 2026-01-13 19:06:00 +00:00
• 538ea9fe12 Remove database connection and schema setup from the project Dylan De Faoite 2026-01-13 19:01:18 +00:00
• 73a19f3ce3 Add script to orchestrate dataset creation Dylan De Faoite 2026-01-13 18:59:42 +00:00
• e58c18bf99 add json files and vscode workspaces to gitignore Dylan De Faoite 2026-01-13 18:57:29 +00:00
• d4fb78aac4 Add pagination to new_subreddit method to bypass 100 post limit Dylan De Faoite 2026-01-13 18:46:43 +00:00
• 05874d233f Implement subreddit search method for new posts Dylan De Faoite 2026-01-13 18:39:55 +00:00
• b5624035ec rename reddit_connecter to reddit_api Dylan De Faoite 2026-01-13 14:45:20 +00:00
• 7c01c335fa remove base_connector and remove non-subreddit specific methods Dylan De Faoite 2026-01-13 14:19:43 +00:00
• 62823bfd44 update requirements.txt Dylan De Faoite 2026-01-12 15:31:14 +00:00
• 0cc95c5358 add ID field to post dto Dylan De Faoite 2026-01-11 20:36:19 +00:00
• 68642709b7 add rudimentary sentiment analysis endpoint to calculate average sentiment of posts Dylan De Faoite 2026-01-11 17:31:37 +00:00
• 4d459f2035 update main.py to launch flask app Dylan De Faoite 2026-01-11 17:21:09 +00:00
• 195188dcd7 update User-agent header in _fetch_data method and add __exit__ method to Database class Dylan De Faoite 2026-01-11 15:30:34 +00:00
• b5a2b01402 remove debug print statements from fetch_subreddit function Dylan De Faoite 2026-01-11 15:11:49 +00:00
• 2a8e3fd4db update README to clarify requirements Dylan De Faoite 2026-01-11 15:11:09 +00:00
• 4b8aebd312 add fetch_subreddit endpoint to retrieve and insert top posts from a specified subreddit Dylan De Faoite 2026-01-11 15:07:44 +00:00
• d3c985ba1f update posts table schema to include title and author_username fields Dylan De Faoite 2026-01-11 14:44:34 +00:00
• 5e1bccb2a8 add execute_many method to Database class and update fetch_reddit endpoint to insert posts into database Dylan De Faoite 2026-01-11 14:44:22 +00:00
• 1e9eb11aa1 update docker-compose to drop volume on restart Dylan De Faoite 2026-01-11 14:44:12 +00:00
• c12e1f7623 add database schema and update docker-compose for initialization Dylan De Faoite 2026-01-11 14:22:46 +00:00
• 550bba62f7 add Reddit post search endpoint Dylan De Faoite 2026-01-11 13:46:11 +00:00
• 1907760f1a add docker-compose file and configure PostgreSQL service; update database credentials in app.py Dylan De Faoite 2026-01-11 13:38:52 +00:00
• fd437db4eb add basic flask server and requirements Dylan De Faoite 2026-01-11 13:35:41 +00:00
• 19dff39dff add requirements section to readme Dylan De Faoite 2026-01-11 13:35:25 +00:00
• 2034cf6537 update readme Dylan De Faoite 2026-01-11 13:17:37 +00:00
• 6adfc2faf5 first commit DylanDeFaoite 2025-11-10 19:30:19 +00:00
• 11755358a4 first commit DylanDeFaoite 2025-11-10 19:30:05 +00:00
• be61a9c7ae ADD requirements.txt & Database class DylanDeFaoite 2025-11-06 15:44:45 +00:00
• a9778f26b2 ADD: Subreddit search DylanDeFaoite 2025-11-06 14:41:46 +00:00
• 6533bc2f13 PATCH: Broken URL handling DylanDeFaoite 2025-11-06 14:28:41 +00:00
• 9f5c6a9647 Initial Commit DylanDeFaoite 2025-11-06 14:15:50 +00:00