📅 2024-09-25 — Session: Engagement Campaign and Web Scraping Automation
🕒 18:05–19:25
🏷️ Labels: Strategic Planning, Web Scraping, Automation, Python, AJAX, Http Errors
📂 Project: Business
⭐ Priority: MEDIUM
Session Goal
The session aimed to plan strategic actions for engaging key groups in an educational campaign and to execute various web scraping tasks for data extraction and automation.
Key Activities
- Strategic Planning for Engagement: Developed a checklist for engaging students, faculty, and alumni, aligning actions with campaign goals.
- Web Scraping and Automation:
- Executed reverse engineering of web queries using Python to bypass UI restrictions.
- Provided naming conventions for Jupyter notebooks for the Guaraní project.
- Addressed HTTP 405 errors using alternative methods like GET and Selenium.
- Automated AJAX requests for department data using Python.
- Implemented login and session management automation with CSRF handling.
- Debugged AJAX queries and updated API parameters for commission retrieval.
- Diagnosed and fixed HTTP 405 errors, focusing on POST/GET methods and CSRF.
- Debugged POST and GET request issues in Python.
Achievements
- Developed a comprehensive plan for stakeholder engagement in the educational campaign.
- Automated data extraction processes using Python, improving efficiency in handling web requests.
Pending Tasks
- Upload the correct HTML file for further data extraction and processing.
Session Time
Start Time: 18:05 End Time: 19:25