📅 2025-05-15 — Session: Developed Educational Pre-registration System
🕒 19:45–22:50
🏷️ Labels: Pre-Registration, ETL, Database, Python, Education
📂 Project: Dev
⭐ Priority: MEDIUM
Session Goal:
The session aimed to design and implement a comprehensive system for educational pre-registration and automatic assignment, focusing on data processing and database management.
Key Activities:
- Modeling Pre-registration and Automatic Assignment: Developed a systematic approach for pre-registration and automatic assignment in education, using Python and optimization techniques.
- Design of MVP for Activity Assignment: Proposed a simplified design for assigning talks and workshops to courses, using pseudocode and Python.
- Metadata Schema for Pre-registration Dataset: Created a detailed metadata schema for pre-registration datasets, including column definitions and validation recommendations.
- Relational Database Structure Proposal: Designed a relational database schema for educational data, emphasizing normalization and efficient querying.
- Data Denormalization for Activity Management: Proposed a relational design to denormalize data for activity management, enhancing relational records.
- Modular Onboarding System for FCEN Project: Designed a modular onboarding system for educational activity management, focusing on quality standards and pedagogical reusability.
- ETL Pipeline Design for Pre-registrations: Developed an ETL pipeline in Python to transform Google Sheets data into normalized CSV tables.
- Date Format Error Solution in Pandas: Provided a solution for date format errors in pandas, using
dayfirst=Truefor accurate datetime conversion. - Silent Risks in
extract_preferencias()Function: Identified and proposed solutions for silent risks in the function due to noisy columns, suggesting regex-based improvements. - DBML Diagram for Pre-registration System: Created a DBML diagram in Third Normal Form for the educational pre-registration system.
Achievements:
- Completed the design and initial implementation of a pre-registration system, including database schema and ETL pipeline.
- Addressed data processing issues and proposed robust solutions for data quality.
Pending Tasks:
- Further enhancements to the
extract_preferencias()function for better data extraction. - Testing and validation of the ETL pipeline and database schema.