📅 2025-05-15 — Session: Developed Educational Pre-registration System

🕒 19:45–22:50
🏷️ Labels: Pre-Registration, ETL, Database, Python, Education
📂 Project: Dev
⭐ Priority: MEDIUM

Session Goal:

The session aimed to design and implement a comprehensive system for educational pre-registration and automatic assignment, focusing on data processing and database management.

Key Activities:

  • Modeling Pre-registration and Automatic Assignment: Developed a systematic approach for pre-registration and automatic assignment in education, using Python and optimization techniques.
  • Design of MVP for Activity Assignment: Proposed a simplified design for assigning talks and workshops to courses, using pseudocode and Python.
  • Metadata Schema for Pre-registration Dataset: Created a detailed metadata schema for pre-registration datasets, including column definitions and validation recommendations.
  • Relational Database Structure Proposal: Designed a relational database schema for educational data, emphasizing normalization and efficient querying.
  • Data Denormalization for Activity Management: Proposed a relational design to denormalize data for activity management, enhancing relational records.
  • Modular Onboarding System for FCEN Project: Designed a modular onboarding system for educational activity management, focusing on quality standards and pedagogical reusability.
  • ETL Pipeline Design for Pre-registrations: Developed an ETL pipeline in Python to transform Google Sheets data into normalized CSV tables.
  • Date Format Error Solution in Pandas: Provided a solution for date format errors in pandas, using dayfirst=True for accurate datetime conversion.
  • Silent Risks in extract_preferencias() Function: Identified and proposed solutions for silent risks in the function due to noisy columns, suggesting regex-based improvements.
  • DBML Diagram for Pre-registration System: Created a DBML diagram in Third Normal Form for the educational pre-registration system.

Achievements:

  • Completed the design and initial implementation of a pre-registration system, including database schema and ETL pipeline.
  • Addressed data processing issues and proposed robust solutions for data quality.

Pending Tasks:

  • Further enhancements to the extract_preferencias() function for better data extraction.
  • Testing and validation of the ETL pipeline and database schema.