Developed Educational Pre-registration System

  • Day: 2025-05-15
  • Time: 19:45 to 22:50
  • Project: Dev
  • Workspace: WP 2: Operational
  • Status: Completed
  • Priority: MEDIUM
  • Assignee: Matías Nehuen Iglesias
  • Tags: Pre-Registration, ETL, Database, Python, Education

Description

Session Goal:

The session aimed to design and implement a comprehensive system for educational pre-registration and automatic assignment, focusing on data processing and database management.

Key Activities:

  • Modeling Pre-registration and Automatic Assignment: Developed a systematic approach for pre-registration and automatic assignment in education, using Python and optimization techniques.
  • Design of MVP for Activity Assignment: Proposed a simplified design for assigning talks and workshops to courses, using pseudocode and Python.
  • Metadata Schema for Pre-registration Dataset: Created a detailed metadata schema for pre-registration datasets, including column definitions and validation recommendations.
  • Relational Database Structure Proposal: Designed a relational database schema for educational data, emphasizing normalization and efficient querying.
  • Data Denormalization for Activity Management: Proposed a relational design to denormalize data for activity management, enhancing relational records.
  • Modular Onboarding System for FCEN Project: Designed a modular onboarding system for educational activity management, focusing on quality standards and pedagogical reusability.
  • ETL Pipeline Design for Pre-registrations: Developed an ETL pipeline in Python to transform Google Sheets data into normalized CSV tables.
  • Date Format Error Solution in Pandas: Provided a solution for date format errors in pandas, using dayfirst=True for accurate datetime conversion.
  • Silent Risks in extract_preferencias() Function: Identified and proposed solutions for silent risks in the function due to noisy columns, suggesting regex-based improvements.
  • DBML Diagram for Pre-registration System: Created a DBML diagram in Third Normal Form for the educational pre-registration system.

Achievements:

  • Completed the design and initial implementation of a pre-registration system, including database schema and ETL pipeline.
  • Addressed data processing issues and proposed robust solutions for data quality.

Pending Tasks:

  • Further enhancements to the extract_preferencias() function for better data extraction.
  • Testing and validation of the ETL pipeline and database schema.

Evidence

  • source_file=2025-05-15.sessions.jsonl, line_number=2, event_count=0, session_id=6ed6c48508f88d0ff16417b1d38015472d0ce84d31d0db5726b00facdf46a05a
  • event_ids: []