Developed Educational Pre-registration System
- Day: 2025-05-15
- Time: 19:45 to 22:50
- Project: Dev
- Workspace: WP 2: Operational
- Status: Completed
- Priority: MEDIUM
- Assignee: Matías Nehuen Iglesias
- Tags: Pre-Registration, ETL, Database, Python, Education
Description
Session Goal:
The session aimed to design and implement a comprehensive system for educational pre-registration and automatic assignment, focusing on data processing and database management.
Key Activities:
- Modeling Pre-registration and Automatic Assignment: Developed a systematic approach for pre-registration and automatic assignment in education, using Python and optimization techniques.
- Design of MVP for Activity Assignment: Proposed a simplified design for assigning talks and workshops to courses, using pseudocode and Python.
- Metadata Schema for Pre-registration Dataset: Created a detailed metadata schema for pre-registration datasets, including column definitions and validation recommendations.
- Relational Database Structure Proposal: Designed a relational database schema for educational data, emphasizing normalization and efficient querying.
- Data Denormalization for Activity Management: Proposed a relational design to denormalize data for activity management, enhancing relational records.
- Modular Onboarding System for FCEN Project: Designed a modular onboarding system for educational activity management, focusing on quality standards and pedagogical reusability.
- ETL Pipeline Design for Pre-registrations: Developed an ETL pipeline in Python to transform Google Sheets data into normalized CSV tables.
- Date Format Error Solution in Pandas: Provided a solution for date format errors in pandas, using
dayfirst=Truefor accurate datetime conversion. - Silent Risks in
extract_preferencias()Function: Identified and proposed solutions for silent risks in the function due to noisy columns, suggesting regex-based improvements. - DBML Diagram for Pre-registration System: Created a DBML diagram in Third Normal Form for the educational pre-registration system.
Achievements:
- Completed the design and initial implementation of a pre-registration system, including database schema and ETL pipeline.
- Addressed data processing issues and proposed robust solutions for data quality.
Pending Tasks:
- Further enhancements to the
extract_preferencias()function for better data extraction. - Testing and validation of the ETL pipeline and database schema.
Evidence
- source_file=2025-05-15.sessions.jsonl, line_number=2, event_count=0, session_id=6ed6c48508f88d0ff16417b1d38015472d0ce84d31d0db5726b00facdf46a05a
- event_ids: []