Developed memory management tools for Python

1 min read

📅 2023-04-25 — Session: Developed memory management tools for Python

🕒 18:50–19:10
🏷️ Labels: Python, Memory Management, Data Operations, Vs Code, Profiling
📂 Project: Dev
⭐ Priority: MEDIUM

Session Goal

The session aimed to enhance Python programming efficiency by exploring memory management techniques and tools.

Key Activities

  • Discussed the need for code submission for evaluation purposes.
  • Implemented a union operation on relations using relational algebra concepts.
  • Developed Python iterators for data operations such as Projection, Distinct, Grouping, Set Union, Set Intersection, and Set Difference.
  • Explored methods to monitor memory usage in Pandas DataFrames using the memory_usage() method and function.
  • Investigated real-time memory usage monitoring techniques in Python, utilizing tools like memory_profiler, objgraph, and pympler, along with OS tools such as top and htop.
  • Reviewed VS Code extensions for optimizing Python application memory usage, including Memory Monitor, Pylance, Memory Analyzer, and Python Performance.

Achievements

  • Successfully implemented and tested various data operations in Python.
  • Gained insights into effective memory management practices for Python applications.

Pending Tasks

  • Submit code for evaluation to complete the review process.
  • Further explore and integrate VS Code extensions for memory optimization.

Graph View

Backlinks