Gonzalez Justo
Contact
- Position:
- European Organisation for Astronomical Research in the Southern Hemisphere (ESO)
- Address
- Germany
Miscellaneous Information
- Miscellaneous Information
-
Abstract Reference: 30567
Identifier: P6.11
Presentation: Poster presentation
Key Theme: 6 Python in Astronomy
Python code parallelization, challenges and alternatives (lightning talk)Authors:
Gonzalez Justo, Taylor Julian, Castro Sandra, Kern Jeff, Knudstrup Jens, Zampieri Stefano, Alisdair Manning, Bhatnagar Sanjay, Rao Urvashi, Golap Kumar, Nakazato Takeshi, Sugimoto KanakoIn the last few years development of Python code for science and data reduction purposes has gained significant popularity. ESO in itself uses a Python-based archiving system for VLT and ALMA data. Also the data reduction suite for ALMA data is python-based. Rapid development is fostered by a big community and a wide range of already available packages. However Python enforces locking mechanisms, to ensure thread safety, that effectively reduce the capacity of Python to use only one core. In this context a number of alternatives have been developed by the community to emulate actual multi-threading and make parallel processing easier to use from Python, preserving interactivity.
