Li Changhua
Contact
- Position:
- National Astronomical Observatories, Chinese Academy of Sciences (CAS)
- Address
- China
Miscellaneous Information
- Miscellaneous Information
-
Abstract Reference: 30823
Identifier: P3.7
Presentation: Poster presentation
Key Theme: 3 New Trends in HPC and Distributed Computing
Astronomical Computing Environment of the Hybrid ArchitectureAuthors:
Li Changhua, Cui ChenzhouWith many large science equipment constructing and putting into use, astronomy has stepped into the big data era. The new method and infrastructure of big data processing has become a new requirement of many astronomers. Cloud computing, Map/Reduce, Hadoop, Spark, etc. many new technology has sprung up in recent years. Comparing to the High performance computing(HPC), Data is the center of these new technology. So, a new computing architecture infrastructure is necessary, which can be shared by both HPC and big data processing. Based on Astronomy Cloud project of China virtualization observatory (China-VO), we have made much efforts to optimize the designation of the hybrid computing environment. which include the hardware architecture, cluster management, Job and Resource scheduling.