"将高性能计算算法引入大数据平台——Spark在实验设施中的应用与优化"

需积分: 5 0 下载量 59 浏览量 更新于2024-03-21 收藏 989KB PDF 举报
"Bringing HPC Algorithms to Big Data Platforms" is a presentation by Nikolay Malitsky from Brookhaven National Laboratory. The focus of the presentation is on using Spark as an integrated platform for experimental facilities, specifically for the Ptychographic application. The Spark-MPI approach is discussed as a way to optimize the use of high-performance computing algorithms on big data platforms. The presentation also highlights the National Synchrotron Light Source II, a highly optimized 3rd generation synchrotron facility at Brookhaven National Laboratory in New York State. This facility started operations in 2014 and offers a suite of six experimental programs. Overall, the presentation emphasizes the importance of leveraging HPC algorithms in conjunction with big data platforms to enhance scientific research and data analysis capabilities at experimental facilities like the National Synchrotron Light Source II."
2023-03-28 上传