
Data illustrations by Storyset
About CLOUD-NES
Cloud computing is rapidly becoming the standard for large-scale data analysis. For researchers in the Natural and Engineering Sciences (NES) domain, the ability to efficiently use cloud-native tools and technologies is essential. Likewise, data providers must be equipped to offer their data in cloud-native formats.
CLOUD-NES: Facilitating cloud-native data access and processing for Natural and Engineering Sciences project aims to demonstrate the benefits of cloud-native approaches and strengthen the skills of researchers, research support staff, and data providers to fully embrace this transformation by:
- Building a prototype open cloud-native data repository,
- Transforming selected datasets in traditional formats into cloud-native ones,
- Demonstrating the benefits of cloud-native approaches with reliable and reproducible benchmarks in comparison to traditional methods,
- Developing open training material and providing tailored training to the researchers to improve their skills in using cloud-native methods, and
- Sharing the experience and lessons learned with relevant (inter)national stakeholders.
Partners
Workpackages
The project has five workpackages:
WP1 - Infrastructure
Aims to develop and operationalize a proof-of-concept cloud-native data access and processing platform. Tasks include:
- Design, implement, and fine-tune the platform.
- Publishing deployment scripts and provide documentation on building cloud-native infrastructure.
WP2 - Data Ingestion
Aims to make selected NES datasets publicly available in cloud-optimized formats. Tasks include:
- Ingest representative datasets for benchmarking and identify optimal cloud-native formats and parameters.
- Share lessons learned via blog posts and document efficient conversion steps in a public guideline.
WP3 - Benchmarking
Aims to evaluate the performance of cloud-native approaches through benchmarks. Tasks include:
- Develop and publish benchmarking code as open-source, summarize outcomes in blog posts, and provide a benchmarking guideline.
- Publish results in a peer-reviewed open-access publication.
WP4 - Capacity and Community Building
Aims to enhance digital skills and build community around cloud-native technologues. Tasks include:
- Organize a symposium with international cloud-native institutions and develop open training materials.
- Conduct hands-on training courses and host a final symposium to share lessons learned.
WP5 - Project Management and Outreach
Aims to ensure effective project management and outreach. Tasks include:
- Prepare a data management plan and software management plan.
- Maintain a project website, hold regular progress meetings, and submit reports.
- Publish as final report with evaluation and suggestions.