Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

ServiceGuides

From EGIWiki
Revision as of 11:29, 31 January 2019 by Ychen (talk | contribs)
Jump to navigation Jump to search

This wiki page provides training materials and service documentations that help end users better understand EGI (and third-party's) services. You can ask questions and discuss a particular service at: https://community.egi.eu/

EGI Services

Cloud Computing

The Federated Cloud is a standards-based, open cloud system that federates institutional clouds to offer a scalable computing platform for data and/or compute driven applications and services in research and science.

Training Materials

  • Introduction and command line usage of the EGI Federated Cloud [ppt]. This training material is provided by Gergely Sipos, 05 Oct 2016. The goals of the training are to help users to learn the concept of IaaS Cloud Computing, conceptual model of the EGI federated Cloud, to obtain skills in using the standard interface of the EGI federated cloud and become an active user. Hand-on exercises are included.

User Manual

Publications

Cloud Container Compute

The Cloud Container Compute offers guaranteed computational resources in a secure and isolated environment with standard API access, without the overhead of managing the operating system.

Training Material

User Manual


Application on Demand

Application on Demand service allows user-friendly access to a portfolio of applications and application hosting frameworks (Science Gateways, VREs) that are configured to use the dedicated pool of cloud computing and HTC clusters from EGI. The service also allows users to run their own simulation/analysis models with custom input data.

Training Material

User Manual

Publication


DataHub

The EGI DataHub is a service prototype designed to make data discoverable and available in an easy way across all EGI federated resources.

Training Materials

User Manuals

Publication

Additional Materials

Check-In

EGI Check-In is a proxy service that operates as a central hub to connect federated Identity Providers (IdPs) with EGI service providers. Check-in allows users to select their preferred IdP so that they can access and use EGI services in a uniform and easy way.

Training Material

User Manuals

  • AAI usage guide: A wiki page contains information about registering an account with the EGI AAI in order to access a variety of EGI tools and services using the same account.
  • AAI guide for IdPs: A wiki page contains information about integrating your identity provider with the EGI AAI Proxy in order to allow users in your community to access EGI tools and services.
  • AAI guide_for SPs: A wiki page contains information about connecting services to the EGI AAI Check-in service in order to allow user login through Check-in and to receive users' attributes.

Additional Information


EGI Jupyter Notebook

EGI Jupyter Notebook is an 'as a Service' environment based on the Jupyter technology, offering a browser-based, scalable tool for interactive data analysis. The EGI Notebooks environment provides users with notebooks where they can combine text, mathematics, computations and rich media output. EGI Notebooks is a multi-user service and can scale to multiple servers based on the EGI cloud service.

Training Material


Online Storage

Online Storage allows you to store data in a reliable and high-quality environment and share it across distributed teams. Your data can be accessed through different standard protocols and can be replicated across different providers to increase fault-tolerance. Online Storage gives you complete control over the data you share and with whom

Training Material

  • EGI Online Storage [ppt]. This information is provided by Vincenzo Spinoso, 17 Sep 2018. It gives an overview of the service, service components, access interfaces, and examples of usage.

User Manual


Workload Manager

EGI Workload Manager (also known as DIRAC4EGI) is a service is provided to the EGI community as a workload management service used to distribute the users' computing tasks among the available resources both HTC and cloud.

Training Material

User Manual

Data Transfer

Data Transfer allows you to move any type of data files asynchronously from one place to another. The service includes dedicated interfaces to display statistics of on-going transfers and manage network resources.

User Manuals

EGI Marketplace

Training Material

  • A YouTube video is given by Björn Backeberg, on 6th Dec 2018, that step-by-step guides users to work through EGI Marketplace, introducing how to search and place an order of a service.

3rd party services (not part of the EGI Service Catalogue)

EGI VMOps dashboard

The EGI Application Database (AppDB) has recently evolved its functionalities from its currently catalogue of applications and virtual machines (VMs) to include a Graphical User Interface (GUI) allowing authorized users to perform basic VM management operations.

Training Material

    • A wizard-like builder that guides users through the selection of virtual machine images, virtual appliances, cloud resources and contextualization scripts to deploy complex applications or services in federated clouds.
    • Graphical interfaces and tools to monitor and manage your applications/services in federated clouds, independently of underlying cloud technologies.
    • A scalable architecture composed of a generic front-end and several, technology-specific back-ends for load balancing, and with a RESTful API to integrate with 3rd party services.

The EGI Applications Database is developed and operated by the Institute of Accelerating Systems and Applications (IASA) on behalf of the EGI Foundation as an EGI Core Service.

The Webinar was recorded. You can watch the recording at: http://connect.ct.infn.it/p5cty7tor87/

Additional Information


WS-PGRADE

WS-PGRADE is an open source, Liferay-based web portal environment for the design and execution of compute and data intensive applications on grid and cloud platforms. Applications can be defined in the form of data-driven workflows in WS-PGRADE. Steps within a workflow can be executable applications, Virtual Machine images, or online (Web) Services. These computational steps are connected through data-dependencies within the workflow: The output of one computation can serve as input of the next one. WS-PRADE resolves data dependencies and manages the computational operations on the infrastructure resources. The back-end system of WS-PGRADE is compatible with various academic and commercial grid and cloud systems, including federated clouds and gLite clusters of EGI. Moreover, scientific communities can connect workflow-specific Web interfaces to WS-PGRADE to simplify the execution of workflows for researchers. This is enabled by the 'Remote API' component of WS-PGRADE, a programming interface that exposes the workflow registry and the workflow manager service to third party clients. During the webinar the main capabilities of WS-PGRADE will be presented and demonstrated. The event will also provide opportunity to discuss scientific applications that would benefit from the use of WS-PGRADE to access EGI cloud and grid resources.

Training Material

Additional Information


Hadoop on the EGI Federated Cloud

With the rapid increase of data volumes in scientific computations, the importance of utilising parallel and distributed computing paradigms in data processing is becoming more and more important. Hadoop is an open source implementation of the MapReduce framework supporting processing large datasets in parallel and on multiple nodes in a reliable and fault-tolerant manner. Scientific workflow systems and science gateways are high level environments to facilitate the development, orchestration and execution of complex experiments from a user-friendly graphical user interface. Integrating MapReduce/Hadoop with such workflow systems and science gateways enables scientists to conduct complex data intensive experiments utilising the power of the MapReduce paradigm from the convenience provided by science gateway frameworks.

Training Material

  • Hadoop on the EGI Federated Cloud. This training is given by Tamas Kiss (University of Westminster, London, UK), and Carlos Blanco (University of Cantabria). 17 March 2016, during Webinar: Hadoop on the EGI Federated Cloud. This presentation and demonstration illustrates how easily Hadoop clusters can be deployed on EGI FedCloud resources, Hadoop applications can be executed on these clusters, and finally resources can be released after execution. Users of the EGI FedCloud WS-PGRADE gateway can import and parameterise pre-prepared workflows for the above tasks published in a public workflow repository. Users can set the type/flavour and number of desired nodes in the Hadoop cluster, select the target EGI FedCloud site, and define the Hadoop executable and the desired data source and destination. All three functionality (create Hadoop cluster, execute Hadoop job, destroy Hadoop cluster) can be executed as a standalone job or can be combined into more complex workflows automating different user scenarios.

User Manual