13th EELA Tutorial, La Antigua, 18-19, October E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA Introducción a la Tecnología Grid y GILDA Richard Miguel SENAMHI - PERU La Antigua, 18 – 19 Octubre 2007
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Agenda Introducción Conceptos de Grid Beneficios Seguridad Gilda 2
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Introducción Que es Grid? –Grid puede ser comparado con una red eléctrica donde los usuarios pueden conectar cualquier dispositivo desde cualquier parte de ella sin necesidad de saber de donde proviene la energía. –Analógicamente, los usuarios de la GRID pueden conectar su computador a una red de recursos computacionales y acceder a la potencia de ellos sin necesidad de saber donde se encuentran estos recursos. –También se dice que es un cluster de clusters donde se agrupan recursos de computo separados geográficamente a través de una red de comunicación para tal fin. 3
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA GRID 4 Site1 Site2 User Interface
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Conceptos de GRID Recursos Computacionales –Equipos o computadores donde los usuarios puedan ejecutar jobs, aplicaciones, almacenar o recuperar datos sin importar el lugar geografico donde se encuentre dicho recurso. Job –Es una tarea computacional, (ejecutable o script) que los usuarios pueden ejecutar en el GRID con la finalidad de obtener un resultado final de regreso a un recurso al cual tenga acceso. Job Submission –Es el acto por el cual un usuario delega al GRID la responsabilidad de hallar el mejor recurso disponible en cualquier lugar del mundo y enviar el job para ser ejecutado en dicho recurso. 5
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Conceptos de GRID 6 VOs:Individuos u organizaciones que tienen acceso a los recursos de GRID User Interface Grid services
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Multi-VOs Usuarios se unen a VOs Una Organizacion Virtual ofrece recursos & negocia accessos El middleware de GRID se ejecuta en cada site –Storage elements –Compute elements Servicios adicionales (tanto usuarios y grid middleware) habilita el GRID Efecto: colaboración INTERNET
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Requerimientos del GRID Heterogéneo VO Resource Sharing Uso de Recursos Job Execution Data Services Seguridad Costos Administrativos Escalabilidad Disponibilidad Requerimientos Específicos
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Middleware Es la capa intermedia entre las aplicaciones de los Usuarios y los Recursos de Grid. 9
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Middleware Grid 10
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Beneficios del Grid Explotar los recursos no utilizados o sub utilizados. Capacidad de acceder a grandes recursos de computo. La tecnología GRID nos proporciona la posibilidad de colaborar con otro investigadores en distintas partes del mundo y obtener resultados positivos de dicha colaboración. Proporciona la posibilidad de balancear recursos. Confiabilidad. Seguridad. 11
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Seguridad Basada en Certificados Digitales X
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Futuro del GRID Incremento del número de usuarios de la infraestructura –Diseminacion de los resultados –Entrenamiento y Educacion –Grids ofrecen nuevas opotunidades para trabajo colaborativo. Incremento del numero de aplicaciones para mejorar el soporte de aplicaciones y las funcionalidades del middleware. –Incremento de la estabilidad, escalabilidad y usabilidad. –Mayores esfuerzos son necesarios particularmente sobre la administracion de un VO, seguridad de la infraestructura, administracion de datos y administraciond e jobs. –Extensiones del middleware del Grid de alto nivel. Incremento de la infrastructure de Grid Incremento de la administrabilidad de los servicios de GRID. –Reduciendo el costo de la operacion –Asegurando la interoperatibilidad entre infraestructuras.
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA The GILDA Project – web portal
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Por qué t-Infrastructure? Evita la interrupción de los sistemas de producción de los proyectos de Grid. Prepara participantes para futuras actualizaciones del middleware. Fácil punto de entrada para nuevas comunidades y usuarios. Proporciona operación garantizada para un Tutorial.
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, GILDA Test-bed ~ 20 sites in 4 continents
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, Todos los servicios gLite en GILDA M I D D L E W A R E V E R S I O N : g L i t e
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, GILDA Sponsors (
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, Training Strategy (1)
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Before trying GILDA… First Steps: Ask for a GILDA personal certificate 2.Load the certificate in your browser 3.Accept Use Policy 4.Subscribe to the GILDA Virtual Organisation
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA The GILDA Certification Authority (
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Training Strategy (2)
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA The GILDA VOMS (
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Training Strategy (3) Site Managers Beginners Application Developers
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Tutorial: Beginners B e g i n n e r s USER INTERFACE PLUG AND PLAY USER INTERFACE VIRTUAL MACHINE USER INTERFACE REAL (gLite-tutor) GENIUS WEB PORTAL [glite-tutor] /home/giorgio > voms-proxy-init --voms gilda Cannot find file or dir: /home/giorgio/.glite/vomses Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Enter GRID pass phrase: Your proxy is valid until Mon Jan 30 23:35: Creating temporary proxy Done Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN "gilda" Creating proxy Done Your proxy is valid until Mon Jan 30 23:35:
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Tutorial: Site Managers S i t e M a n a g e r s HOST CERTS GILDA TESTBED ( SERVICES AND SITES ) GILDA VIRTUAL SERVICES MACHINES GILDA MONITORING SYSTEMS HOST CERTS HOST CERTS
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Tutorial: Application Developers A p p l i c a t i o n D e v e l o p e r s GILDA DEMONSTRATOR GILDA USE CASES HOW TO USE CLI/API/WEB SERVICES in gLiteHOW TO USE CLI/API/WEB SERVICES in gLite GILDA TEAM SUPPORT FORGILDA TEAM SUPPORT FOR APPLICATION INTEGRATIONAPPLICATION INTEGRATION (GENIUS ALSO) Demonstrative Applications
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Some of the Applications ported on GILDA 8 Virtual Organizations supported: –Biomedicine (Biomed) –Earth Science Academy (ESR) –Earth Science Industry (CGG) –Astroparticle Physics (MAGIC) –Computational Chemistry (GEMS) –Grid Search Engines (GRACE) –Astrophysics (PLANCK) –Computation Archaeology (ARCHAEOGRID) Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review) Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator ( demo.ct.infn.it) Development of complete interface with CLI for NEMO
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA The GILDA Training Material (
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA The GILDA Support System
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Ticket Creation (1/2)
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Ticket Creation (2/2)
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Standard tutorial layout Local site User Interface Resource Broker BDII Students Room ssh Worker nodes CE LFC SE VOMS GILDA t-Infrastructure User Desktop Virtual UI Virtual UI Virtual UI
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Applications: RASTER-3D Set of tools for generating high quality raster images of molecules
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Applications: Volcano Sonification (Picture: M. Monzier IRD/IG-EPN)(Picture: g1.globo.com) Etna, ItalyTungurahua, Ecuador Sonified data from geophysical data collected by digital seismographs placed on volcanoes.
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Applications: Volcano Sonification Seismograms Melodisation
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Applications: hadronTherapy Employed for the treatment of some kind of ocular tumours Used to calibrate the proton beamline in reality
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Applications: DEMTOOLs Satellite image rendering program Input: ASCII file in DEM format (Digital Elevation Model) Output: VRML file
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Stats Used in more than 180 tutorials 7693 certificates issued > 3 TB of videos and Virtual Grid services downloaded Web portal: hits in 2006
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, Stats
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, Non EU countries benefited by GILDA courses Basic / user tutorial Advanced / sysadmin Application Porting
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Lima, 12th EELA Tutorial, Non EU countries benefited by GILDA courses Basic / user tutorial Advanced / sysadmin Application Porting
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Summary and conclusions GILDA is a virtual laboratory for dissemination of grid computing: –It is a de facto standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.) –It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre- porting of new applications to EGEE Infrastructure –GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Links GILDA home page – GILDA Certification Authority – GILDA Virtual Organization – GILDA Support System – GILDA Form for Bookings – GILDA Repository of Training Material – GILDA Virtual Services –
E-infrastructure shared between Europe and Latin America 13th EELA Tutorial, La Antigua, October 2007 FP62004Infrastructures6-SSA Preguntas