E-science grid facility for Europe and Latin America AeroVANT Simulaciones del comportamiento Aerodinámico de Vehículos Aéreos No Tripulados Tutores: Elisa Ingra, Riccardo Bruno Daniel Bellomo, Luis Ceballos Universidad Nacional de Río Cuarto (Argentina) 2 nd EELA-2 Grid School Querétaro, Mexico, Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Acerca de esta presentación Objetivos Descripción Conclusiones Resultados Trabajos Futuros Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Objetivos Portar AeroVANT sin modificarlo –Paralelización Trivial Incrementar la velocidad de ejecución –Paralelización explícita (requiere modificaciones) Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, AeroVANT Querétaro, Second EELA-2 Grid School, – Pre-procesador Post-procesador Procesador aerovant (Fortran 90) gg (Matlab®) ® The MathWorks, Inc.

Trujillo, EELA-2 Kick-off-Meeting, AeroVANT Querétaro, Second EELA-2 Grid School, – Pre-procesador Post-procesador Procesador aerovant (Fortran 90) gg (Matlab®) ® The MathWorks, Inc.

Trujillo, EELA-2 Kick-off-Meeting, AeroVANT Querétaro, Second EELA-2 Grid School, – Pre-procesador Post-procesador Procesador aerovant (Fortran 90) gg (Matlab®) ® The MathWorks, Inc. CONFIG.DAT LS.DAT HT.DAT VT.DAT FS.DAT

Trujillo, EELA-2 Kick-off-Meeting, Gridificando AeroVANT Job paramétrico AMGA MyProxy SecureStorage WatchDog Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Job paramétrico CLCL α Configuración 1 Configuración 2 Configuración 3 Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Job paramétrico CLCL α Configuración 1 Configuración 2 Configuración 3 Querétaro, Second EELA-2 Grid School, – g02-*.DAT g01-*.DAT g03-*.DAT g##-*.DAT + CONFIG_TEMPLATE.DAT input.tar.gz

Trujillo, EELA-2 Kick-off-Meeting, COMENT LINE !NOP1/3/5/6/7 %PARAMX% !AoA [deg] !VelVec !Vc[m/s] Lc[m] !T NMAX !Chord[m] Span[m] 2.0 !posicion del VelField CONFIG_TEMPLATE.DAT Querétaro, Second EELA-2 Grid School, – (%PARAMX% es modificado en aerovant.sh)

Trujillo, EELA-2 Kick-off-Meeting, Job paramétrico Querétaro, Second EELA-2 Grid School, – AeroVANT.shaerovant.jdl aerovant.sh...

Trujillo, EELA-2 Kick-off-Meeting, #!/bin/sh # init myproxy./init-grid-m12.sh # varibles PROD=prod.vo.eu-eela.eu EXP=$1 # query to AMGA: number of jobs MDCLI=mdcli DIR=/schooldir/aerovant ANGLES=`$MDCLI "selectattr $DIR/angles:Angle '1=1'" | wc -l` echo $ANGLES GEOM=`$MDCLI "selectattr $DIR/geometries:Geometry '1=1'" | wc -l` echo $GEOM NEXEC=$[$GEOM*$ANGLES+1] # JDL generation cat jdl_template | sed s/%SETPARAMETERS%/2/ | sed s/%SETEXPERIMENT%/$EXP/ > aerovant.jdl # submit job./submitjob.sh aerovant.jdl AeroVANT.sh Querétaro, Second EELA-2 Grid School, – Nombre del experimento ( e.g. exp01, exp02, …)

Trujillo, EELA-2 Kick-off-Meeting, #!/bin/sh # init myproxy./init-grid-m12.sh # varibles PROD=prod.vo.eu-eela.eu EXP=$1 # query to AMGA: number of jobs MDCLI=mdcli DIR=/schooldir/aerovant ANGLES=`$MDCLI "selectattr $DIR/angles:Angle '1=1'" | wc -l` echo $ANGLES GEOM=`$MDCLI "selectattr $DIR/geometries:Geometry '1=1'" | wc -l` echo $GEOM NEXEC=$[$GEOM*$ANGLES+1] # JDL generation cat jdl_template | sed s/%SETPARAMETERS%/2/ | sed s/%SETEXPERIMENT%/$EXP/ > aerovant.jdl # submit job./submitjob.sh aerovant.jdl AeroVANT.sh Querétaro, Second EELA-2 Grid School, – Iniciar MyProxy

Trujillo, EELA-2 Kick-off-Meeting, #!/bin/sh # init myproxy./init-grid-m12.sh # varibles PROD=prod.vo.eu-eela.eu EXP=$1 # query to AMGA: number of jobs MDCLI=mdcli DIR=/schooldir/aerovant ANGLES=`$MDCLI "selectattr $DIR/angles:Angle '1=1'" | wc -l` echo $ANGLES GEOM=`$MDCLI "selectattr $DIR/geometries:Geometry '1=1'" | wc -l` echo $GEOM NEXEC=$[$GEOM*$ANGLES+1] # JDL generation cat jdl_template | sed s/%SETPARAMETERS%/2/ | sed s/%SETEXPERIMENT%/$EXP/ > aerovant.jdl # submit job./submitjob.sh aerovant.jdl Consulta en AMGA para obtener el número de Jobs a realizar AeroVANT.sh Querétaro, Second EELA-2 Grid School, – Iniciar MyProxy

Trujillo, EELA-2 Kick-off-Meeting, #!/bin/sh # init myproxy./init-grid-m12.sh # varibles PROD=prod.vo.eu-eela.eu EXP=$1 # query to AMGA: number of jobs MDCLI=mdcli DIR=/schooldir/aerovant ANGLES=`$MDCLI "selectattr $DIR/angles:Angle '1=1'" | wc -l` echo $ANGLES GEOM=`$MDCLI "selectattr $DIR/geometries:Geometry '1=1'" | wc -l` echo $GEOM NEXEC=$[$GEOM*$ANGLES+1] # JDL generation cat jdl_template | sed s/%SETPARAMETERS%/2/ | sed s/%SETEXPERIMENT%/$EXP/ > aerovant.jdl # submit job./submitjob.sh aerovant.jdl Consulta en AMGA para obtener el número de Jobs a realizar Generación del archivo JDL AeroVANT.sh Querétaro, Second EELA-2 Grid School, – Iniciar MyProxy

Trujillo, EELA-2 Kick-off-Meeting, #!/bin/sh # init myproxy./init-grid-m12.sh # varibles PROD=prod.vo.eu-eela.eu EXP=$1 # query to AMGA: number of jobs MDCLI=mdcli DIR=/schooldir/aerovant ANGLES=`$MDCLI "selectattr $DIR/angles:Angle '1=1'" | wc -l` echo $ANGLES GEOM=`$MDCLI "selectattr $DIR/geometries:Geometry '1=1'" | wc -l` echo $GEOM NEXEC=$[$GEOM*$ANGLES+1] # JDL generation cat jdl_template | sed s/%SETPARAMETERS%/2/ | sed s/%SETEXPERIMENT%/$EXP/ > aerovant.jdl # submit job./submitjob.sh aerovant.jdl Consulta en AMGA para obtener el número de Jobs a realizar Generación del archivo JDL Envío del Job AeroVANT.sh Querétaro, Second EELA-2 Grid School, – Iniciar MyProxy

Trujillo, EELA-2 Kick-off-Meeting, AMGA Querétaro, Second EELA-2 Grid School, – AeroVANT.sh aerovant.jdl aerovant.sh...

Trujillo, EELA-2 Kick-off-Meeting, AMGA Querétaro, Second EELA-2 Grid School, – AeroVANT.sh aerovant.jdl aerovant.sh... Ángulos Nombre de geometrías

Trujillo, EELA-2 Kick-off-Meeting, AMGA Querétaro, Second EELA-2 Grid School, – AeroVANT.sh aerovant.jdl aerovant.sh... Número de Jobs Ángulos Nombre de geometrías

Trujillo, EELA-2 Kick-off-Meeting, AMGA Querétaro, Second EELA-2 Grid School, – AeroVANT.sh aerovant.jdl aerovant.sh... Número de Jobs Ángulos Nombre de geometrías Combinaciones

Trujillo, EELA-2 Kick-off-Meeting, AMGA angles Angle-2 Angle0 5 …… geometries Geometryg01 Geometryg02 …… mdcli "selectattr $AMGADIR/angles:Angle $AMGADIR/geometries:Geometry '1=1'" -2g g Querétaro, Second EELA-2 Grid School, – Número de Jobs

Trujillo, EELA-2 Kick-off-Meeting, [ Type = "Job"; JobType = "Parametric"; Executable = "aerovant.sh"; Arguments = "_PARAM_ %SETEXPERIMENT%"; Requirements = other.GlueCEInfoTotalCPUs<1000 && other.GlueCEStateWaitingJobs<20; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"input.tar.gz", "aerovant.sh", "aerovant,mdclient.config, "watchdog.sh","watchdog.ctrl","watchdog.conf","uuencode","uudecode"}; OutputSandbox = {"loadsUAV.AUX", "std.out", "std.err", "output.tar.gz, "watchdog.log","watchdog.err"}; Parameters=%SETPARAMETERS%; ParameterStep=1; ParameterStart=1; MyProxyServer=px.eela.ufrj.br; ] JDL_template Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, aerovant.sh Preparción de variables de entorno –WatchDog –SecureStorage AMGA –Consultar datos Preparar entrada –Renombrar archivos Iniciar WatchDog Ejecutar el programa Descargar resultados –Almacenar archivos en SE de manera segura Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, MyProxy Cantidad de pasos de simulación Tiempo total de ejecución en horas Generar la matriz de coef. de influencia Porcentajes del tiempo total Generar los lados derechos Resolver el sistema de ecuaciones Realizar la convección de las estelas Calcular las cargas Necesitamos un Necesitamos un proxy con más de 12 hs de duración! Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, SecureStorage y WatchDog SecureStorage –Proteger resultados lcg-scr --vo $PROD -d lnx097.eela.if.ufrj.br --vo_permission /C=AR/O=e-Ciencia/OU=UNLP/L=CeSPI/CN=Luis\ Ceballos -l lfn:/grid/$PROD/E2GRIS2/testsecure_1/$FILE2.enc file://$PWD/loadsUAV.AUX lcg-scp --vo prod.vo.eu-eela.eu lfn:/grid/$PROD/E2GRIS2/testsecure_1/$FILE2.enc file://$PWD/loadsUAV.AUX.enc WatchDog –Monitorear la ejecución del Job –Visualizar resultados parciales./watchdog.ctrl start #./aerovant./watchdog.ctrl stop Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Resultados Almacenamiento en SE $ lcg-ls -l lfn:/grid/prod.vo.eu-eela.eu/E2GRIS2/aerovant/ | grep '\(exp006\|exp005\) -rw-rw-r exp005-g01--2-loadsUAV.AUX -rw-rw-r exp005-g01--2-output.tar.gz -rw-rw-r exp005-g01--3-loadsUAV.AUX -rw-rw-r exp005-g01--3-output.tar.gz -rw-rw-r exp005-g02--2-loadsUAV.AUX -rw-rw-r exp005-g02--2-output.tar.gz -rw-rw-r exp005-g02--3-loadsUAV.AUX -rw-rw-r exp005-g02--3-output.tar.gz -rw-rw-r exp006-g01--2-loadsUAV.AUX -rw-rw-r exp006-g01--2-output.tar.gz -rw-rw-r exp006-g01--3-loadsUAV.AUX -rw-rw-r exp006-g01--3-output.tar.gz -rw-rw-r exp006-g02--2-loadsUAV.AUX -rw-rw-r exp006-g02--2-output.tar.gz -rw-rw-r exp006-g02--3-loadsUAV.AUX -rw-rw-r exp006-g02--3-output.tar.gz Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Resultados WatchDog $./wdcli Checking proxy... ok PROXY expiration time..: 11:50:12 VOMS expiration time..: 11:50:13 wdcli V A client program for watchdog interaction wd> set mode lfc Current mode is set to: 'LFC' wd> show jobs Jobs in: '/grid/prod.vo.eu-eela.eu/aerovant/WD1' 1 2Il_NHFvYE2Vg__XBBZ4ZQ paused 2 5opCRElweUkTbIRxm_xyJw paused 3 LIPktLqHrXzSo21L0s3JtQ paused 4 U-FyjB9Xajh24SuGP0IJog paused 5 bfz5PWumjuoKd-dwi4YUJw finished If you whish to attach to a wathced yob, please answer to the following question with the index of the reported jobId Would you like to select a job? [N] 1 Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Resultados Would you like to select a job? [N] 1 Current jobid is set to: '2Il_NHFvYE2Vg__XBBZ4ZQ' wd> show snapshots Snapshots in: '2Il_NHFvYE2Vg__XBBZ4ZQ' Snapshots of job id: '2Il_NHFvYE2Vg__XBBZ4ZQ' _18064_file.err.empty _18064_file.out.empty _18064_watchdog.log _18064_watchdog.err _18064_GEOMETRY.TEC If you whish to show a snapshot content, please answer witht the snapshot id reported on the left side of the snaphot list above Would you like to view a snapshot? [N] 5 Getting snapshot E E E E E E E E E E E E E E E etc Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Conclusiones Portar AeroVANT sin modificarlo –Paralelización Trivial Incrementar la velocidad de ejecución –Paralelización explícita MPICH (Fortran 77) Programa simple Compilar en la UI MPICH2 (Fortran 90) Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, Trabajos Futuros AMGA –Automatizar la carga de datos en las colecciones –Modificar el preprocesador ? Paralelización explícita –MPICH2 Actualizar documentación –Página web –Documentación del usuario Querétaro, Second EELA-2 Grid School, –

Trujillo, EELA-2 Kick-off-Meeting, ? Querétaro, Second EELA-2 Grid School, – Muchas gracias a todos!