Thursday, June 30, 2011

OSG 1.2.20 Release Notification

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.20.


******************************
OSG 1.2.20 Update Notification
******************************

Date: June 30, 2011

Affected Components

The following components are affected:

* All RSV installations
* CE installations

Summary

Due to the fourth of July holiday weekend, OSG support
resources will be limited so admins may want to wait until
Tuesday July 5th before updating.
This release contains the following updates:

* Several gatekeeper changes for CMS
* Optional re-nicing of the globus-gatekeeper to give it a
lower priority to keep the gatekeeper more responsive under heavy
loads
* Random sleep for fork jobs to prevent unwanted synchronization
of grid monitor processes

* Condor job manager changes to support group accounting
* SGE job manager changes to use a more reliable polling method
* Cleanup scripts are now provided by VDT so that files left by
globus in user home directories can be removed automatically

Several other updates are also included in this release, see
the VDT update page for more details.


Update Instructions
Update instructions can be found on the OSG Twiki under the OSG
1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions
).

Additional Information

The release notes for the VDT 2.0.0p27 release underlying this
release can be found here (
http://vdt.cs.wisc.edu/releases/2.0.0/release-p27.html ).

LIGO Needs Your Opportunistic Cycles

OSG Resource Providers,

The LIGO VO (http://www.ligo.caltech.edu/) is looking for cycles. LIGO is currently running on approximately one-third of the OSG Resources and is ready to expand to more. Please take a look to see if your resource is enabled to allow LIGO VO jobs, and if it is not please consider enabling it. Below is a description of the application. LIGO has a strong application group that will work closely with resource providers to get the Einstein at OSG Application running. If you'd like to help please enable the LIGO VO and contact goc@opensciencegrid.org to let us know you'd like LIGO to run at your site. We are more than happy to provide assistance with enabling the VO or getting the application working on your site.

Thank you in advance for your participation,
Rob Quick
OSG Operations Coordinator
and
Robert Engel
LIGO Application Developer

About E@OSG
-----------

Einstein@OSG is software written to allow BOINC projects such as Einstein@Home to be executed in Grid environments. Initially developed at the Max-Planck-Institute for Gravitational Physics in Germany it is running today on the German D-Grid and the Open Science Grid. The software consists of a server scheduling and submitting jobs to grid resources and a client monitoring and executing the Einstein@Home client. Einstein@OSG has completed hundred's of million cpu hours on a vast number of heterogeneous grid resources mainly by utilizing available idle cycles.


E@OSG Execution on the OSG
--------------------------

The client supports following important features:

* ability to run on heterogeneous clusters providing i386 and x86_64 worker node architectures
* execution in $OSG_WN_TMP to avoid utilizing the network file system
* checkpointing on external SRM resources as well as network file systems such as NFS
* full support for eviction of jobs, automatic suspend and restart of the job
* automatic error detection and recovery of jobs
* support for GPU acceleration when available
* fine grained control about the client run-time (minutes to days) and scheduler (1 to 1000s of jobs)

which allows LIGO to utilize all compute elements currently available to LIGO to run jobs:

https://twiki.grid.iu.edu/bin/view/Main/RobertEngel#EinsteinHome_at_the_Open_Science

Benefits of running E@OSG on your Site
--------------------------------------

E@OSG continuously runs on many OSG resources mainly utilizing idle cycles that otherwise might be wasted. Our automatic error detection also informs us quickly about errors on grid resources, such as:

* lost mounts on worker nodes
* misconfigured firewalls on worker nodes
* failing GRAM and GridFTP services
* wrong set permissions on SRM and NFS directories

By opening GOC tickets we can quickly inform the resource provider about problems on the resource that otherwise might be unnoticed.

Wednesday, June 29, 2011

DocDB downtime

The OSG DocDB will be unavailable on Tuesday, July 5 between 07:00 and 08:00 central time.

Tuesday, June 21, 2011

GOC Service Update - Tuesday, June 28th, 2011 at 14:00 UTC

The GOC will upgrade the following services beginning at Tuesday, June 28th, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OIM

ITB version is now available for testing at https://oim-itb.grid.iu.edu/pub/
Updated OIM v1 legacy views. Switched OIM db URL to localhost, and updated obsolute MyOSG URLs [OIM-11]

GOC Ticket 1.38

ITB version is now available for testing at https://ticket-itb.grid.iu.edu
Added list of emails under each security contact types [old JIR GOCTICKET-77]
Made security tickets to not listed in the /navigator unless user has authrozation for view_security_incident_ticket [GOCTICKET-81]
Added missing submitter metadata for custom form
Added a note for assignment tip in the ticket editor

MyOSG

Installed awstats (apache log analyzer) * please contact GOC for the URL if you’d like to test this.

OSG Jira

ITB version is now available for testing at https://jira-osg-itb.grid.iu.edu

Upgrading to version 4.3.4. Please see release notes since our last update
http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.4+Release+Notes
http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.3+Release+Notes
http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.1+Release+Notes

Upgrading GreenHopper to 5.6.5
http://confluence.atlassian.com/display/GH055/GreenHopper+5.5+Release+Notes
http://confluence.atlassian.com/display/GH/GreenHopper+5.6+Release+Notes
http://confluence.atlassian.com/display/GH/GreenHopper+5.6.1+Release+Notes
http://confluence.atlassian.com/display/GH/GreenHopper+5.6.2+Release+Notes
http://confluence.atlassian.com/display/GH/GreenHopper+5.6.4+Release+Notes
http://confluence.atlassian.com/display/GH/GreenHopper+5.6.5+Release+Notes

Installing Links Hierarchy Report Plugin

Installing Gant Chart Plugin

Tuesday, June 14, 2011

Welcome to the NEES Project and Enabling their VO for Use

OSG Collaborators,

Please join us in welcoming the George E Brown Network for Earthquake Engineering Simulation (NEES) VO to the OSG community! NEES is a shared national network of 14 experimental facilities, collaborative tools, a centralized data repository, and earthquake simulation software. Together, these resources provide the means for collaboration and discovery in the form of advanced research based on experimentation and computational simulations of the ways buildings, bridges, utility systems, coastal regions, and geomaterials perform during seismic events.

OSG User Support has worked with this VO for several months by helping them integrate their applications with OSG. We would like to ask opportunistic sites to grant NEES access to resources. Information about their work and science is available at http://nees.org.

NEES has been recently added to the VO Package. We urge you to update to this new VO package to enable the NEES VO for opportunistic use. Instructions for doing this can be found here: http://osggoc.blogspot.com/2011/06/new-vo-package.html

Thank you in advance for your support of this new OSG VO.

Friday, June 10, 2011

MyOSG DNS Resolution Issue

At approximately 3:00pm Eastern time the Indiana University DNS administrators erroneously removed myosg.grid.iu.edu from their DNS servers. The service was unavailable at myosg.grid.iu.edu but could be reached via myosg1.grid.iu.edu and myosg2.grid.iu.edu. This problem was fixed by DNS administrators at 4:00pm Eastern time. We apologize for any inconvenience this has caused.

Intermittent problem with MyOSG

Between 14:50 and 15:10 UTC one instance of MyOSG (myosg2) experienced a spike in memory usage.
Some users may have encountered slow response times during this period. We believe the problem
was transitory in nature and is currently not effecting service. As a precaution, the effected
instance will be removed from DNS round robin at noon eastern time. The memory allocated to
this machine will be increased and the process repeated on the remaining instance. We do not
anticipate visible interruption of service during this process.

Wednesday, June 8, 2011

GOC Service Update - Tuesday, June 14th at 14:00 UTC

The GOC will upgrade the following services beginning at Tuesday, June 14th, 2011 at 14:00 UTC. The GOC reserves eight hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.
MyOSG 1.36

ITB version is now available for testing at https://myosg-itb.grid.iu.edu
Moved the Tiny URL button to the top of the page, and made it to generate TinyURL in a single click (and the URL pre-selected) [MYOSG-11]

GOC Ticket 1.37

ITB version is now available for testing at https://ticket-itb.grid.iu.edu
Renamed "Internal Activities" to "Footprints Activities", and renamed "Meta Information" to "Ticket Creation Information" in order to differentiate it from ticket metadata which are now key/value pairs stored in data.grid for each tickets.
Enabled shorter URL for ticket viewer (like.. https://ticket.grid.iu.edu/goc/10000)
Moved submitter DN information from update description to DB based metadata. Changed the layout for ticket viewer metadata in order to accommodate long value

GOC-Ticket Exchanger 1.19

Exchanging submitter DN between GGUS and Footprints so that ticket submitted through Footprints can be edited in GGUS via the same submitter.

OIM 2.35 (https://oim.grid.iu.edu)

ITB version is now available for testing at https://oim-itb.grid.iu.edu
Made Footprints ticket templates used during various registrations configurable via admin page [OIM-10]
Added contact type description field to contact type table in order to store tooltip information for each contact types.
Added tooltips for various contact type information based on the information stored in https://twiki.grid.iu.edu/bin/view/Operations/OIMTermDefinition#Contact [old-JIRA OIM-21]
Updated the WLCG flag labels so that their purposes are clear [old - OIM-53]
Made a service editor to be pre-inserted in a form during new resource registration.
Updated resource group selector inside resource registration form so that site & resource group can be selected independently in order to make it easier to specify resource group.
Added delete button inside Resource Downtime Editor.
Changed the way downtime records are “removed” by implementing ability to use "disable" flag instead of remove the downtime record physically.
Implemented GOCTicket metadata accesser with ability to set metadata (for SUBMITTER DN)
Various cosmetic changes.

RSV Gratia Collector (rsv.grid.iu.edu)

A major relocation of various key tables & query changes for RSV-SAM transporter.

GOC BDII

Changed the way resource summary XML was generated so that the final file creation step will be more atomic. (There is no change to the BDII service itself)

Software.grid.iu.edu

Installing AWStat (Apache Log Analyzer)

Tuesday, June 7, 2011

New VO Package

A new VO package is now available. This package adds the NEES VO and removes the JDEM VO.

A detailed list of changes is available at:
https://twiki.grid.iu.edu/bin/view/Operations/PackageV37

The GOC suggests backing up your installation before running any
update commands.

To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please
use:
# cd $VDT_LOCATION
# source setup.sh
# pacman -update vo-package

Please remember a UNIX account for 'nees' will need to be set up as specified in the VO Package V37 document referenced above. Also, if you have a local 'jdem' unix account it can be disabled.

To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:
# cd $VDT_LOCATION
# source setup.sh
# pacman -update vo-client