Monday, December 22, 2014

Holliday Greetings from OSG Operations

Dear OSG Collaborators,

OSG Operations would like to wish you a happy holiday season and joyous new year!

We’d like to thank the OSG resource providers and users worldwide that have helped us provide over 780M hours of compute time this calendar year. There is a good possibility we will cap the 800M mark by year end! OSG Operations will continue to provide round the clock holiday coverage in case of operational emergencies over the holiday season. You can continue to open tickets at https://ticket.grid.iu.edu/goc/open, send us mail at goc@openscinecegrid.org, of call us at +1 (317)-274-9699. However, we will be operating on holiday procedures beginning on Wednesday the 24th and resuming regular staffing on Friday, January 2nd. During this time non-emergency issues will be handled on a best-effort basis.

Operations Weekly Calls will resume on Jan 5.

Thanks to everyone for another successful year! We look forward to working with everyone in 2015!

Tuesday, December 16, 2014

2015 OSG All-hands meeting: Registration now Open!

The 2015 Open Science Grid all-hands meeting is now open for registration! Please visit http://sites.northwestern.edu/osg-ahm2015/register/ to sign up.

The meeting will be held from Monday, March 23 to Friday, March 27, 2015 at Northwestern University’s Evanston Campus, Illinois. Please visit our website for more information about the format of the meeting and what is included in registration: http://sites.northwestern.edu/osg-ahm2015. If you have any questions, please contact Pamela Villalovoz at pmv@northwestern.edu.

The program will be based on the successful format from previous years, and details will be available in early 2015 https://indico.fnal.gov/conferenceDisplay.py?confId=8580. If you would be interested in participating in the planning process or the program itself, please do not hesitate to contact us as osg-contact@opensciencegrid.org.

We look forward to seeing you there!

Wednesday, December 10, 2014

Announcing OSG Software versions 3.2.18 and 3.1.42

We are pleased to announce OSG Software versions 3.2.18 and 3.1.42.

In addition to the items below, this release contains a rebuild of the OSG
MyProxy package for both OSG 3.1 and 3.2. It avoids installation and update
problems that started occurring December 5th and that are due to a change in
another repository (EPEL). Although this update was required to make Yum work
correctly, no action is required on your part.

OSG 3.2.18 contains:
* Several HTCondor CE fixes and improvements (see release notes)
* HTCondor 8.2.4 with patches (see release notes)
* GUMS 1.4.1 - Spruce up "Ban Users" UI
* Gratia probe updates - dCache probe keeps up, report proper VOName
* VO Package v58 - Remove old CERN VOMS addresses, Fermilab Analysis Role
* CA Certificate update to IGTF 1.61
* HTCondor 8.3.1 in the upcoming repository (with known issues)
* Several other minor bug fixes

OSG 3.1.42 contains:
* VO Package v58 - Remove old CERN VOMS addresses, Fermilab Analysis Role
* CA Certificate update to IGTF 1.61

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3218
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3142

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Tuesday, December 2, 2014

GOC Services Update - Tuesday, December 9th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, December 9th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

All Services
Operating system updates; reboots will be required. The usual HA mechanisms will be used but there will be short outages.

TWiki
Upgrading virtual machine to 2G RAM.

OASIS
Installing awstats on oasis and oasis-replica for monitoring purposes.

GOC Ticket 1.84
Added new ticket types (user/host cert request) and added type column under ticket list (OIM-113)
Another attempt to fix the url/email formatter (TICKET-60)

MyOSG 2.30
Regrouped the oasis manager contact information by contact_id and show list of DNs for each contact.
(released) meshconfig / Fixed a bug caused by duplicate service registration with identical hostnames.

RSV Process
Rebuilding rsvprocess1/2 instances to RHEL6

GOC-TX 1.43
Added handling of SNOW’s resolution note (https://ticket.grid.iu.edu/22547)

GratiaWeb
Upgrading graphtool to version 0.6.6-21.osg32.el6

Monday, November 24, 2014

Holiday Schedule

On November 27 and 28th, the Grid Operations Center will be operating on a Holiday schedule. Staff will be available to respond to emergencies but routine operations will resume at start of business Monday, December 1.

OSG Operations wishes its users and OSG staff a happy Thanksgiving Holiday.

Tuesday, November 11, 2014

Announcing OSG Software versions 3.2.17 and 3.1.41

We are pleased to announce OSG Software versions 3.2.17 and 3.1.41.

If you are using the OSG PKI command line tools, you must upgrade
to the release. The OSG PKI servers no longer accept SSLv3 connections
and you must use the corresponding command line tools.

HTCondor 8.2.3 has moved from Upcoming into the 3.2 repository.
Next month we plan to release HTCondor 8.3.x in the Upcoming repository.
If you are currently running HTCondor 8.2 out of the Upcoming repository
and do not want to upgrade to HTCondor 8.3.x, be sure to disable the
Upcoming repository in your yum configuration before the December release.

OSG 3.2.17 contains:
* HTCondor 8.2.3
* XRootD 4.0.4
* GlideinWMS 3.2.7
* HTCondor CE 1.7
* GFAL tools come from EPEL

OSG 3.2.17 and 3.1.41 contain:
* Disable SSLv3 in OSG PKI tools
* VO Package v57 - New CERN VOMS servers
* CA Certificate update to IGTF 1.60
* RSV version 3.7.20
* various minor bug fixes

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3217
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3141

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

OSG PKI Update - Affects OSG Certificate Command Line Tools

OSG Operations has applied an update to the OSG PKI to disable SSLv3. Users who request and retrieve certificates through the OSG Command Line Tools will need to update to the latest version of the osg-pki-tools package. Older versions of osg-pki-tools will be unable to request or retrieve certificates.

Wednesday, November 5, 2014

GOC Service Update - Tuesday, November 11th, 2014 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, November 11th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. IMPORTANT NOTE: This update will contain updates to the OSG PKI SSL. Once this update is applied you will need the latest PKI Tools from OSG Software release 3.2.17 or 3.1.41 before requesting certificates via the command line tools. More details immediately below.

PKI tools
A new version will be available during this release. The affected tools are: osg-cert-request, osg-cert-retrieve, osg-gridadmin-cert-request, osg-user-cert-renew, osg-user-cert-revoke, osg-cert-revoke. You must update your tools to continue to use them.

GOC VOMS
Configuration change to address SSLv3 vulnerability.

OIM 3.38
Fixed a bug where wrong resource ID was used to lookup service detail while repopulating selected sites for mesh config / host group editor for OIM resources - related to (MYOSG-78)
Increased max resource number of OIM/wlcg under meshconfig / host groups (was defaulted at 32)
Added user_cert_renew test script that uses serial_id (OSGPKI-343)
Added "certificate banner" configuration option. Updated action token from admin_pki_quota to admin_pki_config (OSGPKI-395)
Moved the "contact goc for assistance" to the page banner.
Increased max secondary admin contact for mesh config to be 4 (per conversation with Shawn)
Updated pf_endpoint_crawler to test for 3.4 (rest) interface. Removed write_url as it is not used by 3.4. Also adding update_timestamp field.

Ticket 1.83
Fixed missing submitter_name issue (TICKET-105)
Un-implemented security ticket notification suppression feature (TICKET-84)
Another bug fix for ticket URL/email highlighting feature (broken encoding) (TICKET-109)

MyOSG 2.29
meshconfig / removed references for v33 and made v34 default URLs.
meshconfig / improved auto-mesh configuration URL generator (I need to add autocomplete function later)
meshconfig / show default MA endpoint URLs for endpoint where crawler can not reach.
Applied check for active/disable flag for search result for resources for Submit Ticket button. Also added labels for active/disable flags (MYOSG-79)

Repo
Updating koji package to 1.6.0-8

RSV Process
Rebuilding rsvprocess1/2 instances to RHEL6

GOC-TX 1.42
Changed the SNOW2FP ticket status conversion rule (GOC Ticket 22547)

Virtualization Infrastructure
We will be transitioning the last of our VMware Server 1.x hosts to RHEL6/KVM; this will bring all our virtualization hosts into line with the same OS and infrastructure. This will affect confluence, data, repo, rsvprocess, and software, but in the case of repo and software we will be using the LVS HA to minimize end user impact. For the other services, however, there will be periods of downtime as the VMs are brought down, converted, and transitioned to a temporary host, then again when they are transitioned back to the newly-rebuilt permanent host.

High-Availability Infrastructure
We will be transitioning our HA infrastructure to LVS/keepalived rather than LVS/heartbeat so as to have fully redundant HA again, and also to be fully IPv6-ready.

perfSONAR 3.4+ install/update instructions

For any issues, please open an OSG ticket or contact mailto:wlcg-perfsonar-support@cern.ch.

Dear All,
this is to announce availability of the perfSONAR re-installation and upgrade instructions. We kindly request all WLCG sites to reinstall or upgrade their perfSONAR instances. Detailed instructions are now available at https://twiki.opensciencegrid.org/bin/view/Documentation/InstallUpdatePS

All sites that have terminated their instances following the shellshock exploit are requested to re-install following the instructions. In case you have already upgraded to perfSONAR version 3.3 or 3.4, you will still need to follow the instructions to configure your instances in order to take advantage of the new WLCG perfSONAR configuration system. We'd like to ask sites to update if possible before 8th of December.

For any issues, please open an OSG ticket or contact wlcg-perfsonar-support@cern.ch.For general information on the WLCG perfSONAR, please visit our new documentation at https://twiki.opensciencegrid.org/bin/view/Documentation/DeployperfSONAR

Best regards,
perfSONAR Support Team

Disabling SSLv3 for OSG VOMS Admin Server

The OSG Security team has concluded that the POODLE SSLv3 vulnerability
is not a *critical* concern to OSG software installations. Most services
are not affected, and those that are affected are difficult to exploit in
a meaningful way. Nonetheless, the recommendation is to disable support
for SSLv3 where reasonable.

OSG software includes VOMS Admin Server (currently, version 2.7.0), which
runs within Tomcat. By default Tomcat allows SSLv3 connections, but that
is easy to change. To disable SSLv3 support from a Tomcat instance that
contains VOMS Admin Server, add a "protocols" configuration attribute to
/etc/tomcat[56]/server.xml as follows (in diff format, sort of):

maxThreads="150" minSpareThreads="25" maxSpareThreads="75"
enableLookups="false" disableUploadTimeout="true"
acceptCount="100" debug="0" scheme="https" secure="true"
sSLImplementation="org.glite.security.trustmanager.tomcat.TMSSLImplementation"
trustStoreDir="/etc/grid-security/certificates"
sslCertFile="/etc/grid-security/http/httpcert.pem"
sslKey="/etc/grid-security/http/httpkey.pem"
crlUpdateInterval="2h"
log4jConfFile="/usr/share/tomcat6/conf/log4j-trustmanager.properties"
clientAuth="true" sslProtocol="TLS" sslEnabledProtocols="TLSv1"
+ protocols="TLSv1.1,TLSv1.2"
crlEnabled="true" crlRequired="true"/>







Note: OSG Software has tested this change only for a Tomcat instance that
is running VOMS Admin Server. But the change affects Tomcat itself and
thus affects all web applications running within that instance. So for
now, we recommend making this change to Tomcat instances that run only
VOMS Admin Server. There are known issues with applying this change to a
Tomcat instance that runs GUMS, in that dCache clients (at least) fail to
work with the changed GUMS server.

Thursday, October 30, 2014

End of Life Date for OSG 3.1 Release Series - April 30, 2015

The OSG has published a new policy for supporting software releases:

https://twiki.opensciencegrid.org/bin/view/SoftwareTeam/ReleaseSeriesSupportPolicy

Following this policy, OSG is announcing that support for the OSG 3.1 release series will end on April 30, 2015. Until then, OSG will backport critical bug and security fixes to OSG 3.1. Please migrate existing installations to OSG 3.2 prior to this date. Early plans are forming for OSG 3.3, but no release date has been set and OSG 3.2 will likely be the only supported release series for a while after April, 2015.

If you have any concerns or questions about this date please contact OSG Operations and Software by creating a ticket at http://ticket.grid.iu.edu/submit.

Friday, October 24, 2014

Resolved: OSG PKI Certificate Issuance Problems

The problems with issuing PKI certificates have been resolved and you may resume requesting and approving certificates.

We apologize for any inconvenience this has caused.

Resolved: OSG PKI Certificate Issuance Problems

The problems with issuing PKI certificates have been resolved and you may resume requesting and approving certificates.

We apologize for any inconveniences this has caused.

OSG PKI Certificate Issuance Problems

We are currently experiencing problems with host and user certificates issuance. The problem has been traced to the Certificate issuing entity and communication with DigiCert will be required to address the problem. We will keep you informed with progress and alert you when the issue has been resolved. We apologize for any inconvenience.

Wednesday, October 22, 2014

PKI Service Restored

The changes required to address the recent POODLE vulnerability (http://osggoc.blogspot.com/2014/10/osg-pki-command-line-interface-problem.html) had unexpected consequences. These have been addressed and the OSG PKI command line scripts are working properly at this time. We apologize for any inconvenience.

Tuesday, October 21, 2014

GOC Service Update - Tuesday, October 28th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, October 28th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

Oasis
* Test repository blanking and removal of a misconfigured replicated repository. (OO-25)
* Add batch update capability. A new command will be created that will queue an update request rather than “try again later” response. (OO-28)

GratiaWeb 1.2-30
* Distinguish between transfers in and out (GRATIAWEB-53)
* Crush in /gratia/xml/user_quality query(GRATIAWEB-58)
* Gratia web disregard % of ownership listed in OIM (GRATIAWEB-64)
* Fix the reporting URL in configuration (GRATIAWEB-65)

Ticket 1.82
* Refactored chatjs out of GOC Ticket and made it a dedicated component hosted under nginx in order to solve frequent node https server crash (TICKET-103)
* Fixed an issue where closing parenthesis was considered part of highlighted URL

Jira
Upgrading from 6.2 to 6.3.8 to keep up with latest updates.
Please see release notes for
https://confluence.atlassian.com/display/JIRA/JIRA+6.2+Release+Notes
https://confluence.atlassian.com/display/JIRA/JIRA+6.3+Release+Notes

All Services
* Operating system updates; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.

Monday, October 20, 2014

OSG PKI Command Line Interface Problem

In an attempt to protect the OSG services from the recent POODLE
vulnerability, the interaction with the OSG PKI via the command line
interface scripts was broken. We are working on a fix and expect a patch
to be in place on the OSG PKI service tomorrow.

This affects the following OSG PKI CLI scripts:
osg-cert-request
osg-cert-retrieve
osg-gridadmin-cert-request
osg-user-cert-renew
osg-user-cert-revoke
osg-cert-revoke

We apologize for any inconvenience. We will alert the community when things are once again available.

Tuesday, October 14, 2014

Announcing OSG Software versions 3.2.16 and 3.1.40 - GOC Ticket # 22731

We are pleased to announce OSG Software versions 3.2.16 and 3.1.40.

OSG 3.2.16 contains:
* Several improvements to HTCondor CE (see release notes for details)
* GUMS 1.4, which includes simplified user banning
* A bug fix for GridFTP-HDFS to avoid file corruption on certain transfers
* HTCondor 8.2.3 in the upcoming repository (and see NOTE below about production release)

OSG 3.2.16 and 3.1.40 contain:
* frontier-squid update including compressed access logs and other minor features
* CA certificate update to IGTF 1.59
* Many minor bug fixes

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3216
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3140

NOTE: We plan to move HTCondor 8.2 from Upcoming to the production OSG 3.2 repositories soon, perhaps as early as the November release. Please let the GOC, Operations, or Software teams know soon if you have questions, concerns, or comments about this change.

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Please see ticket 22731 at:
https://ticket.grid.iu.edu/22731

Monday, October 6, 2014

SAVE THE DATE! 2015 OSG All-hands Meeting: March 23 to March 27 at Northwestern University, IL

The 2015 Open Science Grid All-hands meeting will be held at Northwestern University’s (NU) Evanston campus, Illinois, from Monday, March 23 to Friday, March 27, 2015. The event will be sponsored by NU’s Weinberg College of Arts and Sciences, the NU Office for Research, NUIT (Northwestern University Information Technology), and CIERA (the NU Center for Interdisciplinary Exploration and Research in Astrophysics). As we move closer, more sponsors may be added to this list.

The schedule will follow the successful format from previous years:

US ATLAS and US CMS distributed facility – Tier-2 and Tier-3 – and the next Campus Infrastructure Community (CIC) meetings on the Monday and Tuesday.
Plenary talks from scientists, researchers and OSG leaders on the Wednesday.
“Ask the Experts” and other workshops on Thursday.
And the OSG Council face-to-face – open to Consortium members – at the end of the week.

Please visit our website at http://sites.northwestern.edu/osg-ahm2015/ which will be updated with details about logistics, including accommodation and dining arrangements, as well as information about the program itself.

If you would like more information in the meantime or if you would be interested in participating in the planning process or program itself, please do not hesitate to contact us at osg-contact@opensciencegrid.org.

Wednesday, September 24, 2014

GOC Special Special Maintenance Window - Tuesday, September 30th at 13:00 UTC

The GOC would like to announce a special maintenance window for September 30th, the 5th Tuesday of September.

Beginning at 13:00 UTC (9:00 a.m. EDT), OSG Operations will be performing maintenance on the OSG Twiki and JIRA services, as well as the Planet OSG blog aggregator.  The VM host for these services has been upgraded and they will now be moved back to this upgraded host.  The services will not be down at the same time, and no service should be down for longer than 30 minutes.

Additional maintenance will be performed on machines used internally for the operation of all services. These internal changes should be transparent to users. The GOC reserves 8 hours for these activities.

Tuesday, September 16, 2014

GOC Service Update - Tuesday, September 23rd at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, September 23rd, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

LVS Cluster
Upgrading LVS instances, lvs1 to CentOS6 during this cycle.

AMQP Cluster (event.grid)
Upgrading RabbitMQ RPMs to the latest version (3.1.5)

OIM 3.36
Add ldapsearch utilities
(patched) made it possible to remove mesh config / configs and tests
Moved various aux. scripts used by OIM under oim repository.
Fixed an issue where host certificate expiration notifier was broken due to missing requester_id. Using requeser_name instead which is always set.
oim cron scripts / Added check for real service return code to generate goc alert in case of server error.
Patched the issue where newly entered meshconfig records go missing. Updated meshconfig admin to allow multiple hostgroup to be used per each member group.
Added new oasis_repo_urls field in VO. Refactored alias editor used by resource form and implemented host editor used by both resource form and new VO/oasis url (OIM-104)

OSG Homepage
Upgrading to Wordpress v4.

GOC Ticket 1.81
Fixed an issue where assignee selector malfunctions sometimes (TICKET-102)
Reorganized application configuration.

MyOSG 2.27
Added oasis_repo_urls indicator (OIM-104)
Reorganized configuration file for eventjs.
Updated mesh config publisher to allow multiple host groups to be used per each member.

Oasis
Created SL6 login node per request (https://ticket.grid.iu.edu/22409)

All Services
Operating system updates, reboots will be required. The usual HA mechanisms will be used but there will be short outages.

Tuesday, September 9, 2014

Announcing OSG Software versions 3.2.15 and 3.1.39

We are pleased to announce OSG Software versions 3.2.15 and 3.1.39.

OSG 3.2.15 contains:
* XRootD updated to version 4.0.0
* GlideinWMS 3.2.6 (update from version 3.2.5.1)
* HTCondor CE 1.5.1 bug fix for idle jobs put on hold
* HTCondor 8.2.2 in the upcoming repository
* Patch for HTCondor 8.0.7 to fix bug with AWS EC2 integration

OSG 3.2.15 ang 3.1.39 contain:
* Update dCache SRM client to version 2.2.27
* minor fixes to the OSG PKI tools
* fix for LSF script in the blahp package

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3215
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3139

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

OSG Connect Services Restored

At approximately 1:50 pm CDT (18:50 GMT) a switch management card at University of Chicago failed, taking down a portion of the Science DMZ that serves US ATLAS Midwest Tier 2, ATLAS Connect, OSG Connect and other CI Connect services, UChicago ATLAS Tier 3, and a server for the South Pole Telescope. System and network engineers responded immediately. As of 3:00 pm CDT (20:00 GMT), all systems are back online and operating at full speed/capacity. The failed management card is being investigated by UC network staff and the vendor. No further interruptions are expected.

OSG Connect Service Unavailable

At 18:52 GMT today, an outage at the University of Chicago caused all OSG Connect services to become unavailable. This outage is ongoing and system engineers are investigating. We will provide updates as they become available.

Tuesday, September 2, 2014

GOC Service Update - Tuesday, September 9th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, September 9th at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

MyOSG 2.26
Modifications to the operations status page (tentative). An internal modification to a display of OSG-COG services status.
Updated the responsiveness of rgstatushistory graphs.
Updated pfmesh to use perfsonar_mas and other meshconfig related tables introduced by OIM 3.35.

GOC Ticket 1.80
Added gsiftp/srm to list of url-linked target that are converted to on ticket viewer. Added dedup for replace email/url so that same replacement won't corrupt the page.
Fixed issue where filename containing &ampersand will break the attachment interface (TICKET-99)
Updated dlog to use the mysql style static output file.
Fixed issue where assignee list in ticket list are displaying empty lines. Other minor style adjustments; made "security" label to be red, etc..
Fixed: ticket exchange foreign ID is not displayed nicely for non-anchor id

LVS
Rebuilding one of the lvs instance (lvs2) to run on CentOS 6. We’d like to make sure lvs2 will function properly before switching lvs1 to CentOS6 also, probably during the next-next release.

OIM 3.35
Updated DomainNameValidator to prevent entering invalid GridAdmin domain (OSGPKI-89)
Updated CN validation rule to prevent double space (OIM-105)
Added a module which crawls all perfsonar endpoints and collect available MA endpoints and store them on perfsonar_mas table to be used by MyOSG/mesh config publisher.
Added a bit more debug log to help troubleshoot the staling Digicert certificate issuing problem.
Made FOS list accessible by guest as readonly view. Organized primary/secondary VO and project into different columns. Also added CERT only label.
Added a module called wlcgloader which downloads wlcg sites/endpoints from GOCDB and synchronize them in OIM periodically.
Implemented mesh config admin page.

VM Host Upgrade
Updating vm06.grid.iu.edu, one of our remaining RHEL5/VMware Server 1.10 hosts, to RHEL6/KVM (which most of our VM hosts use)
Converting guest disk images, not rebuilding
Will affect software2, data2, repo2, and rsvprocess2 – will use LVS to shunt traffic to the other instance in the case of software1 and repo1, so users will notice no downtime, only possibly some degradation of service, but rsvprocess2 and data2 will be down
This will leave only two RHEL5/VMware Server 1.10 hosts to upgrade (vm02 and vm04)

Monitor
monitor.grid.iu.edu will be rebuilt with RHEL6 GOC stemcell. monitor.grid.iu.edu is GOC’s internal service used to monitor our services and provide various other internal services like gocbot.

GridFTP-HDFS Corruption Issue Workaround

Some sites in OSG have observed data corruption when transferring files with GridFTP-HDFS. In particular, the problem arises when pthreads is enabled (by setting GLOBUS_THREAD_MODEL="pthread") and GridFTP is using *single stream* transfers that span multiple HDFS blocks. In this condition, blocks may be written to the destination file in the wrong sequence. A few sites using GridFTP-HDFS have reported failures, including Fermilab and GLOW.

This issue affects the OSG gridftp-hdfs package, versions 0.5.4-14 and newer, because they have pthreads enabled by default.



DETAILS

Transfers that use parallelism (we tried from 2-10 streams) and single stream transfers that only span a single HDFS block seem to be fine.

Transfers using a single stream but spanning multiple (3 or more) HDFS blocks result in the correct size, but usually the wrong checksum at the destination. The issue was reported originally by a remote user transferring via srm-copy, and OSG testing has observed the same failures using local globus-url-copy tools.

The issue has been reported to the Globus GridFTP developers, but there is no fix yet. But see below for possible workarounds.



WORKAROUNDS

On the server side, the problem can be avoided by disabling pthreads. To do this step, comment out the following line in /etc/gridftp.d/gridftp-hdfs.conf:

# $GLOBUS_THREAD_MODEL pthread

Until the bug is fixed, we recommend making this change on all gridftp-hdfs servers 0.5.4-14 and newer.

Alternatively, if pthreads cannot be disabled for the GridFTP server, it is sufficient on the client side to run globus-url-copy with parallelism greater than 1. For example:

globus-url-copy -p 2 gsiftp://$host:2811/path/file.in file:///path/file.out

FOR MORE INFO

https://globus.atlassian.net/browse/GT-547
https://jira.opensciencegrid.org/browse/SOFTWARE-1495
https://ticket.grid.iu.edu/21825
https://ticket.grid.iu.edu/21157

Gratiaweb unavailable

Gratiaweb (gratiaweb.opensciencegrid.org) is currently unavailable. OSG Operations is aware of the situation and is looking into solutions. We apologize for any inconvenience.

Friday, August 29, 2014

GOC Ticket Emergency Maintenance 21:00-21:30 UTC

There will be a service impacting outage on GOC Ticket today, August 29 2014, between 21:00-21:30 UTC.

We are very sorry for the inconvenience. Please do not submit or update any tickets during this window. Please do not submit, issue or approve any cert requests, which are linked to tickets.

Wednesday, August 20, 2014

GOC Service Update - Tuesday, August 26th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, August 26th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OSG Web Hosts (web1/2.grid.iu.edu)
- Adding campusgrid.opensciencegrid.org redirection (OIM-11)

OIM 3.34
- Reverting to OpenJDK JVM in order to correct issues such as invalid PKCS12 export.
- Fixed incorrect filename used for user cert CSR export
- Fixed incorrectly placed tooltip content for GridAdmin enrollment button
- Improved responsive handling of navbar.
- Added disable flag to project table (OIM-103)
- Updated VO / SC / CG and Project servlet to hide disabled (removed) record if the user is non admin, and if the user doesn't have edit access.
- Updated friendlyname attribute on PKCS12 to use user certificate DN (OIM-87)
- Increased the possible size of key for semi-static config table.

GOC Ticket 1.79
- Reimplemented ticket assignment logic administration page. Updated NextAssignee logic to use assignment table. (TICKET-17)
- Fixed an issue where solr autocomplete search is returning duplicate research result (TICKET-97)
- Pathed PHP notice for missing ticket_type.
- Added IP prefix for IPV6 (both eth0 and eth1) for GOC VLAN.
- Fixed the Security label issue on ticket viewer (it wasn't using the correct bootstrap class).
- Made the ticket ID displayed on "Successfully updated ticket XXX" to be a HTML link
- Added SUBMITTER metadata to BulkresourceController
- The GOC will upgrade the following services beginning Tuesday, August 26th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

Blogs, GratiaWeb
- Moving host certificates to standard location

GratiaWeb 1.2-29
- Upgrading to osg-measurments-metrics-db/web 1.2-29
- Kernel updates at FNAL, outage expected to be brief.

MyOSG 2.25
- Improved responsiveness of navbar and simplified the homepage title (to make it handle responsive layout better)
- Fixed various issues on support center summary page. Index based query update wasn't working, active filter was still present, and active menu indicator wasn't working. Updated various URLs displayed on search result to use index based query.
- Removed unused css file.
- Removed legacyosgwebsiteview Action from scsummary; page that referenced it no longer exists.
- Added project table to myosg search.
- Added disable flag filtering on project model
- Added deprecation announcements for various perfsonar pages

Tuesday, August 12, 2014

Announcing OSG Software versions 3.2.14 and 3.1.38

We are pleased to announce OSG Software versions 3.2.14 and 3.1.38.

OSG 3.2.14 contains:
* GlideinWMS 3.2.5.1 (update from version 3.2.3)
* Many improvements to HTCondor CE (including changes to OSG Configure and RSV)

OSG 3.2.14 ang 3.1.38 contain:
* VO Package v56
* other minor improvements to OSG Configure, GIP, and GridFTP

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3214
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3138

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Thursday, August 7, 2014

GOC Service Update - Tuesday, August 12th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, August 12th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

GOC Ticket

Moving to github.com and updating release mechanism
Using yum provided php-ZendFramework (1.12.7)
Reports (reports.grid.iu.edu)
Installing OIM DB replication and pki-reports script
RSV Collector (rsv1.grid.iu.edu)
Upgrading to 1.14
(Tentative) Allocating more memory for tomcat to prevent mysql-connector running out of memory (pending on goc ticket 22013)

MyOSG 2.24

Switched to RPM installed Zend framework
Fixed the broken page title issue (MYOSG-75)
Added package.json for eventjs
Fixed wrong perfsonar MA URL for published mesh config
Made OIM URL configurable similar to GOC ticket
(released) Added escape around rgsummary/xml GOC Ticket title / url info.

OIM 3.33.3

PKI / Applied renewal notification update made for OSGPKI-393 on broader context. Also added CC notification suppression for user/host renewal notification. Left the host cert renewal description the same (not requested)
PKI / Refactored isIssuedX509Cert out of CertificateManager. Renamed Certificate to CertificateBase to avoid conflict with java.security.cert.Certificate package
PKI / Made user cert pkcs12 download to not output broken pkcs12 file if it fails to create a pkcs12 object.
PKI / Added capability to revoke individual host certificates (OIM-90)
Added sam_uri field for CE service UI. Added link to the htcondor URI twiki doc (OIM-97)
PKI / Fixed host cert progress bar issue.
PKI / Fixed the SQL issue on "host certificate I approve" (OIM-98)
PKI / Added VO field on host certificate list.
Updated divrep for DivRepButton disabled support.
PKI / Made RA/GridAdmin enrollment form button disabled for admin so that they know where the buttons are (OIM-92)
Added indicator for disabled contact for ContactEditor. Also refactored various public contact list and created PersonView view with disabled contact label (OIM-91)
Various cleanups related to recent migration from svn to git
PKI / Made CNValidator to work with both user/host CN. Replaced regex test on CertRequestHostModel to use CNValidator. Renamed CNEditor to UserCNEditor to make it clear that this is for editing UserCN (not HostCN)
PKI / Applied the CNValidator on CertificateRequestHostForm.

OASIS

Add FNAL, icecube repositories to oasis.

Internal DNS Security Improvement

At the request of the Indiana University Information Policy Office, the caching-only nameserver on each host at OSG Operations will be reconfigured so as to listen only to requests from localhost. Requests from hosts outside the OSG Operations LANs (other than the UIPO’s security testing servers) were already prevented by firewalls, but this will provide an extra layer of security.

IPv6 DNS Addresses

The hostnames of the OSG Operations servers will be given IPv6 addresses in addition to their existing IPv4 addresses in DNS. This is the next step in OSG Operations’ transition to supporting IPv6 in addition to IPv4. No production servers will be transitioning to full dual-stack status at this time, but this will allow us to gauge whether the presence of an IPv6 address in DNS will have any adverse effects on existing services. It is not anticipated that there will be any adverse effects.

Tuesday, July 22, 2014

Announcing OSG Software versions 3.2.13 and 3.1.37

We are pleased to announce OSG Software versions 3.2.13 and 3.1.37.

This high priority release addresses urgent problems that sites are
currently experiencing.

OSG 3.2.13 and 3.1.37 contain:
- Fixed HTCondor Gratia probe to properly account for grid jobs
- Fixed HTCondor CE startup when using a very recent version of HTCondor

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3213
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3137

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

GOC Power and Network Maintenance Tuesday, July 29

The GOC would like to announce a special maintenace window on Tuesday, July 29 from 12:00 to 21:00 UTC. Please note this is the fifth Tuesday of July. The maintenace is required to physically move several servers to satisfy network, power and space constraints and install new equipment. No outages of production services is anticipated, but physical access to racks containing production servers is required.

Wednesday, July 16, 2014

GOC Service Update - Tuesday, July 22nd at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, July 22nd, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OSG Repo (repo.grid.iu.edu)
Update mash files to include non-release el7 repos (osg-3.2-el7-development, -testing, etc.)

All Services
There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases.
However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Wednesday, July 9, 2014

Announcing OSG Software versions 3.2.12 and 3.1.36

We are pleased to announce OSG Software versions 3.2.12 and 3.1.36.

OSG will include CAs conforming to IGTF accredited IOTA (Identifier-Only
Trust Assurance) profiles starting with this release.

OSG 3.2.12 contains:
- Update to HTCondor CE 1.2
- Update to HTCondor 8.0.7
- A fix for file corruption when using parallel transfers in gridftp-hdfs

OSG 3.2.12 ang 3.1.36 contain:
- Updated CA certificates (IGTF 1.58)
- VO Package V55
- A fix for the BeStMan initialization script
- nmap is no longer required by osg-client
- Improvements to osg-configure
- Improvements to osg-pki-tools

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3212
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3136

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Tuesday, July 1, 2014

GOC Service Update - Tuesday, July 8th, 2014 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, July 8th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OIM / GOC-TX / MyOSG
Moving github.com and updating release mechanism

GOC Ticket 1.78
Added check for missing ccs on tickets REST interface
Added fontawesome CDN
Added links to goc ticket RSS feed
Updated GGUS Test URL for ggus1 GOC-TX target
Updated Footprint model so that security/_notification creation / update will not send notification directly to customer / CCs (GOC ticket will send signed email to customer / CCs. Assignee will continue to receive emails directly)
Made description template to load only if the desc area is empty (TICKET-63)
Made Email model to use goc@ as from address by default
Added php notice suppressor for CustomController
(patched) fixed various issues found for RSS feed

Internal DNS/LDAP Improvements
Deploying dnsmasq as a caching-only nameserver on all hosts in order to speed DNS queries and insulate against outages
Shortening DNS and LDAP query timeouts to improve failover performance in case of outages
Rebuilding secondary internal DNS/LDAP server so as to ensure its consistency
Installing primary internal DNS/LDAP server on a different host, one with a single RAID-6 array

Friday, June 20, 2014

DocDB Database Outage for Software Upgrade Tuesday, July 1; 7 a.m. - 9 a.m. CDT

Dear DocDB instance administrators,

WHAT ARE WE DOING?
The DocDB database (MySQL) software will be upgraded to improve security.

WHEN WILL THIS OCCUR?
Tuesday, July 1; 7 a.m. - 9 a.m. CDT

WHAT IS THE IMPACT TO YOU?
All instances of DocDB managed by the Computing Sector-will have read-only access for up to 2 hours within the maintenance window. In addition, read access may be unavailable for up to 10 minutes within that time.
During the read-only period, if you attempt to make changes, you may get an error message or you may get a message saying you were successful. However, your change will not have been implemented.

WHAT DO YOU NEED TO DO?
Please notify your end users of this work. Contact the Service Desk if you have any questions regarding this upgrade.

This message is being distributed to cd-docdb-users@fnal.gov; webteam@fnal.gov; servicedesk@fnal.gov; csi-uss@fnal.gov ba-liaisons@fnal.gov; dharris@fnal.gov; kevin@rochester.edu; ksmcf@fnal.gov; rs@fnal.gov; morfin@fnal.gov; svetlana@fnal.gov; mrenfer@fnal.gov; steige@iu.edu; cssehgal@fnal.gov; rquick@iu.edu; boyd@fnal.gov; sbn-docdb@fnal.gov.

Fermilab Service Desk
http://servicedesk.fnal.gov
servicedesk@fnal.gov
(630) 840-2345

Thursday, June 19, 2014

GOC Service Update - Tuesday, June 24th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, June 24th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

All Services

There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases. However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Tuesday, June 10, 2014

Announcing OSG Software versions 3.2.11 and 3.1.35

We are pleased to announce OSG Software versions 3.2.11 and 3.1.35.

OSG 3.2.11 and 3.1.35 contain:
- Update to CVMFS 2.1.19 (many enhancements and bug fixes)
- Update to VOMS Server 2.0.11 (bug fix)
- Several osg-configure bug fixes
- Gratia probes updated: SGE probe, HDFS probe
- Updated CA certificates (IGTF 1.57)
- Other minor improvements

OSG 3.2.11 contains:
- A new meta-package for HDFS secondary NameNodes

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3211
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3135

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Monday, June 9, 2014

GOC Service Update - Tuesday, June 10th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, June 10th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OIM 3.32
VO / Made VO name to look for duplicate VO name case-insensitively. host_certs_request REST interface will now look up VO names case-insensitively (OSGPKI-329)
Split CN validation rule for user/host certificate CNs, and made host certificate CN’s hostname to not able to start with .(dot) (OIM-82)

GOC Ticket 1.77
Added error checking for search controller to prevent GOC alert in case no autocomplete search results are found. Also added checks for invalid priority label (with a bit more log message) to monitor future occurrence of this issue
Replaced various instances of htmlspecialchars usage with view->escape function (we still have a few more to go..)
Added code to automatically focus & expand description area when user select quick desc
Updated jquery/jquery ui libs
Added RSS export capability for open tickets (still an early prototype) User can subscribe to ticket update via RSS feeder via URLs such as http://ticket.grid.iu.edu/rss?cc=hayashis@iu.edu See Jira ticket for more detail. (patched) added a cron task to remove old posts made to solr indexer (TICKET-68)
Made quick description to sort case insensitively. (TICKET-23)

Repo
Applying createrepo patch to ensure repo1 and repo2 will produce identical metadata checksum (SOFTWARE-1490)

RSVProcess 1.20
Minor cleanup of the code. Switching from IU SVN to github for SCM / release management
New CA distribution, version 1.39

GOC-TX 1.38
GGUS / Updated goctx.jar which include functionality to base64 decode if the content is encoded. (GOCTX-29)
Updated build.xml to include all jar files under lib
(patched) added to suppress and issue reported here http://stackoverflow.com/questions/7615645/ssl-handshake-alert-unrecognized-name-error-since-upgrade-to-java-1-7-0
Updated GOC-TX attachment functions to use the new GOC-TX attachment handlers as requested by Guenter.

Tuesday, May 27, 2014

Announcing OSG Software versions 3.2.10 and 3.1.34

We are pleased to announce OSG Software versions 3.2.10 and 3.1.34.

This high priority release addresses urgent problems that sites are
currently experiencing.

OSG 3.2.10 and 3.1.34 contain:
- VO Package v54
-- Updated information for 2 new CERN VOMS servers
-- Now contains LSC files for those 2 new servers
- Updated Gratia probes
-- Now removes certinfo files as appropriate
-- Fixes this problem which was introduced in 3.2.6 / 3.1.31

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3210
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3134

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Tuesday, May 20, 2014

GOC Service Update - Tuesday, May 27th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, May 27th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OIM 3.31
OIM will be upgraded to run on RHEL6 / tomcat6 / MySQL 5.1 (previously on RHEL5/tomcat5). During the upgrade, OIM might be down for a few hours for reconfiguration.
PKI / Updated the serial ID search field to accept OpenSSL format (OSGPKI-392)
Fixed the missing remove icon issue by replacing all DivRepDialog instance with Bootstrap Dialog (OIM-89)
Updated jquery-ui and jquery libs.

GOC Ticket 1.76
Another attempt to reduce false alerts from Search controller.
(patched) Fixed an issue where attachment/list on ticket without attachment will return empty document

MyOSG 2.22
(patched) Fixed an issue where unescaped newline character crashes rsvmap script
Removed improper active site filter on rsvmap script (MYOSG-73)
Updated jquery/jqueryui/bootstrap and various javascript libraries to match ones used by GOC ticket.
Installed lib/select2 and lib/jquery-scrollstop and replaced fblist with select2
Replaced various references made to .grid.iu.edu with .opensciencegrid.org
Removed obsoleted reference to fermi gratia reporting service.
Made changes to the way list parameters (facility_123=on, facility_234=on) are handled in order for select2 to work. This change should be backward compatible.
Fixed some css issue on chrome with bdii browser

All Services
There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases. However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Tuesday, May 13, 2014

Announcing OSG Software versions 3.2.9 and 3.1.33

We are pleased to announce OSG Software versions 3.2.9 and 3.1.33.

Announcing HTCondor CE 1.0:
-HTCondor CE is suitable for all sites running HTCondor, PBS or SLURM.

OSG 3.2.9 contains:
- HTCondor CE 1.0
-- Improved osg-configure to better support HTCondor CE
-- Improved RSV to better support HTCondor CE
- GridFTP now supports UDT (use the -udt flag)

OSG 3.1.33 and 3.2.9 contain:
- VOMS Admin no longer passes expired and suspended users to GUMS
- Update to cctools 4.1.3
- Update to UberFTP 2.8
- osg-configure more robust when fetch-crl reports problems
- VO Package v53
- Updated Gratia probes (PBS)
- Update to javascriptrrd (used by GlideWMS)
- Various bug fixes

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release329
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3133

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Wednesday, May 7, 2014

Introducing the OSG puppet-contrib repository

Introducing the OSG puppet-contrib repository

Do you manage a site with Puppet? Do you write your own modules because the right ones are not available elsewhere? Or do you wish to share the fruits of your labor?

We have created a new repository where you and others from the OSG community will be able to contribute and obtain Puppet modules for grid software.
The repository is on Github at https://github.com/opensciencegrid/puppet-contrib.

Anyone in OSG can contribute via pull requests; the OSG-Software team will (lightly) curate the modules. We have guidelines and advice at .

Tuesday, May 6, 2014

GOC Service Update - Tuesday, May 13th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, May 13th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

OSG Wordpress Instances (Bosco / OSG Homepage)
* Upgrading to Wordpress version 3.9.
* Upgrading all plugins.

GOC Ticket 1.75
* Security patch (TICKET-95)
* Removed long deprecated attachment handlers
* Patched overly verbose error message generated by SearchController.

GOC-TX 1.38
* Fixed an issue where GOC accessor was still using old attachment handler (updated to use new interface).

OIM 3.30
* Fixed a bug where service certificate request with CN that consists with only the GridAdmin domain name will not be accepted (OIM-86)
* Added “Provide Feedback” button on PKI pages.
* (patched) Added Digicert grid_approve_request call immediately after calling grid_request_host_revoke call.
* Added a capability to configure certificate signer class.

GratiaWeb (tentative)
* Doubling CPU count and memory size (to 2 CPUs and 2G) to reduce occurrence of GratiaWeb service hanging

Monday, April 28, 2014

Gratia Database Outage - Update - Monday, April 28, 2014

The Gratia Database is currently experiencing an outage. On Friday, April 25, the GOC reported instability in some of the services that rely on Gratia for information. Over the course of the weekend, this instability degraded to outage status. Fermilab is currently working to tune the Gratia database. Maintenance is ongoing and there is no estimated time of repair.

We will pass along updates as they become available to us.

During this time Gratia will continue to collect and store accounting records normally and local Gratia record caching will occur if the collector reaches it limits, however no updates will occur to the above referenced sites until it is fully restored.

Friday, April 25, 2014

GratiaWeb Instability

GratiaWeb is currently experiencing an instability. Additionally, OSG Display is experiencing delays with updates. We are currently investigating the cause of the instability. More information can be found here https://ticket.grid.iu.edu/20881. We will provide updates as they become available.

Please contact the GOC with any questions.

Gratia Functionality Restored

Gratia DB resumed normal operations at 09:15 GMT this morning. Gratiaweb and OSG Display have also resumed normal operations and Gratia-APEL will follow shortly.

Please contact the GOC with any questions.

Thursday, April 24, 2014

Gratia Maintenance Ongoing

Fermilab is still working on the gratia DB failures reported earlier. Maintenance is ongoing at this point and no estimated time of repair is available. We will pass on updates as they are avaliable. As a reminder, gratiaweb.opensciencegrid.org and display.opensciencegrid.org will be affected. During this time Gratia will continue to collect and store accounting records normally and local Gratia record caching will occur if the collector reaches it limits, however no updates will occur to the above referenced sites until it is fully restored.

GOC Service Update - Tuesday, April 29th at 13:00 UTC

The GOC announces a special maintenance period starting Tuesday, April 29th, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.

Oasis
Upgrade oasis-replica to cvmfs-server v2.1. Only the GOC instance will be affected.

Tuesday, April 22, 2014

Gratia Emergency Maintenance - Follow Up Information

The Gratia accounting database investigation has completed and a restoration plan is underway. Due to the size of the database we expect it to remain unavailable for publishing data to gratiaweb.opensciencegrid.org and display.opensciencegrid.org until at least tomorrow afternoon. During this time Gratia will continue to collect and store accounting records normally and local Gratia record caching will occur if the collector reaches it limits, however no updates will occur to the above referenced sites until it is fully restored. We will inform the community when Gratia is back to normal operation.

Gratia Emergency Maintenance

Due to a hardware failure the Gratia accounting database has become corrupted. This is currently affecting the publishing of new information to gratiaweb.opensciencegrid.org and display.opensciencegrid.org. The Gratia collector is still functioning normally and all records are being collected and preserved. We are investigating the best way to restore the data from backup and process the new records held on the collector. Until we have completed this emergency maintenance no new data will be published to the sites referenced above.

Wednesday, April 16, 2014

GOC Service Update - Tuesday, April 22nd, 2014 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, April 22nd, 2014 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

GratiaWeb v1.2-28

Rebuilding with RHEL6 image (new version may require python2.6)
Moved all external ‘URL’s into a single file location for easier update and tracking.
Reworked WLCG Reporting (Overview) to contain all summary pledge and capacity information by Federation Name and Resource Group
Reworked WLCG Reporting (Detailed) to contain detailed resources supplied information by Federation Name and Resource Group
New WLCG report pages
Bug fix to ATLAS data transfer graphing
Improvement to wlcg reports error handling
Completion of move for all GratiaWeb URLs to a config file
graphtool / Reworked RPM packaging
graphtool / Updated database connection error handling

GOC-TX 1.36

Added fp114_fermide TX ID for test purpose.

GOC Ticket 1.74
(Didn’t get released during the last release)

Made Gratia software ticket to go to GOC support staff instead of SNOW-GratiaDev (https://ticket.grid.iu.edu/20235)
Oasis

Upgrade oasis-replica to cvmfs-server v2.1. Only the GOC instance will be affected.

All Services

There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases. However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Tuesday, April 15, 2014

Notification of Gratia-reporters service to be decommissioned

Greetings,

On Thursday, April 17th, the gratia-reporters service will be
decommissioned. We recommend anyone still using this service to switch
to the GratiaWeb interface at http://gratiaweb.opensciencegrid.org/. You
should be able to search all gratia data there, however if you need to
do a local search there are local gratia collector instances available at
http://gratia-fermi-osg.fnal.gov:8100/gratia
http://gratia-fermi-transfer.fnal.gov:8100/gratia
http://gratia-fermi-itb.gov:8100/gratia

thanks,
-Kevin

Tuesday, April 8, 2014

Emergency Maintenance

Tomorrow, April 9th, starting at 9:00 (eastern) the GOC will perform emergency maintenance on some services. The usual
high-availability mechanisms will be used to eliminate visible downtime for all services except Oasis where a brief
outage should be expected.

Announcing OSG Software versions 3.1.32 and 3.2.8

We are pleased to announce OSG Software versions 3.1.32 and 3.2.8.

These releases contain updated Certificate Authority (CA) bundles.
It is imperative that these new CA packages are installed before
June 1st. At that time, DigiCert will begin issuing OSG certificates
that depend on the new CA bundles.

OSG 3.1.32 and 3.2.8 contain:
* Updated CA certificates (IGTF 1.56)
- New SHA-2 signed DigiCert CA certificates
- DOEGrids CA certificates removed
- Old format CA certificate bundles discontinued
* Update to CVMFS 2.1.17 (many enhancements and bug fixes)
* VO Package v52
- New Sub VOs: Lariat, Gendetrd, Lar1, and Okra
- New VOMS servers at CERN
* Bug fixes for VOMS admin
* Updated gratia probes (sge, lsf, htcondor)
* Update to RSV 3.7.15 (bug fixes)
* Update to MyProxy 5.9 (bug fixes)
* Many other minor bug fixes

OSG 3.2.8 also contains:
* Bug fix for crash in gridftp-hdfs

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release328
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3132

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Monday, April 7, 2014

2014 OSG User School - application deadline extended

Applications for the 2014 OSG User School are due soon. To make it easier
to apply, we extended the application deadline as late as possible: Sunday,
April 13th. But there is no reason to wait ... apply today for acceptance
to the School and for financial support!


ANNOUNCING THE 2014 OPEN SCIENCE GRID USER SCHOOL!

If you could access thousands, maybe millions of hours of computing, how
would it transform your research? What discoveries would you make?

We are looking for qualified students to attend the 2014 Open Science Grid
(OSG) User School, where they will learn how to use high throughput
computing (HTC) to harness vast amounts of computing power for research.

Using lectures, discussions, roleplays, and lots of hands-on work with OSG
experts in high throughput computing, students will learn how HTC systems
work, how to run and manage many jobs and huge datasets to implement a full
scientific computing workflow, and where to turn for help and more info.

Worried about costs? Successful applicants will get financial support to
attend the OSG School (July 7-10) at the beautiful University of Wisconsin
in Madison.

Ideal candidates are science, technology, engineering, and mathematics
(STEM) graduate students whose research demands large-scale computing.
Also, we will consider applications from faculty, staff, and advanced
undergraduates, so make a good case for yourself!

IMPORTANT DATES

Application Period: March 10 - April 13 (EXTENDED!)
OSG User School: July 7-10

MORE INFORMATION AND APPLICATIONS

Web: http://www.opensciencegrid.org/UserSchool
Email: osg-school-2014@opensciencegrid.org
Facebook: https://www.facebook.com/OSGUserSchool
Twitter: https://twitter.com/OSGUserSchool

Please forward this announcement to help us reach potential students. And
consider posting our flyer where appropriate:

https://twiki.opensciencegrid.org/twiki/pub/Education/OSGUserSchool2014/2014-osg-user-school-flyer.pdf

Tuesday, March 25, 2014

Announcing OSG Software version 3.2.7

We are pleased to announce OSG Software version 3.2.7. This is a high-
priority update to the OSG 3.2 release series.

A few sites encountered a situation where the Globus GRAM Job Manager
would repeatedly crash. The circumstances to trigger the initial crash
were rare. However, once it crashed, it could not recover. This problem
is present in OSG versions 3.2.4 through 3.2.6. We applied a patch from
the Globus developers that addresses both the crash and the failure to
recover.

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release327

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Wednesday, March 19, 2014

OSG Software Release 3.2.7 - March 25th - Globus Job Manager Fix - GOC Ticket # 20220

Some sites have discovered an issue with the "globus-gram-job-manager" package distributed in OSG 3.2. The symptoms are: repeated crashes of the "globus-job-manager" process with a segmentation fault, new jobs not getting queued, and the subdirectories under "/var/lib/globus/gram_job_state" getting filled up with state files of smaller than usual size. The issue is caused by globus-job-manager not handling certain kinds of incomplete state files correctly.

The affected versions of the package are 13.53-1.2.osg32.el5 and 13.53-1.2.osg32.el6. These versions were first released in OSG 3.2.4. CEs running the 3.1 series or those that have not yet upgraded to one of these versions should not be affected.

We have a new version of the globus-gram-job-manager package available in the OSG testing repositories. The new versions are 13.53-1.3.osg32.el5 and 13.53-1.3.osg32.el6. Admins of CEs running the affected version of globus-gram-job-manager are strongly encouraged to upgrade via the following command: yum upgrade --enablerepo=osg-testing globus-gram-job-manager

OSG will be making a 3.2.7 release containing this fix on March 25th.

Please see ticket 20220 at:
https://ticket.grid.iu.edu/20220

Tuesday, March 18, 2014

GOC Service Update - Tuesday, March 25th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, March 25, 2014 at 13:00 UTC.
The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.
We encourage users to test affected services before the production release.

GLIDEIN
*Apply a patch to glideinwms factory to fix a multicore glidein memory bug causing glideins to fail on startup.

OASIS
*Replace the oasis.opensciencegrid.org Virtual Machine with a new one that has a rebuilt repository with much smaller but more numerous catalogs.
*Change osg-oasis-update command on oasis-login.opensciencegrid.org to first check to make sure all files are readable by other before publishing changes.

Monday, March 17, 2014

Announcing the 2014 OSG User School

ANNOUNCING THE 2014 OPEN SCIENCE GRID USER SCHOOL!

If you could access thousands, maybe millions of hours of computing, how
would it transform your research? What discoveries would you make?

We are looking for qualified students to attend the 2014 Open Science Grid
(OSG) User School, where they will learn how to use high throughput
computing (HTC) to harness vast amounts of computing power for research.

Using lectures, discussions, roleplays, and lots of hands-on work with OSG
experts in high throughput computing, students will learn how HTC systems
work, how to run and manage many jobs and huge datasets to implement a full
scientific computing workflow, and where to turn for help and more info.

Worried about costs? Successful applicants will get financial support to
attend the OSG School (July 7-10) at the beautiful University of Wisconsin
in Madison.

Ideal candidates are science, technology, engineering, and mathematics
(STEM) graduate students whose research demands large-scale computing.
Also, we will consider applications from faculty, staff, and advanced
undergraduates, so make a good case for yourself!

IMPORTANT DATES

Application Period: March 10 - April 4
OSG User School: July 7-10

MORE INFORMATION AND APPLICATIONS

Web: http://www.opensciencegrid.org/UserSchool
Email: osg-school-2014@opensciencegrid.org
Facebook: https://www.facebook.com/OSGUserSchool
Twitter: https://twitter.com/OSGUserSchool

Please forward this announcement to help us reach potential students. And
consider posting our flyer where appropriate:

https://twiki.opensciencegrid.org/twiki/pub/Education/OSGUserSchool2014/2014-osg-user-school-flyer.pdf

Wednesday, March 12, 2014

OSG All Hands Meeting - Registration

Dear Colleagues,

We are just a few weeks away from the OSG All Hands Meeting! We encourage you to register and participate in this important annual event for the Consortium. We have a very full and interesting agenda – the details of which are being built out at https://indico.fnal.gov/conferenceDisplay.py?confId=7207

If you plan on attending please register and make your lodging arrangements soon.

The SLAC National Accelerator Laboratory is hosting this event to reflect its increasing activity as a member of OSG Communities and the OSG Consortium itself, and we are using the opportunity to invite and include more of our local researchers and scientists from Standard University as well as SLAC itself. The scheduled topics include:
* Monday: US ATLAS and US CMS computing workshops
* Tuesday: The OSG Campus Infrastructures Community: campus distributed computing infrastructures and the national cyber ecosystem
* Wednesday: Plenary presentations from Scientists benefiting from the OSG as well as the OSG Project Leads giving the status and future plans
* Thursday:
OSG New Technologies
Federated Storage Workshop (USA and Europe)
* Friday:
Federated Storage Workshop (USA and Europe)

We invite you to visit the 2014 OSG AHM site at http://app.certain.com/profile/web/index.cfm?PKwebID=0x5948342f2c&varPage=home soon and register.

Amber Boehnlein, SLAC Division Director, Scientific Computing Applications
Lothar Bauerdick, OSG Executive Director
Ruth Pordes, OSG Council Chair

Tuesday, March 11, 2014

Announcing OSG Software version 3.1.31 and 3.2.6

We are pleased to announce OSG Software versions 3.1.31 and 3.2.6.

OSG 3.2.6 contains:

* Update to HTCondor-CE 0.6.3
(now works with PBS, plus SLURM through SLURM's PBS emulation layer)
* Update to GlideinWMS 3.2.3 (several bug fixes)
* Update to HTCondor 8.0.6 (several bug fixes)

Both 3.1.31 and 3.2.6 contain:

* Many updated gratia probes, (e.g. htcondor, slurm, psacct, dcache-transfer)
* Disable certinfo check on probes that don't need it
* Update BeStMan to support "root" SRM transfer protocol
* Update to XRootD 3.3.6 (several minor bug fixes)

OSG 3.1.31 contains:
* Improved integration between osg-configure, osg-info-services and gip
(Previously released in OSG 3.2.5)

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3131
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release326

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Thursday, March 6, 2014

GOC Services Update - Tuesday, March 11th at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, March 11, 2014 at 14:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OIM 3.27
* Updating approver_vo_id on host certificate request records with NULL approver_vo_id with current *best* matching VO IDs.
* Removed /goc URL reference for goc ticket submitter
* Fixed CNEditor input width issue.
* Removed old bootstrap libs Updated divrep.jar (DivRepUpload / Base64 encoding) and stripped old js/css and updated bootheaders to use CDNs.

MyOSG 2.21
* Removed ReSS service from operations status overview page.
* OSG Display (git/master 0554f5b)
* Fixing typo for “Month” instead of “Months”.

GOC-TX 1.35
* Modifying the way GOC-TX pulls ticket comments from ServiceNow (per Mike Baker)

GOC Ticket 1.73
* Added a null check to suppress false alerts from search controller
* Updated GOC ticket assignment configuration
* Removed Dan F. from campusgrid form assignment.

Monday, March 3, 2014

RESOLVED: Problems Issuing Certificates via OSG PKI

The previously reported issue with issuing OSG PKI certificates has been resolved. OSG Operations and DigiCert restored service at approximately 5:40pm Eastern time. It is now safe to continue issuing certificates as you have done in the past.

Users affected by this issue will be contacted and working certificates reissued.

We apologize for any inconvenience this may have caused.

Problems Issuing Certificates via OSG PKI

The OSG PKI is currently having an issue with new certificates not being signed properly. OSG Operations is currently working with DigiCert (issuer of OSG certificates) to investigate the cause. We will send an update as soon as we have more information. Meanwhile, please do not issue any certificate using OSG PKI tools and OIM web interface until further notice.

We apologize for any inconvenience this may cause.

Thursday, February 27, 2014

Announcing OSG Software version 3.2.5 - GOC Ticket # 19799

We are pleased to announce OSG Software version 3.2.5. This is a high-
priority update to the OSG 3.2 release series.

In OSG 3.2, we dropped CE-Monitor in favor of osg-info-services, which
provides the same core functionality in a simpler package. But until
now, a default installation of osg-configure, osg-info-services, and gip
were not well integrated, and in some environments osg-configure even
failed to run. This release corrects the known issues with and improves
integration of the information services components.

Use this new release if (a) you tried OSG 3.2, but reverted to OSG 3.1
because of problems with these components, or (b) you are avoiding OSG
3.2 because you have heard that these components were not ready.

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release325

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Please see ticket 19799 at:
https://ticket.grid.iu.edu/19799

Wednesday, February 19, 2014

GOC Services Update - Tuesday, February 25 at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, February 25, 2014 at 14:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.


OSG Planet (https://blogs.opensciencegrid.org)
* Adding OSG Homepage newsletters to the aggregator.


OSG Display
* Updating to osg-display-data-1.0.9-1 so that it calculates 12 month numbers similar to gratiaweb (SOFTWARE-1400)


All Services
* There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases. However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Tuesday, February 11, 2014

Announcing OSG Software versions 3.1.30 and 3.2.4

We are pleased to announce OSG Software versions 3.1.30 and 3.2.4.

The 3.2.4 version contains the following change:

* Update to Globus Toolkit 5.2.5 (many minor bug fixes and performance improvements)

In addition, both 3.1.30 and 3.2.4 versions contain the following changes:

* Update to xrootd version 3.3.5 (pick up bug fixes from 3.3.4 and 3.3.5)
* Update to VO Package v51 (DigiCert: Fermilab, SBGrid; GOC VOMS server reference)
* Update to RSV version 3.7.14 (provide support for contributed zabbix consumer)

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3130
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release324

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

CORRECTION: HTCondor delegates proxies as 512-bit proxies by default

WLCG glexec tests have uncovered an issue with the effective default size of HTCondor delegated proxies. Sites should be aware that if they allow HTCondor to delegate proxies, the delegated proxies will be 512-bit proxies, even if the original proxy was 1024-bits or greater.

The issue is an incompatibility with 512-bit proxies and OpenSSL versions >= 1.0.1. Glexec calls and SSL communication will fail.

As stated in the OSG release documentation, sites should disable delegation entirely by inserting the following line into their HTCondor configuration:

DELEGATE_JOB_GSI_CREDENTIALS = False

More information can be found at https://twiki.grid.iu.edu/bin/view/Documentation/Release3/InstallComputeElement#5_1_If_you_are_using_Condor

HTCondor delegates proxies as 512-bit proxies by default

The following announcement from Tony Tiradani applies only to HTCondor sites:

WLCG glexec tests have uncovered an issue with the effective default size of HTCondor delegated proxies.  Sites should be aware that if they allow HTCondor to delegate proxies, the delegated proxies will be 512-bit proxies, even if the original proxy was 1024-bits or greater.

The issue is an incompatibility with 512-bit proxies and OpenSSL versions >= 1.0.1.  Glexec calls and SSL communication will fail.

Sites may disable delegation entirely by inserting the following line into their HTCondor configuration:

DELEGATE_JOB_GSI_CREDENTIALS = False

Alternatively, sites may specify to HTCondor the bit size to use for delegating proxies by inserting the following line into their HTCondor configuration:

GSI_DELEGATION_KEYBITS = 1024

The actual value may be increased.  However, from the HTCondor manual, "Setting the value greater than 4096 is likely to cause long compute times."

Additionally, the default for GSI_DELEGATION_KEYBITS will be changed to 1024-bits in the upcoming HTCondor 8.0.6 release.

Monday, February 10, 2014

REMINDER: OSG PKI Update to SHA-2 - Tomorrow, February 11th, 2014

As a reminder, tomorrow, February 11th all newly issued certificates will be signed with the new SHA-2 hash algorithm. To be fully compliant in all packages OSG resources will need to be updated to OSG 3.1.22 or greater. Release 3.1.22 has been available since August, 2013. A full table of packages and the OSG version they are compliant at is available at https://twiki.opensciencegrid.org/bin/view/Documentation/Release3/SHA2Compliance. It is very important that you review this list and determine if commonly used software at your site needs to be updated.

The OSG Production and Software Teams are available to answer your questions regarding the SHA-2 update. Please open a ticket at http://ticket.grid.iu.edu/goc/submit if you have any questions or need assistance.

Wednesday, February 5, 2014

GOC Services Update - Tuesday, February 11th at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, February 11th, 2014 at 14:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

GratiaWeb v1.2-24
* Rebuilding with RHEL6 image (new version may require python2.6)
* Moved all external ‘URL’s into a single file location for easier update and tracking.
* Reworked WLCG Reporting (Overview) to contain all summary pledge and capacity information by Federation Name and Resource Group
* Reworked WLCG Reporting (Detailed) to contain detailed resources supplied information by Federation Name and Resource Group

GOC Ticket 1.72
* Removing /goc prefix inside GOC Ticket URL (/goc will be redirected to /)
* Added ticket list statistics info back to ticket list view (TICKET-92)
* Replaced obsolete version of jquery autocomplete plugin with jquery-ui native autocomplete (TICKET-94)
* Fixed the checkbox display issue on notification form (rss / sign checkboxes)
* Removed group ticket page (deprecated). the group.xml will remain for ticket viewer page
* (already released) fixed issue where attachment handler won't insert new attachment on ticket that has never had attachment

OIM
* Switching configuration to start issuing user/host certificate in SHA-2

VOMS
* Doing a full-system backup of voms.grid.iu.edu, during which the VM must be powered down.

Tuesday, January 21, 2014

GOC Service Update - Tuesday, January 28th, 2013 at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, January 28th, 2013 at 14:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OASIS

Updating grid-mapfile updater to allow same user(DN) to be listed for multiple VOs (OO-20)

OIM

(DB Update) All host certificate request records with approver VO ID not set will be reset based on CNs and current configuration of GridAdmin table.

MyOSG 2.20

Minor cosmetic update on Resource Group / downtime page.
Filtered disabled contact on vooasisuser
Fixed the issue where contact model does not return all DNs. Updated HTML/XML to return list of DNs instead of a single DN.

RSV collector - rsv1.grid.iu.edu (1.13.10-1.1.osg.el6)

(Re-try from last week’s update aborted)
Upgrading to version 1.13.10
(already applied) Increased tomcat memory size to 2G/512M-perm to prevent GC out of memory problem, and increased OS memory size to 8G.

OSG Homepage

Currently, /pub URLs such as https://www.opensciencegrid.org/twiki/pub/Security/PKIDocumentationIndex/DigiCert_Grid_API_August_2012.pdf are not forwarded to Twiki. Fixing RewriteRule to forward such URLs.

Repo (repo-itb/repo1/repo2.grid.iu.edu)

Updating the mirror script to add connection timeout and locking

All Services

There will be OS updates; reboots will be required. Downtime should be minimal, and the usual high-availability mechanisms will be used to reduce service downtime even further and eliminate it in most cases. However, services may experience degraded performance, and the services without HA mechanisms (OIM and Twiki) will still experience brief downtimes.

Tuesday, January 14, 2014

New VO Package Available

OSG Operations would like to welcome two new Virtual Organizations to the OSG Consortium.

This includes the Cherenkov Telescope Array and the XENON Dark Matter Search

Please add these new VO’s along with the recently released ENMR VO that is attempting to gain a foothold.

A detailed list of changes is available at:
https://twiki.grid.iu.edu/bin/view/Operations/PackageV50

The GOC suggests backing up your installation before running any update commands.

Announcing OSG Software versions 3.1.29 and 3.2.3

We are pleased to announce OSG Software versions 3.1.29 and 3.2.3.

Both 3.1.29 and 3.2.3 versions contain the following changes:

* Update to VO Package v50 (Add CTA and xenon-biggrid.nl)
* Added manpages to Cooperative Computing Lab's cctools packages (Parrot, Chirp, Makeflow, etc.)
* Added cctools-doc package which contains overall cctools HTML documentation.
* Update to gLExec version 0.9.9

The 3.2.3 version contains the following additional changes:

* Improved usability of empty-* packages
* Update to HTCondor version 8.0.5

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3129
https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release323

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Tuesday, January 7, 2014

OSG PKI Update to SHA-2 Now February 11th, 2014

The OSG PKI has delayed its start date for issuing SHA-2 signed certificates from January 14th, 2014 to February 11th, 2014. On February 11th all newly issued certificates will be signed with the new SHA-2 hash algorithm. To be fully compliant in all packages OSG resources will need to be updated to OSG 3.1.22 or greater. Release 3.1.22 has been available since August, 2013. A full table of packages and the OSG version they are compliant at is available at https://www.opensciencegrid.org/bin/view/Documentation/Release3/SHA2Compliance. It is very important that you review this list and determine if commonly used software at your site needs to be updated.

The OSG Production and Software Teams are available to answer your questions regarding the SHA-2 update. Please open a ticket at http://ticket.grid.iu.edu/goc/submit if you have any questions or need assistance.

GOC Service Update - Tuesday, January 14th, 2013

The GOC will upgrade the following services beginning Tuesday, January 14th, 2013 at 14:00 UTC. The GOC reserves 8 hours in the unlikely event that unexpected problems are encountered.  We encourage users to test affected services before the production release.

OSG Homepage
* Fixed the jQuery conflict issue by replacing jQuery from OSG theme with one provided by Wordpress, and updated jQuery referencing to use noConflict version.
* Upgrading to Wordpress 3.8 (& updating all plugins)

GratiaWeb v1.2-20, v1.2-21, v1.2-22
* Updating to use latest OSG release (3.2)
* Allowing filter by ProjectName and facility on the project query / Fixed project filtering (GratiaWeb-42)
* Added two new queries in preparation for wlcg_reporting software modifications.

OSG Display (1.0.6)
* Rebuilding to RHEL6
* Fixed discrepancy between OSG display and GratiaWeb's CPU hours (SOFTWARE-1326)

RSV collector - rsv1.grid.iu.edu (1.13.10-1.1.osg.el6)
* Maintenance update
* (already applied) Increased memory size to 2G/512M-perm to prevent GC out of memory problem.

MyOSG 2.19
* Added a counter for number of resources displayed for all resource group pages
* Added specific metric selector for Current Status page - behavior should be backward compatible with old MyOSG queries, but need more testing / notification (MYOSG-71)
* Fixed the issue that crashes resource group / XML page if user enter resource name with & character in OIM.
* Combined FieldOfScience and VOFieldOfScience models into one, and deprecated FieldOfScience model itself.
* Updated the way FOS is pulled & displayed in MyOSG to allow fos_rank related to OIM-78
* Added rank indicator icons for various contacts for vosummary page

OIM 3.26
* Work in progress to make sure approver_vo_id gets set for all new request
* Added various notifications messages after user performs actions successfully  (renew / revoke / re-request ,etc..) Also replaced "you can not performed any action" to "please wait while certificate is issued" during certificate issuing state (per goc ticket 17869)
* Added list of DNs requested by user for host certificate request (per GOC Ticket 17991)
* Various updates related to FOS editor (access control, menu placement, breadcrumbs) Made autocomplete.js to take minLength parameter as an attempt to allow user to double click on the input field to list all values.
* Added capability to re-focus new contact input after user select a value - also for FOS editor (OIM-75)
* Updated vo_field_of_science contact_rank_id table column name to rank_id
* Updated FOS editor with contact editor style selector, and remove ability for user addition.
* Updated FOS administration page to include list of VO/Project using the FOS, and delete button if no VO/project is used (OIM-78 / OIM-79)

GOC Ticket 1.71
* Updated to use latest jquery/jquery-ui/bootstrap (still 2.3.2) from publically available CDN.
* Completely overhauled attachments interface (TICKET-91)
* (released) adjusted RR rule (TICKET-90)
* (patched) fixed an issue where failure to connect chat.js will prevent page from loading

GOC-TX 1.32 (Rebuild)
* Upgrading to RHEL6 / MySQL 5.1

Monday, January 6, 2014

Sever Weather Conditions Continue at Indiana University

Due to severe weather conditions the Bloomington and Indianapolis campuses of Indiana University will be closed Tuesday, January 7th (http://emergency.iu.edu). The OSG Operations Center will be operating on emergency weekend and evening procedures until at least the morning of Wednesday, January 8th. Critical services and emergency response will be addressed immediately, but routine business items and ticket handling may be postponed until campus reopens.

Sunday, January 5, 2014

Severe Weather Conditions at Indiana University

Due to severe weather conditions the Bloomington and Indianapolis campuses of Indiana University will be closed Monday, January 6th (http://emergency.iu.edu). The OSG Operations Center will be operating on emergency weekend and evening procedures until at least the morning of Tuesday, January 7th. Critical services and emergency response will be addressed immediately, but routine business items and ticket handling may be postponed until campus reopens.

We anticipate both campuses will be operating normally by Tuesday morning. We will update our status if this is not the case.

Thursday, January 2, 2014

OSG Connect Network Maintenance - Friday January 4th

OSG Connect services will be impacted by a network maintenance on the
University of Chicago's 100G network tomorrow, January 4th 2014, between
1100 and 1200 GMT. During this window the 100G network will be unavailable
though some traffic may be reroute through the 10G network. This includes
all OSG Connect services homed at the University of Chicago.