Friday, April 27, 2018

OASIS announcement



The OSG will be performing a migration of the OASIS services to be physically located at the University of Nebraska.  The hosts behind oasis.opensciencegrid.org, oasis-login.opensciencegrid.org, and oasis-replica.opensciencegrid.org will migrate Thursday, 3 May 2018, starting at 10AM EST.

The migration will require us to  to synchronize the home directories and OASIS contents from the old server to the new; we expect this to complete within three hours. During that period, access to oasis-login.opensciencegrid.org will be disabled.

Test versions of the new hosts are already available at oasis-itb.opensciencegrid.org, oasis-login-itb.opensciencegrid.org, and oasis-replica-itb.opensciencegrid.org. Concerned users are encouraged to test their publication workflow on those services.  The ITB hosts were last synchronized on 25 April and any changes done on the ITB there will be reset on 3 May.

If you see any issues or have any questions or concerns, please reach out to https://support.opensciencegrid.org/ or help@opensciencegrid.org.

OSG Operations and OSG Software Team
https://www.opensciencegrid.org/

Friday, April 20, 2018

DNS Migration Tuesday, 23 April, 10:00 EDT

The OSG will be performing a migration of the nameserver for opensciencegrid.org and osgstorage.org next Tuesday, 23 April 2018, starting at 10AM EST.  Given the level of caching within the DNS infrastructure, it may take up to 24 hours for the change to fully propagate.

The migration is expected to be completely transparent to all sites and not require any action.

However, there remains some risk of interruption, particularly around the delivery of email messages to opensciencegrid.org lists.  If you see any issues next Tuesday, kindly reach out to https://support.opensciencegrid.org or, for non-email-related issues, help@opensciencegrid.org.

If you have any questions or concerns, feel free to reach out prior to the transition.

OSG Operations and OSG Software Team
https://www.opensciencegrid.org/

OSG Statement on Continued Services and Support

As you may have heard, the Open Science Grid (OSG) is undergoing some transitions in its funding model. We have been planning for these changes for some time, and the National Science Foundation is providing clear direction and enthusiastic support now and for the foreseeable future.

We remain committed to providing services and support for our community of resource providers and science users. To that end, we want to tell you about some short-term transitions that are planned between now and the end of May 2018.

OSG operates a fabric of services that form the core of our distributed infrastructure, and we are reviewing all service deployments.  Some services will be retired (e.g., central RSV components, VOMS Admin), most services will be migrated with little planned effect on sites (e.g., OSG Display, CVMFS, perfSONAR monitoring), and some services will be migrated with greater effect on sites (OIM and OSG CA). There will be announcements for each service as it migrates.

In addition, OSG provides support to users, Virtual Organizations (VOs), resource providers, and others through a variety of entry points. Over the next month, we will be retiring one of the three underlying support ticket-tracking systems in use today, but plan to maintain nearly all of the current methods for requesting support (e.g., email addresses).  The LHC community will concentrate its support on the existing GGUS system, and the broader community will use the existing OSG Support system based on the Freshdesk system.  As with services, there will be announcements for specific support entry points as each one migrates.

For OSG resource providers, we have created and will frequently update an OSG Operations Transition document here: https://opensciencegrid.github.io/technology/policy/service-migrations-spring-2018/

Frank Wuerthwein - OSG Executive Director
Miron Livny – OSG Technical Director and Principle Investigator
David Swanson – OSG Council Chair

Wednesday, April 18, 2018

Announcing OSG Software version 3.4.10

We are pleased to announce OSG Software version 3.4.10.

NOTE: See the release notes for known issues with Singularity 2.4.6

Changes to OSG 3.4.10 include:
- Singularity 2.4.6: fixed bind mount security vulnerability
- HTCondor-CE 3.1.1: now accepts InCommon certificates
- HTCondor 8.6.10: fixed handling of grid jobs when submit fails
- cigetcert 1.16: first release in the OSG Software Stack
- BLAHP: Improved input file checks and can save submit info for debugging
- xrootd-lcmaps: fixed crashes on EL6 with HTTPS requests
- frontier-squid: fixed startup problem under SELinux
- osg-configure: several minor bug fixes
- Upcoming: HTCondor 8.7.7
- Upcoming: xrootd-hdfs improved write support

Release notes and pointers to more documentation can be found at:

http://opensciencegrid.github.io/docs/release/3.4/release-3-4-10/

Need help? Let us know:

http://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release!

Tuesday, April 10, 2018

Applications and letters of recommendation are due Friday, April 20!

Announcing the Open Science Grid User School 2018

If you could access hundreds or even thousands of computers for your
scholarly work, what could you do? How could it transform your work?
What discoveries might you make?

We are seeking applicants for the Open Science Grid (OSG) User School
2018, which takes place July 9-13 at the beautiful University of
Wisconsin in Madison. Participants will learn to use high throughput
computing (HTC) to harness vast amounts of computing power for research,
applicable to nearly any field of study (e.g., physics, chemistry,
engineering, life sciences, earth sciences, agricultural and animal
sciences, economics, social sciences, medicine, and more).

For more background:
https://research.cs.wisc.edu/htcondor/htc.html
https://www.opensciencegrid.org/news/research-highlights-list/
https://docs.google.com/presentation/d/1KeI-ZGfPya6S9WQ7Wzo7lRhU5fr0N_gIHRgRtK3tlIc/

Using lectures, discussions, roleplays, and lots of hands-on work with
OSG experts in HTC, participants will learn how HTC systems work, how to
run and manage many jobs and huge datasets, how to implement a realistic
scientific computing workflow, and where to turn for help and more info.

Worried about costs? We pay all basic travel, hotel, and food costs for
applicants who are selected to attend. This is a valuable offer!

Ideal candidates are graduate students whose research involves or could
involve large-scale computing - work that cannot be done on one laptop
or a handful of computers. Also, we accept some post-doctoral students,
faculty, staff, and advanced undergraduates, so make a strong case for
yourself regardless of your current role!

IMPORTANT DATES

Application Period (OPEN NOW): 15 March - 20 April 2018
OSG User School: 9-13 July 2018

MORE INFORMATION AND APPLICATIONS

Web: https://www.opensciencegrid.org/UserSchool
Email: user-school@opensciencegrid.org
Facebook: https://www.facebook.com/OSGUserSchool
Twitter: https://twitter.com/OSGUserSchool

Please forward this announcement to anyone who might benefit from the
OSG User School. And consider posting our flyer where appropriate:

https://opensciencegrid.github.io/user-school-2018/files/osg-user-school-2018-flyer.pdf

Thursday, April 5, 2018

Operations Service Update - Thursday, April 12th, 2018 at 13:00 UTC

The GOC will upgrade the following services beginning Thursday, April 12th, 2018 at 13:00 UTC. Grid Operations reserves 8 hours in the unlikely event unexpected problems are encountered.

Repo
  * Remove el5 and osg 3.1 support

OIM
  * Downtime add/editing permission integration update
  * SSO update

Tuesday, March 20, 2018

Operations Service Update - Tuesday, March 27th, 2018 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, March 27th, 2018 at 13:00 UTC. Grid Operations reserves 8 hours in the unlikely event unexpected problems are encountered.

REPO
 *Update repository maintenance scripts

Oasis
 *Update to cvmfs-servermon-1.7+

OIM
 *Python script updates
 *Database configuration changes

Myosg
 *Jquery update

Ticket Exchange
 *Fermilab format update  

Operations Service Update - Tuesday, March 27th, 2018 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, March 27th, 2018 at 13:00 UTC. Grid Operations reserves 8 hours in the unlikely event unexpected problems are encountered.

REPO
 *Update repository maintenance scripts

Oasis
 *Update to cvmfs-servermon-1.7+

OIM
 *Python script updates
 *Database configuration changes

Myosg
 *Jquery update

Ticket Exchange
 *Fermilab format update  

Monday, March 19, 2018

ANNOUNCING THE OPEN SCIENCE GRID USER SCHOOL 2018!

If you could access hundreds or even thousands of computers for your
scholarly work, what could you do? How could it transform your work?
What discoveries might you make?

We are seeking applicants for the Open Science Grid (OSG) User School
2018, which takes place July 9-13 at the beautiful University of
Wisconsin in Madison. Participants will learn to use high throughput
computing (HTC) to harness vast amounts of computing power for research,
applicable to nearly any field of study (e.g., physics, chemistry,
engineering, life sciences, earth sciences, agricultural and animal
sciences, economics, social sciences, medicine, and more).

For more background:
https://research.cs.wisc.edu/htcondor/htc.html
https://www.opensciencegrid.org/news/research-highlights-list/

Using lectures, discussions, roleplays, and lots of hands-on work with
OSG experts in HTC, participants will learn how HTC systems work, how to
run and manage many jobs and huge datasets, how to implement a realistic
scientific computing workflow, and where to turn for help and more info.

Worried about costs? We pay all basic travel, hotel, and food costs for
applicants who are selected to attend. This is a valuable offer!

Ideal candidates are graduate students whose research involves or could
involve large-scale computing - work that cannot be done on one laptop
or a handful of computers. Also, we accept some post-doctoral students,
faculty, staff, and advanced undergraduates, so make a strong case for
yourself regardless of your current role!

IMPORTANT DATES

Application Period (OPEN NOW): 15 March - 20 April 2018
OSG User School: 9-13 July 2018

MORE INFORMATION AND APPLICATIONS

Web: https://www.opensciencegrid.org/UserSchool
Email: user-school@opensciencegrid.org
Facebook: https://www.facebook.com/OSGUserSchool
Twitter: https://twitter.com/OSGUserSchool

Please forward this announcement to anyone who might benefit from the
OSG User School. And consider posting our flyer where appropriate:

https://opensciencegrid.github.io/user-school-2018/files/osg-user-school-2018-flyer.pdf

Thursday, March 8, 2018

Announcing OSG Software version 3.4.9

We are pleased to announce OSG Software version 3.4.9.

Changes to OSG 3.4.9 include:
- XRootD: Several important bug fixes
- GlideinWMS: Enhanced Singularity support, automatic proxy renewal
- Frontier Squid: Fixed handling of "Pragma: no-cache" directive
- RSV: Improved security verifying certificates, fixed Java version probe
- osg-release: Use HTTPS protocol for OSG repositories

Release notes and pointers to more documentation can be found at:

http://opensciencegrid.github.io/docs/release/3.4/release-3-4-9/

Need help? Let us know:

http://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release!

Announcing OSG Software version 3.3.33

We are pleased to announce OSG Software version 3.3.33.

Changes to OSG 3.3.33 include:
- Fixed an issue where the XRootD service would not start upon reboot

Note: At this point, only critical issues will be addressed in this series
through May 2018. After May, this release series is unsupported. Please
update to the 3.4 series.

Release notes and pointers to more documentation can be found at:

http://opensciencegrid.github.io/docs/release/3.3/release-3-3-33/

Need help? Let us know:

http://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release!

Tuesday, March 6, 2018

Operations Service Update - Tuesday, March 13, 2018 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, March 13, 2018 at 13:00 UTC. Grid Operations reserves 8 hours in the unlikely event unexpected problems are encountered.

Collector
  * Reconfigure certificates to properly enable multiple instances

Jira
  * Change cipher suite

OIM
  * Adjustments to internal URL configurations
  * Session increase to 24 hours

Oasis
  * Update frontier-squid on oasis-replica to prevent runaway squids.

Repo
  * Enable iPV6

Ticket
  * Update recaptcha to v2 (branch 2.3)
  * Session increase to 24 hours

MyOSG
  * Session increase to 24 hours

Ticket Exchange
  * Fermilab synchronization update  (branch 1.55)

All Services
  * Operating system updates will be installed; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.

Tuesday, February 20, 2018

Operations Service Update Tuesday, February 27, 2018 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, February 27, 2018 at 13:00 UTC. Grid Operations reserves 8 hours in the unlikely event unexpected problems are encountered.

All Services
  * Operating system updates will be installed; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.

Friday, February 16, 2018

Update: Single Sign On for OSG Operations Services

Colleagues,

As most of you know, on February 7, we released our first step in a transition to Single Sign On for OSG Operations Services.  These changes have affected the following websites:

https://oim.opensciencegrid.org/
https://ticket.opensciencegrid.org/
https://my.opensciencegrid.org/

Please refrain from using the *.grid.iu.edu addresses, as the sessions are domain-based and we will be using *.opensciencegrid.org moving forward.

We understand that there has been some confusion and growing pains during this change, and we apologize for the inconvenience that this has caused.  We are actively working to solve these problems as they come to us.  If you do encounter problems, please open a ticket by:

1) Submitting a ticket at https://ticket.opensciencegrid.org/submit/

2) Sending email to help@opensciencegrid.org

One of the most common issues that we are seeing is confusion about whether a user is actually logged in or not.  When you approach one of the above-mentioned websites, you may be asked to present a certificate.  In the past, this would have logged you in, however, now you are asked for a certificate so that we can pair your existing OIM account to your new CILogon SSO credentials.

To make sure that you are logged in, look at the upper-right corner of the website. If you see your name, you are logged in.  If you see “Login,” you will need to click that button, which will take you to CILogon’s SSO interface.  You can choose your institution from the list, or if your institution is not listed, you can log in with a Google or Github account.  Once you do that, you should be returned to the website and you’ll see your name in the upper-right corner.  From there, you should be good to go.  

If you encounter problems with this, please open a ticket as stated above.

Again, we understand that this change has caused some confusion and frustration.  Please know that we are actively working to make this transition as painless as possible.

Tuesday, February 13, 2018

OSG Operations Service Update - Tuesday, Feb 20 at 13:00 UTC

The GOC will upgrade the following services beginning Tuesday, Feb 20 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.

Ticket
  * Update JQuery package
  * Do not notify the submitter when a ticket is marked as spam
Display
  * Fix response when empty data returned from GRACC

Thursday, February 8, 2018

Announcing OSG Software versions 3.3.32 and 3.4.8

We are pleased to announce OSG Software versions 3.3.32 and 3.4.8!

This is the OSG Software distributed via RPMs for:

* Scientific Linux 6 and 7
* CentOS 6 and 7
* Red Hat Enterprise Linux 6 and 7

This release affects the GlideinWMS VO Frontend and consists of a critical bug
fix for heavily loaded frontends (<https://cdcvs.fnal.gov/redmine/issues/18748>;).

Release notes and pointers to more documentation can be found at:

* https://opensciencegrid.github.io/docs/release/3.4/release-3-4-8/
* https://opensciencegrid.github.io/docs/release/3.3/release-3-3-32/

Need help? Let us know:

https://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release

Monday, February 5, 2018

Single Sign-on implementation on OIM, Ticket, and MyOSG - February 7, 2018

On February  7th, 2018 grid operations will be impementing new authentication system in OIM, Ticket and MyOSG.

The new authorization/authentication system will ask both to login with your certificate and login through CILogon with your institution credentials. This will allow us to map your account in case the information passed from CILogon is different from the information we have in OIM.

We encourage all of you to test the new SSO login funtionality of the following services.

https://oim-itb.grid.iu.edu
https://ticket-itb.grid.iu.edu
https://myosg-itb.grid.iu.edu

Thursday, February 1, 2018

Announcing OSG Software version 3.4.7

We are pleased to announce OSG Software version 3.4.7.

Changes to OSG 3.4.7 include:
- HDFS 2.6 and related tools are now available in the Upcoming repository
- Singularity 2.4.2: Feature upgrade from Singularity 2.3.2
- Pegasus 4.8.1: Feature upgrade from Pegasus 4.7.4
- Updated gratia-probe to account for GPUs
- perfSONAR-tools package including updated BWCTL, OWAMP, and nuttcp
- HTCondor 8.6.9: Bug fix release
- frontier-squid 3.5.27-2.1: Bug fix release
- Minor bug fix for osg-user-cert-renew
- HTCondor 8.7.6 in the Upcoming repository

Release notes and pointers to more documentation can be found at:

http://opensciencegrid.github.io/docs/release/3.4/release-3-4-7/

Need help? Let us know:

http://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release!

Tuesday, January 30, 2018

Operations Service Update Tuesday, February 7 at 13:00 UTC

The GOC will upgrade the following services beginning Wednesday, Feb 7 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.

Repo
   * Remove references to OSG 3.1 and modify configurations to not recreate them.


GRACC
   * Front end will be rebooted, only minimal downtime is anticipated.


MyOSG, OIM and Ticket
   * Implement Single Sign On allowing users to validate with local credentials, deferred from previous release.

Wednesday, January 24, 2018

Announcing OSG CA Certificate Update

We are pleased to announce a data release for the OSG Software Stack.
Data releases do not contain any software changes.

This release contains updated CA Certificates based on IGTF 1.89:
- Discontinued expiring UGRID (2008) root CA (UA)

SHA256 checksums are provided in addition to the MD5 checksums

Release notes and pointers to more documentation can be found at:

http://opensciencegrid.github.io/docs/release/3.4/release-3-4-6-2/
http://opensciencegrid.github.io/docs/release/3.3/release-3-3-31-2/

Need help? Let us know:

http://opensciencegrid.github.io/docs/common/help/

We welcome feedback on this release!

Wednesday, January 17, 2018

Operations Service Update Wednesday, January 24 at 13:00 UTC

The GOC will upgrade the following services beginning Wednesday, January 24 at 13:00 UTC. The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.

Redirector
  * The two redirector.osgstorage.org instances, redirector1.grid.iu.edu and redirector2.grid.iu.edu, are running xrootd v4.3.0, while the latest OSG version of xrootd is 4.8.0. This package will be upgraded on both instances.

Indiana University Submit node
  * Install filebeats for transfer logs

MyOSG, OIM and Ticket
  * Implement Single Sign On allowing users to validate with local credentials

OASIS
  * Update configuration repository so that those cvmfs clients that set CVMFS_HTTP_PROXY=DIRECT will access stratum 1s through the openhtc.io Content Delivery Network.

Repo
  * Implement new repository update script

All Services
  * Operating system updates will be installed; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.