Tuesday, May 18, 2010
OSG DocDB Outage Resolved
Access via certificate to the OSG DocDB has been restored. We are
working on diagnosing the problem and apologize for the inconvenience as
the service was unavailable.
OSG DocDB Administrators
GOC Service Update - Tuesday, May 25th at 14:00 UTC
The GOC will upgrade the following services beginning at Tuesday, May 25 2010 at 14:00 UTC.
Special Note about short expected intermittent outages
A short intermittent outage of (~10 minutes) is expected for all the services listed below while the GOC adjusts the virtual machine settings one VM host at a time; For example, myosg2 might be down for 10 minutes while myosg1 is still available for anyone trying to access myosg.grid.iu.edu. Additionally, the GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered.
Update 2010-05-24: The GOC will also restart the NSCD daemon with an updated configuration on the BDII servers is1 and is2 during this maintenance. This is expected to be completely transparent to the outside world, and users of the BDII should not experience any problems.
OIM 2.19 (https://oim.grid.iu.edu)
ITB version is now available for testing at https://oim-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added direct link to register a new vo, sc, or resource on the home page.
* Converted descriptive text to tooltips on homepage.
* Added tooltips on VO page (Expect more of this in the future!)
Patched since last release:
* Fixed an issue which caused a null pointer exception when an empty Log ID was parsed by a specific Log function.
* Fixed authorization bug in Contact and ProfileEdit Servlets.
MyOSG 1.19 (https://myosg.grid.iu.edu)
ITB version is now available for testing at https://myosg-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added Resource ID to ResourceGroup / Current RSV Status XML (URL that starts with /rgcurrentstatus); NOTE: Registered XML users have been notified.
GOC-TX Ticket Exchange/Sync System 1.6 (tx.grid.iu.edu)
The ITB TX server has been functioning properly.
Release Notes:
* Switched the order of metadata / comment update on RT accessor so that when RT sends an update, the metadata shown on it has the latest information.
* Added logic for BNL so that it will use comment action instead of correspondence if ticket status is going to be resolved in order to avoid re-opening of the ticket due to ticket update (a necessary change due to metadata / comment reorder)
* Update GOC-TX so that if GGUS's ticket status is currently "verified" and if the new status is "solved", then GOC-TX will not do the update. We do something similar thing for RT already - we need to have this logic because the concept of "verified" status currently exist only in GGUS.
* Added code to append custom field information for RT during ticket update.
* Added CF.{VO Name} for GOC > RT conversion.
* Updating Associate RG name to "Resource Group Name" for GOC>BNL converter
GOC Ticket 1.19 (https://ticket.grid.iu.edu)
ITB version is now available for testing at https://ticket-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Made Ticket Viewer to show priority tags when ticket has higher priority
* [For GOC Staff only] On Myticket page, changed the table header to reflect that fact that it includes CC-ed ticket
Special Note about short expected intermittent outages
A short intermittent outage of (~10 minutes) is expected for all the services listed below while the GOC adjusts the virtual machine settings one VM host at a time; For example, myosg2 might be down for 10 minutes while myosg1 is still available for anyone trying to access myosg.grid.iu.edu. Additionally, the GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered.
OIM 2.19 (https://oim.grid.iu.edu)
ITB version is now available for testing at https://oim-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added direct link to register a new vo, sc, or resource on the home page.
* Converted descriptive text to tooltips on homepage.
* Added tooltips on VO page (Expect more of this in the future!)
Patched since last release:
* Fixed an issue which caused a null pointer exception when an empty Log ID was parsed by a specific Log function.
* Fixed authorization bug in Contact and ProfileEdit Servlets.
MyOSG 1.19 (https://myosg.grid.iu.edu)
ITB version is now available for testing at https://myosg-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added Resource ID to ResourceGroup / Current RSV Status XML (URL that starts with /rgcurrentstatus); NOTE: Registered XML users have been notified.
GOC-TX Ticket Exchange/Sync System 1.6 (tx.grid.iu.edu)
The ITB TX server has been functioning properly.
Release Notes:
* Switched the order of metadata / comment update on RT accessor so that when RT sends an update, the metadata shown on it has the latest information.
* Added logic for BNL so that it will use comment action instead of correspondence if ticket status is going to be resolved in order to avoid re-opening of the ticket due to ticket update (a necessary change due to metadata / comment reorder)
* Update GOC-TX so that if GGUS's ticket status is currently "verified" and if the new status is "solved", then GOC-TX will not do the update. We do something similar thing for RT already - we need to have this logic because the concept of "verified" status currently exist only in GGUS.
* Added code to append custom field information for RT during ticket update.
* Added CF.{VO Name} for GOC > RT conversion.
* Updating Associate RG name to "Resource Group Name" for GOC>BNL converter
GOC Ticket 1.19 (https://ticket.grid.iu.edu)
ITB version is now available for testing at https://ticket-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Made Ticket Viewer to show priority tags when ticket has higher priority
* [For GOC Staff only] On Myticket page, changed the table header to reflect that fact that it includes CC-ed ticket
Friday, May 14, 2010
OSG TWiki - Brief Outage
The OSG TWiki experienced a second brief outage while administrators were
investigating reported service slowness. The TWiki was restarted as
soon as alarms were received and the recorded downtime was approximately
30 minutes.
investigating reported service slowness. The TWiki was restarted as
soon as alarms were received and the recorded downtime was approximately
30 minutes.
OSG TWiki - Brief Outage
The OSG TWiki experienced a brief outage while administrators were
investigating reported service slowness. The TWiki was restarted as
soon as alarms were received and the recorded downtime was less than
10 minutes.
investigating reported service slowness. The TWiki was restarted as
soon as alarms were received and the recorded downtime was less than
10 minutes.
Friday, May 7, 2010
Scheduled Maintenance is2.grid.iu.edu - GOC Ticket # 8530
The GOC has scheduled removal of is2.grid.iu.edu from round-robin for is.grid.iu.edu on Monday, May 10, 2010 11:00 EST (15:00 UTC), to enable work on resolving potential operating system and/or hardware issues. We do not have an ETA for when is2 will be added back into the BDII round-robin, we expect it to be out of commission for at least 2 weeks. We will announce via a follow up notification when we have a clear idea. During the time is2 is offline, the is1 server is expected to handle all the BDII traffic without any issues - the GOC will monitor the situation.
Please see ticket 8530 at:
https://ticket.grid.iu.edu/goc/viewer?id=8530
Please see ticket 8530 at:
https://ticket.grid.iu.edu/goc/viewer?id=8530
Tuesday, May 4, 2010
Some OSG CEs Facing Intermittent CEMon Reporting Problems - GOC Ticket # 8530
OSG Operations was made aware of an issue of some CEMon clients on production CEs not reporting to the OSG CEMon collector; consequently, those CEs did not show up on the BDII.
GOC staff and USCMS admins have started troubleshooting this issue, and have found a temporary work around by removing one of the two CEMon collectors (on is2) from activity. The raw LDIF data is still being rsynced between the two servers. At this point all information is available in the OSG BDII and being sent properly to the WLCG. Investigations of the cause and work toward a fix will continue when business hours resume tomorrow.
Please see ticket 8530 at:
https://ticket.grid.iu.edu/goc/viewer?id=8530
GOC staff and USCMS admins have started troubleshooting this issue, and have found a temporary work around by removing one of the two CEMon collectors (on is2) from activity. The raw LDIF data is still being rsynced between the two servers. At this point all information is available in the OSG BDII and being sent properly to the WLCG. Investigations of the cause and work toward a fix will continue when business hours resume tomorrow.
Please see ticket 8530 at:
https://ticket.grid.iu.edu/goc/viewer?id=8530
GOC Service Update - Tuesday, May 11th at 14:00 UTC
The GOC will upgrade the following services beginning at Tuesday, May 11 2010 at 14:00 UTC. No outages are expected for any of the services listed but the GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered.
OIM 2.18 (https://oim.grid.iu.edu)
ITB version is now available for testing at https://oim-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added (back) Remove button to resource downtime editor.
* Modified authentication check to show an elegant error message if user is not authorized (for any reason) to view the following pages: Admin, AuthorizationMatrix, Contact, Log, ProfileEdit
* Added Tooltips to replace help text on certain pages
Patched since last release:
* Further bug fix related to JIRA ticket OIM-28 - personal info checkbox and showing/hiding of section was messed up - fixed.
MyOSG 1.18 (https://myosg.grid.iu.edu)
ITB version is now available for testing at https://myosg-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Updated how db connections are handled to allow failover to secondary server
* Added link to submit goc ticket from rg summary page
* Added WLCG status information to GIP validation status page. (Note: No XSD yet) [MYOSG-48]
* Added tooltips on certain pages
* Added "sort by" section for VO [Jira ticket MYOSG-32]
* Cleaned up verbiage on Query editor
* Updated formatting of service name display (to use smaller font)
* [Experimental Feature]: Added BDII Information page under Resource Group - shows selected information from BDII like version numbers, and some other statistics. Note that this feature is still in experimental mode, and may be modified further in future releases.
GOC-TX Ticket Exchange/Sync System 1.5 (tx.grid.iu.edu)
The ITB TX server has been functioning properly.
Release Notes:
* Added capability to access GOC's metadata server
* Replaced GGUS internal field that was added to ticket update with metadata.
* Added new FP>RT custom field conversion using newly available metadata
* Now set ggus origin ticket id to GOC metadata.
* Patched code to handle case where GGUS' diary may be null (for unknown reasons) more elegantly
* [Relevant to Developers]: Modified custom conversion logic; Renamed FP2BNLTicketConverter to GOC2BNLTicketConverter (more appropriate); Added "generate JIRA soap script" script
Issues patched on production
* Removed erroneous conversion code for ticket type field from GGUS to FP
GOC Ticket 1.18 (https://ticket.grid.iu.edu)
ITB version is now available for testing at https://ticket-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Updated how db connections are handled to allow failover to secondary server
* Made the resource form to be able to preselect resource names (per MyOSG ticket submitter change)
* Updated various menu/sub-menu links - based on recent changes to the location of various forms
* [GOC Staff and Ticket Editors]Updated ticket URL for ticket cluster view
* [GOC Staff and Ticket Editors]: Added new "My Tickets" page
* Added more error logs in case TX assignee can not be found
Issues patched on production
* Fixed undefined contact search box issue
OIM 2.18 (https://oim.grid.iu.edu)
ITB version is now available for testing at https://oim-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Added (back) Remove button to resource downtime editor.
* Modified authentication check to show an elegant error message if user is not authorized (for any reason) to view the following pages: Admin, AuthorizationMatrix, Contact, Log, ProfileEdit
* Added Tooltips to replace help text on certain pages
Patched since last release:
* Further bug fix related to JIRA ticket OIM-28 - personal info checkbox and showing/hiding of section was messed up - fixed.
MyOSG 1.18 (https://myosg.grid.iu.edu)
ITB version is now available for testing at https://myosg-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Updated how db connections are handled to allow failover to secondary server
* Added link to submit goc ticket from rg summary page
* Added WLCG status information to GIP validation status page. (Note: No XSD yet) [MYOSG-48]
* Added tooltips on certain pages
* Added "sort by" section for VO [Jira ticket MYOSG-32]
* Cleaned up verbiage on Query editor
* Updated formatting of service name display (to use smaller font)
* [Experimental Feature]: Added BDII Information page under Resource Group - shows selected information from BDII like version numbers, and some other statistics. Note that this feature is still in experimental mode, and may be modified further in future releases.
GOC-TX Ticket Exchange/Sync System 1.5 (tx.grid.iu.edu)
The ITB TX server has been functioning properly.
Release Notes:
* Added capability to access GOC's metadata server
* Replaced GGUS internal field that was added to ticket update with metadata.
* Added new FP>RT custom field conversion using newly available metadata
* Now set ggus origin ticket id to GOC metadata.
* Patched code to handle case where GGUS' diary may be null (for unknown reasons) more elegantly
* [Relevant to Developers]: Modified custom conversion logic; Renamed FP2BNLTicketConverter to GOC2BNLTicketConverter (more appropriate); Added "generate JIRA soap script" script
Issues patched on production
* Removed erroneous conversion code for ticket type field from GGUS to FP
GOC Ticket 1.18 (https://ticket.grid.iu.edu)
ITB version is now available for testing at https://ticket-itb.grid.iu.edu; we encourage users to test this service before the production release.
Release Notes:
* Updated how db connections are handled to allow failover to secondary server
* Made the resource form to be able to preselect resource names (per MyOSG ticket submitter change)
* Updated various menu/sub-menu links - based on recent changes to the location of various forms
* [GOC Staff and Ticket Editors]Updated ticket URL for ticket cluster view
* [GOC Staff and Ticket Editors]: Added new "My Tickets" page
* Added more error logs in case TX assignee can not be found
Issues patched on production
* Fixed undefined contact search box issue
Subscribe to:
Posts (Atom)
Posts
Copyright 2009 Indiana University - Developed for Open Science Grid