Category Archives: Maintenance and downtime

Monthly Maintenance on May 19, 2011

To all HSPH users,

Next Thursday night, May 19th, we will be performing our normal system maintenance to all servers and network equipment.

Please Note – This Maintenance window was rescheduled from 5/15/2011 due to conflicts with the academic calendar.

The maintenance window will last from 7:00 PM til 1:00 AM.

The following services will have one or two small outages:
(You can continue to work, but may have brief pauses while services restart)

  • GroupWise Full Client and IMAP Clients
  • Novell File and Print services
  • NetStorage
  • ICF File and Print services
  • OASIS
  • Powerfaids and NetPartner
  • Web Server (main www.hsph.harvard.edu site)
  • GroupWise WebAccess
  • Accellion
  • HSPH Unix server

The following services will be unavailable from 7PM to 10:30PM:

  • ALICE
  • MyHSPH Portal

The following services will be unaffected during the maintenance window:

  • HPCC system

Future maintenance windows are scheduled for Thursday nights from 7PM to 1AM on the following dates:

  • 6/16/2011
  • 7/14/2011
  • 8/11/2011
  • 9/15/2011
  • 10/13/2011
  • 11/10/2011
  • 12/15/2011

 

Server Maintenance on Thursday, March 15, 2012

On Thursday, March 15, 2012, we will be performing our normal system maintenance to all servers and network equipment.

The maintenance window will last from 7:00 PM til 1:00 AM.

The following services will have one or two small outages:
(You can continue to work, but may have brief pauses while services restart)

The following services will be unavailable from 7PM to 10:30PM:

The following services will be unaffected during the maintenance window:

  • HPCC system

Future maintenance windows are scheduled for Thursday nights from 7PM to 1AM on the following dates:

UPDATE: PIN System Outage

We recieved the following notification from the University Information Systems’ Directory Services department about the PIN System.

Our monitors picked up an outage on the PIN system at 10:42 AM this
morning.  At this point we believe that just one of our PIN servers is
unavailable and that users connecting to the other servers or making new
connections to the PIN system should be successfully authenticating.
However, connections to the failed server will remain cached on machines
for 5 minutes from their previous attempt to login.  The PIN team is
actively working the issue with NSS to resolve the problem and hope to
bring the failed server back online ASAP.

I apologize for the inconvenience this is causing your customers.  More
details on the outage will be made available as soon as we have them.

Stay tuned for further updates.
Update on February 23, 2011:

Dear Customers,
The PIN system has been fully functional since 12:08 PM.  We continue to investigate the root cause and ensuing impact of the partial outage and slowness of the service.  At no time was the PIN service fully down, but the reduced capacity, very high traffic, and the resulting slow response were, understandably, construed as an outage by many.
Here’s what we know:At 10:42 our monitors alerted us to a problem on one of our production PIN servers At 10:44 we had taken that PIN server off the content switch so traffic was going to other PIN servers At 10:56 the misbehaving server was restarted, looked healthy, and was placed back on the content switch. At 11:33 we saw the same PIN server having problems and pulled it off the content switch again. At 12:08 having bounced the box, and the software components on it we put the server back online and the service has been stable since.
Customers would have experienced issues with PIN around 10:42 AM and experienced “problems” with the PIN service until 12:12 PM (1:20 hrs).  Here are some of the things that complicated connectivity for end-users:We were seeing loads on the PIN service that we haven’t seen in years.  We are investigating this, but suspect that helpdesks contributed to this load as they “tested” connectivity. The load overwhelmed the crippled service when the errant machine was pulled off the switch making it REALLY slow (with a number of timeouts) which some users reported as an outage (which it was to them).
Once again, I apologize for the inconvenience this caused you and your customers.  We continue to investigate the root cause of this problem and any information that you can add to this would be helpful.   As always, please contact me should you have any questions.

Server Maintenance on Thursday, February 16, 2012

On Thursday, February 16, 2012, we will be performing our normal system maintenance to all servers and network equipment.

The maintenance window will last from 7:00 PM til 1:00 AM.

The following services will have one or two small outages:
(You can continue to work, but may have brief pauses while services restart)

The following services will be unavailable from 7PM to 10:30PM:

The following services will be unaffected during the maintenance window:

  • HPCC system

Future maintenance windows are scheduled for Thursday nights from 7PM to 1AM on the following dates:

  • 03/15/2012

Computer System Maintenance on Thursday, September 16, 2010

On Thursday evening, September 16th, we will be performing our normal system maintenance to all servers and network equipment.

The maintenance window will last from 7:00 PM til 1:00 AM.

The following services will have one or two small outages:
(You can continue to work, but may have brief pauses while services restart)

The following services will be unavailable for the duration of the maintenance window:

The IT Department recommends that you reboot your PC after any system maintenance.

This will ensure that the proper software updates are applied to your computer.

Be Green!  We also request that you shutdown your PC before you leave everyday.

All future planned maintenance windows are Thursday nights from 7PM to 1AM and on the following dates:

  • 10/14/2010
  • 11/11/2010
  • 12/16/2010

Computer System Maintenance on August 15, 2010

On Sunday night, August 15th, we will perform our normal system maintenance to all servers and network equipment.  We are moving the time from the previously scheduled time of Thursday, August 12 to avoid a conflict with the end of the summer 2 session.

The maintenance window will last from 5:00 PM til 12:00 AM.

All future planned maintenance times are Thursday nights from 7PM to 1AM on the following dates:

  • 9/16/2010
  • 10/14/2010
  • 11/11/2010
  • 12/16/2010

Student Computing Laboratories

On Saturday afternoon, July 10, an intense rain storm caused some water damage at HSPH, primarily on the ground floor and lower level of the Kresge building.  The water caused minor damage to the main student computing laboratory in Kresge LL19.

As of 8 am on Monday morning, all student computing laboratories are currently open for business. 
The Kresge LL19 lab has 25 computers currently available. We will bring the rest back online today. There will be work crews in LL19 throughout the day. 

For quieter computing, we suggest that students use:

  • Kresge 209
  • Kresge 210 or
  • Kresge LL10

Thank you for your patience as we get the labs operating back at full capacity.
———————-
A copy of the email sent to community from Operations on Sunday:
Sunday, July 11, 2010

To: HSPH
From: Operations

On Saturday afternoon, July 10, an intense rain storm caused some water damage at HSPH, primarily on the ground floor and lower level of the Kresge building. The School remains open.

Eleven workstations in the Student Computing Facility (LL19) have been taken offline for repair. The remaining 31 are available, as well as the workstations in the other computing facilities on the Lower Level and in Kresge 209. There also has been damage to rugs and walls in the Kresge G1 and G2 classrooms, offices on the ground level, and in the adjacent corridors. Occupants may occupy the spaces, including classrooms, this Monday (excluding affected student workstations).

Crews are working to remove moisture and to make repairs. On Monday, Environmental Health and Engineering will conduct a moisture survey, with a focus on preventing and removing potential mold.

We thank you for your patience.

Computer Maintenance on June 10, 2010

On Thursday night, June 10th, we will be performing our normal system maintenance to all servers and network equipment. The maintenance window will last from 7:00 PM til 1:00 AM.

The following services will have one or two small outages: (You can continue to work, but may have brief pauses while services restart)

  • GroupWise Full Client and IMAP Clients
  • Novell File and Print services
  • NetStorage
  • ICF File and Print services
  • OASIS
  • ALICE
  • Powerfaids and NetPartner
  • Web Server (main www.hsph.harvard.edu site)
  • GroupWise
    WebAccess System
  • Accellion File transfer
    Appliance

The following services will not be affected:

  • HPCC system
  • HSPH Unix server
  • Network connectivity for all of SPH. This includes non-HSPH Web sites
  • Network connectivity for SPH 1
  • Network connectivity for SPH 2
  • Network connectivity for FXB
  • Network connectivity for Landmark Center
  • Network connectivity for Offsite Locations
  • HSPH Wireless Network System

All future planned maintenance times are Thursday nights from 7PM to 1AM on the following dates:

  • 7/15/2010
  • 8/12/2010
  • 9/16/2010
  • 10/14/2010
  • 11/11/2010
  • 12/16/2010

Computer Downtime on May 16, 2010

On Sunday night, May 16, 2010, the network and server teams will perform our normal monthly system maintenance to all servers and network equipment.

The downtime window will last from 5:00PM – 1:00AM.

This downtime was moved from the normal Thursday evening to prevent a conflict with the academic calendar.

The following services will have one or two small outages:
(You can continue to work, but may have brief pauses while services restart)

  • GroupWise Full Client and IMAP Clients
  • Novell File and Print services
  • NetStorage
  • ICF File and Print services
  • OASIS
  • ALICE
  • Powerfaids and NetPartner
  • Web Server (main www.hsph.harvard.edu site)
  • GroupWise WebAccess
  • Accellion 

The following services will not be affected:

  • HPCC system
  • HSPH Unix server
  • Network connectivity for all of SPH. This includes non?HSPH Web sites
  • Network connectivity for SPH 1
  • Network connectivity for SPH 2
  • Network connectivity for FXB
  • Network connectivity for Landmark Center
  • Network connectivity for Offsite Locations
  • HSPH Wireless Network System

All future planned down times are Thursday Nights from 7PM to 1AM on the following dates:

  • 6/10/2010
  • 7/15/2010
  • 8/12/2010
  • 9/16/2010
  • 10/14/2010
  • 11/11/2010
  • 12/16/2010