Past Change Management Plans

This is the Change Management Plan for the week of 24-30 Sept 2010.

 

System: Cat Tracks
Purpose of Change: Upgrade to 4.0.7
Risk: Not being on the most current version and losing functionality
Roll Back Plan: rolling back to the previous version from cold backup taken prior to the upgrade
DateTime: Saturday, 9/25/2010 starting at 1:00 am for cold backup actual upgrade will begin at 7:00 am.  Cat Tracks is not a 24/7 system, can be down outside of the maintenance window.
Outage Length: 5 hours for cold backup and 4 hours for actual upgrade, Cat Tracks should be available by 11:00 am on Saturday 9/25/2010.
Performed by: Van Nguyen

 

System: Banner
Purpose of Change: Migrate Flex-Reg to production
Risk: unable to clone test systems from PROD without wiping out current installation and also not being able to meet the Flex-Reg go live date.
Roll Back Plan: Roll back to backup taken prior to begining install.
Date and Time: Sunday 09/26/2010 6:00 am
Outage Length: 4 hours
Performed by: Van Nguyen

 

System: Cisco ACE Load balancer
Purpose of Change: Replace defective unit with replacement unit.

All TE data center network traffic will be down during replacement. This includes servers in the Academic co-location data center except Library servers.
Risk: Device could reboot automatically to clear memory errors.
Roll Back Plan: Put old device back in service.
DateTime: Sunday, Sept  26th, 2010 2 am

Outage Length: 1hr

_______________________________________________________________________________________________

These are additions to the change management plan for the week of 24 to 30 Sept 2010

 

System: PT Wired and Wireless networks
Purpose of Change: Replace out of support switches with switches that are still supported. Upgrade building router to the latest code version. 
Risk: Unsupported switches remain on the network posing a security risk.
Roll Back Plan: Reinstall old switches and code.
Date and Time: Wednesday September 29, 2010 5:00pm
Outage Length: 1 Hour
Performed by: Luke Jenkins and other NCIS members

 

System: selfservice.weber.edu
Purpose of Change: Move DNS to new Load Balancer
Risk: Can't move forward with WebTailor 8.3 upgrade.
Roll Back Plan: Change DNS back.
Date and Time: Sun Sept 25th 2am
Outage Length: none
Performed by: Jonathan Karras

This is the Change Management Plan for the week of 1 - 7 Oct 2010

 

System:GroupWise Rho Post Office (tentative)
Purpose of Change:Data of Rho Post office migrating to AMS 2500
Risk:Data stays on xRaid
Roll Back Plan:Start the PO back on Netware
Date and Time:Saturday Oct 2nd 10:00PM - 5:00 AM
Outage Length: 6 hrs
Performed by:Gursharan Bakshi

 

 

System:Banner Self Service
Purpose of Change:Move Web Tailor 8.3 New Look and Feel to production.
Risk: Old Look and Feel.
Roll Back Plan:rollback to Old Look and Feel.Date and Time:Sunday Oct 3, at 7 a.m.
Outage Length:3 hours from 7:00 a.m to 10:00 a.m.

Performed by:Van Nguyen

_______________________________________________________________________________________________

 

This is an Emergency Change Management Plan for 11 Oct 2010

 

System: Netdrive1 & 2, Network shared files on the Forest
Purpose of Change: To rebuild failed volumes and upgrade OS and OES versions to prevent more failures
Risk: The shared drives are currently not available and will not be available until the work is complete.
Roll Back Plan: none
Date and Time: 11 Oct 2010 16:36
Outage Length: Unknown
Performed by: Edd Ramer

_______________________________________________________________________________________________

This is an Emergency Change Management Plan for 12 Oct 2010

 

System: Netdrive1 & 2, Network shared files on the Forest
Purpose of Change: Finish upgrade to OS and OES on Netdrive1
Risk: Corruption of data
Roll Back Plan: None
Date and Time: 12 Oct 2010, 9:00 PM
Outage Length: 3-5 Hours

Performed by: Edd Ramer

_______________________________________________________________________________________________

This is the Change Management Plan for the week of 15-21 Oct 2010:

 

System: Davis Data Center
Purpose of Change: Complete the rack power and networking and cable management for the Data Center at the Davis Campus

Risk: Accidental unplugging of servers while doing cable management, short network outage while cables are being moved.
Roll Back Plan: Plug the server or network cable back in.
Date and Time: Oct 15 2010 9:00am to 5:00 pm This is the day of Fall Break so student impact should be minimal.

Outage Length: 8 hours
Performed by: Heidi Munk

 

 

System: (Tentative) GroupWise Kappa PO & Omega PO
Purpose of Change: Move the Data from these 2 post offices to AMS 2500 and change OS of the server to SLES 10 SP 3
Risk: Data residing on old xraid
Roll Back Plan: Start back on old Netware server.
Date and Time: Saturday 9:00 PM - Sunday 7:00 AM
Outage Length: 8 hrs Intermittent
Performed by: Gursharan Bakshi

 

 

System: MS SQL 2005 Dev, MS SQL 2005 Prod,  Appshare and WSUImages (Site Manager)
Purpose of Change: Move files to new storage

Risk: Running on old hard drives has higher risk of failure
Roll Back Plan: Revert to old storage
DateTime: Oct 17th 2:00AM-10:00AM
Outage Length: 8 hours

Services Impacted: part of the outage ChiTester, Blackberry, Citrix, Helpdesk, Zenwoks, Master Cal., All in house web development, Continuing Education, CMS, CLM, EMS , EMAS, and many more servers.
Performed by: Mark Buxton and David Fernelius

 

 

System: Xtender
Purpose of Change: Move files to new storage

Risk: Running on old hard drives has higher risk of failure
Roll Back Plan: revert to old storage
DateTime: Oct 17th 2:00AM-10:00AM
Outage Length: 8 hours

Services Impacted: part of the outage ChiTester, Blackberry, Citrix, Helpdesk, Zenwoks, Master Cal., All in house web development, Continuing Education, CMS, CLM, EMS , EMAS, and many more servers.
Performed by: Mark Buxton and David Fernelius

_______________________________________________________________________________________________

This is the change management plan for the week of 22-28 Oct 2010.

 

System:(Tentative) GroupWise Beta PO & Sigma PO
Purpose of Change:Move the Data from these 2 post offices to AMS 2500 and change OS of the server to SLES 10 SP 3
Risk:Data residing on old xraid
Roll Back Plan:Start back on old Netware server.
Date and Time:Saturday  23 Oct 9:00 PM - Sunday 24 Oct 7:00 AM
Outage Length:8 hrs Intermittent
Performed by:Gursharan Bakshi

_______________________________________________________________________________________________

This is the Change Management Plan for the week of  29 Oct  to 4 Nov 2010.

 

System: GroupWise Beta Post Office / Grpwise1vs
Purpose of Change: Move the Data of Beta Post Office and Grp1 Domain to AMS2500. Move the OS to Linux.
Risk: Data staying on xRaid
Roll Back Plan: Run it on NetWare
Date and Time: Saturday 10/30/10 - 9:00 PM - 6:00 AM
Outage Length: 5 hrs Intermittent
Performed by: Gursharan Bakshi

_______________________________________________________________________________________________

This is the Change Management Plan for the week of 5-11 Nov 2010:

 

System: Banner Financial Aid
Purpose of Change: Upgrade from 8.8 to 8.8.1
Risk: Not able to upgrade to 8.9 until 8.8.1 has been applied
Roll Back Plan: roll back to 8.8
Date/Time: November 7th 7:00 am
Outage Length: one hour
Performed by: Mark Green

 

 

System: Degree Works
Purpose of Change: Upgrade Oracle from 10g to 11g
Risk: being on older version of Oracle
Roll Back Plan: Restore from backup taken before starting the upgrade
Date/Time: November 7th 7:00 am
Outage Length: 3 hours
Performed by: Van Nguyen

 

 

System: GroupWise Campus Domain
Purpose of Change: Change Campus Primary GroupWise Domain to AMS 2500 as well as change operating system to SLES.
Risk: Data staying on X-Raid/Netware server
Roll Back Plan: Start it back on Netware Server.
Date/Time: Saturday 11/06/10 - 9:00 PM
Outage Length: 4 hours - (user impact -none) (mail will be delayed going out)

Performed by: Gursharan Bakshi

_______________________________________________________________________________________________

This is the Change Management Plan for the week of 12 to 18 Nov 2010

 

This notification is a Tentative notification. It is subject to a go no go and might not happen.

This is the revised Change Management Plan for the week of 12 to 18 Nov 2010.

 

This notification is a Tentative notification. It is subject to a go no go and might not happen.

This is the Change Management Plan for the week of 19 -25  Nov 2010.

 

 

System: Eweber Portal

Change: We are moving Eweber from the old load-balancer (CSS) to the new load-balancer (ACE).

Risk of not performing maintenance: The old load-balancer is going to be decommissioned in the near future. Additionally, the new load-balancer provides more features.

Roll Back Plan: Change DNS entry for eweber.weber.edu to direct users to the old service location.

Date and Time: 6:00 AM on Sunday, November 21, 2010

Expected Length of Outage: 30 minutes while DNS is synchronized

Work performed by: Tristan Rhodes

 

 

System: Workflow Production

Change: Database 11g (11.1.0.7) upgrade

Risk of not performing maintenance: None

Roll Back Plan: Restore from Database 10g version.

Date and Time: 21 Nov 2010 midnight

Expected length of Outage: 10 hours

Work performed by: Van Nguyen

 

 

 

In conjunction with the installation of electrical meters that Facilities Management, IT Infrastructure will be switching the Data Centers in Technology Education to generator power. The Data Center will run on generator power from midnight to 2 am. We do not anticipate any disruption of University Services during this time. If you have questions, please feel free to call me.

 ______________________________________________________________________________________________

This is the Change Management Plan for the week of 3 - 9 Dec 2010

 

 

Purpose of Change: Upgrade UC4 production database to Oracle 11g
Services Affected: UC4
Risk: Reaching end of support on 10g databases
Roll Back Plan: roll back to backup of 10g database
Date and Time: Saturday December 4th 7:00 AM - 10:00 AM
Outage Length: 3 hours
Performed by: Van Nguyen

 

 

System: AiM (FM)
Purpose of Change: Upgrade AiM production database to Oracle 11g
Services Affected: AiM
Risk: Reaching end of support on 10g databases
Roll Back Plan: roll back to backup of 10g database
Date and Time: Sunday December 5th 12:00 AM - 10:00 AM
Outage Length: 10 hours
Performed by:Van Nguyen

 

 

 

 

System: Eweber portal (eweber.weber.edu)
Purpose of Change: Change DNS to send users directly to Macyn (137.190.9.91), rather than going through the load-balancer (137.190.8.17).
Services Affected: Eweber portal (eweber.weber.edu)
Risk: Some users are getting an error ("cp/home/next")that prevents them from using Eweber.
Roll Back Plan: Change DNS back to the load-balancer VIP (137.190.8.17)
Date and Time: 5:00 PM, Friday, December 3rd
Outage Length: No outage expected, users will migrate to new location within an hour.
Performed by: Tristan Rhodes

 

 

 

 

 

 

This is the Change Management Plan for the week of 3 - 9 Dec 2010

 

 

System: Eweber portal (eweber.weber.edu)
Purpose of Change: Change DNS to send users back through the load-balancer.  Also change sticky method to "cookie insertion". (Previous method was "source-IP")
Services Affected: Eweber portal (eweber.weber.edu)
Risk: Some users are getting an error ("cp/home/next")that prevents them from using Eweber.
Roll Back Plan: Change DNS back to Macyn.
Date and Time: 4:00 AM, Sunday, December 5th
Outage Length: No outage expected, users will migrate to new location within an hour.
Performed by: Tristan Rhodes

 

 

Purpose of Change: Upgrade UC4 production database to Oracle 11g
Services Affected: UC4
Risk: Reaching end of support on 10g databases
Roll Back Plan: roll back to backup of 10g database
Date and Time: Saturday December 4th 7:00 AM - 10:00 AM
Outage Length: 3 hours
Performed by: Van Nguyen

 

 

System: AiM (FM)
Purpose of Change: Upgrade AiM production database to Oracle 11g
Services Affected: AiM
Risk: Reaching end of support on 10g databases
Roll Back Plan: roll back to backup of 10g database
Date and Time: Sunday December 5th 12:00 AM - 10:00 AM
Outage Length: 10 hours
Performed by:Van Nguyen

_______________________________________________________________________________________________

This is an emergency Change Management Plan:

 

System: Eweber portal (eweber.weber.edu)
Purpose of Change: Change DNS to send users back through the load-balancer.  Also change sticky method to "cookie inspection". (Previous method was "source-IP")
Services Affected: Eweber portal (eweber.weber.edu)
Risk: Some users are getting an error ("cp/home/next")that prevents them from using Eweber.
Roll Back Plan: Change DNS back to Macyn.
Date and Time: 2:00 AM, Tuesday, December 7th
Outage Length: No outage expected, users will migrate to new location within an hour.
Performed by: Tristan Rhodes

 

 

 

In conjunction with the installation of electrical meters that Facilities Management, IT Infrastructure will be switching the Data Centers in Technology Education to generator power. The Data Center will run on generator power from midnight to 2 am. We do not anticipate any disruption of University Services during this time. 

_______________________________________________________________________________________________

The following notice was sent out by Cory Cunningham:

 

Due to complications with Sungard software and Oracle 11g, UC4 Production was backed down to 10g yesterday, as well as Banner BTST. We will be backing UC4 Test back to 10g as well. Please confirm that all work in UC4 Test has been copied/saved. 

 

The upgrade will be attempted again in the future.

_______________________________________________________________________________________________

This is the Change Management Plan for the week of 10- 16 Dec 2010

 

System: Infoblox DNS
Purpose of Change: Apply software patches to Infoblox DNS systems. These patches fix a possible Denial of service bug in the current Bind version.
Services Affected: DNS
Risk: Security Vulnerabilities remain
Roll Back Plan: Built in roll back feature
Date and Time: Dec 12th 6am
Outage Length: None, Redundant system
Performed by: Jonathan Karras

 

 

System: eWeber portal
Purpose of Change: New code to resolve on-going errors for users with the eWeber login
Services Affected: eWeber portal (eweber.weber.edu)
Risk: Some users are getting an error ("cp/home/next")that prevents them from using eWeber.

Roll Back Plan: Change back to old code
Date and Time: Sunday, December 12, 2010 at 12:00 AM
Outage Length: No outage expected
Performed by: Stan Holmes

 

 

System: ID Card Office, Project Tracker
Purpose of Change: Upgrade LYNX database to 11gR2
Services Affected: ID Card Office, Project Tracker
Risk: Running on old software
Roll Back Plan: Restore database to 10g
Date and Time: 12/12/2010 12:00pm
Outage Length: 6-8 hours
Performed by: David Fernelius

 

In conjunction with the installation of electrical meters that Facilities Management, IT Infrastructure will be switching the Data Centers in Technology Education to generator power. The Data Center will run on generator power from midnight to 2 am. We do not anticipate any disruption of University Services during this time. 

_______________________________________________________________________________________________

This is an Emergency Change Management Message

 

System: Pinnacle Telecommunications Database
Purpose of Change: In working with Pinnacle Product Support and having them go through Pinnacle error logs they've determined that we have an internal Oracle error.
Services Affected: Pinnacle is discarding the call data rather than rating and archiving it.
Risk: We need Pinnacle to rate the call data so that we can bill back for long distance usage. 
Roll Back Plan: We are in the process of upgrading Pinnacle to 5.4.11 so that the DBA's can upgrade to Oracle 11.  This may solve the problem.  Also asking Pinnacle Support for other suggestions. 
Date and Time: Dec. 14, 2010 4:00 pm

Outage Length: None
Performed by: Tricia Burton, Mark Read, Lucas Jones

 

 

This is the Change Management Plan for the week of 17- 23 Dec 2010

 

System: Network File Shares
Purpose of Change: Move files to new SAN and add MAC user access to G and H drives
Services Affected: File Access
Testing: some testing on small scale compared to amount of data to be moved.
Risk: Old storage failure and loss of data
Roll Back Plan: temporarily reactive old SAN
Date and Time: 12:00 AM 24 Dec 2010
Outage Length: 4 DAYS
Performed by: Edd Ramer

_______________________________________________________________________________________________________________

 

This is the Change Management Plan for the week of 31 Jan 2010 to 6 Jan 2011:

 

System: Banner Position Control, Payroll, and Employee Self-Service
Purpose of Change: Upgrade Banner Position Control to 8.4
                              Upgrade Banner Payroll to 8.4
                              Upgrade Banner Employee Self-Service to 8.4
                              Upgrade Banner Payroll to 8.4.1
                              Upgrade Banner Employee Self-Service to 8.4.1
Services Affected: Banner Position Control, Payroll and Employee Self-Service
Yes Testing: Yes, upgrades were applied to BTST over two weeks ago and approved by the Payroll Office.
Risk: We will be out of compliance, these are regulatory changes for the new year.
Roll Back Plan: Revert to previous versions.
Date and Time: January 2, 2011 6:00 AM
Outage Length: Four Hours

Performed by: Mark Green

__________________________________________________________________________________________________________________

This is the Change Management Plan for the week of 7-13 Jan 2011

 

System: Xtender
Purpose of Change: Move data from old HP MSA 1000 to Hitachi AMS 2500
Services Affected: Xtender imaging services
No Testing: We do not have a development system setup to test with
Risk: Service will be on old hardware
Roll Back Plan: Roll back to old storage
Date and Time: January 7-8 2011 Start: 9:00 PM

Outage Length: 24 hours

Performed by: Mark Buxton

__________________________________________________________________________________________________________________

This is the Change Management Plan for the week of 14 to 20 Jan 2011

 

 

System: UC4
Purpose of Change: Apply Service Pack 4 to UC4
Services Affected: UC4
Yes Testing: We have applied this service pack to the test enviornment two times successfully.
Risk: not able to upgrade UC4 to 11gR2
Roll Back Plan: Roll back service pack and restore from backups taken prior to applying the service pack
Date and Time: 1/16/11 7:00 AM
Outage Length: 30 minutes

Performed by: Mark Green

__________________________________________________________________________________________________________________

 

This is an Emergency Change Management Plan.

 

System: Pinnacle Database
Purpose of Change: After upgrading Oracle and Pinnacle the database is still discarding the call data.
Services Affected: The call data is being discarded and so we're unable to bill back for long distance calls and archive call history.
Yes Testing: Yes - the Pinnacle database is discarding the call data.
Risk: We need to collect call data so that we can bill for long distance and archive call data.
Roll Back Plan: Tricia is contacting Pinnacle customer support and letting them know that upgrading Oracle and Pinnacle did not fix this problem.
Date and Time: January 18, 2011
Outage Length: Top priority issue.
Performed by: Tricia Burton, Mark Read, Kyle Stoddard
Change Submitted by: Tricia Burton

 _________________________________________________________________________________________________________________