SYSTEMS STATUS
GeorgiaVIEW QPROD Slowness Issues Reported
Incident Report for USG Services

Incident Summary:
At approximately 10:53 a.m. on Tuesday, November 28th, 2017, the GeorgiaVIEW Online Learning QPROD environment experienced a disruption of service due to database blocking. While no outage occurred, this negatively impacted performance for a small subset of users. These issues persisted until approximately 11:13 a.m., when full functionality of the service was restored.

Because we recognize that interruptions of GeorgiaVIEW service impact institutions across the state, we are communicating this post-outage analysis of what occurred and the measures being taken to address the factors resulting in this incident.

Incident Cause:
Upon investigation, ITS technical staff determined that the application code related to dropbox and file submission was causing excessive database blocking. Blocking, a term that describes database processes systematically waiting their turns so as to ensure database consistency as multiple changes are requested at the same time, is completely normal. Excessive blocking, however, which can occur for many reasons including poor application/query design, stale indexes, and unexpected changes in the use of the application, can result in significant performance problems.

Incident Response Measures:
To correct the issue, ITS technical staff identified and terminated the so-called "lead blocker" process. To help prevent this situation from recurring, ITS staff forced a refresh of the statistics relevant to the blocking event and also added a job that will automatically refresh the same statistics on a more frequent and ongoing basis. (Microsoft SQL Server automatically keeps these internal statistics and uses them to help optimize database activity.)

Posted 3 days ago. Dec 12, 2017 - 16:23 EST

Resolved
After monitoring the situation throughout the afternoon, Information Technology Services (ITS) has confirmed the stability of GeorgiaVIEW QPROD. The system should continue operating normally.

In the event that you experience any further issues with GeorgiaVIEW QPROD, please contact the ITS Helpdesk at helpdesk@usg.edu or 706-583-2001.
Posted 16 days ago. Nov 28, 2017 - 17:15 EST
Update
After monitoring the situation throughout the afternoon, Information Technology Services (ITS) has confirmed the stability of GeorgiaVIEW QPROD. The system should continue operating normally.

In the event that you experience any further issues with GeorgiaVIEW QPROD, please contact the ITS Helpdesk at helpdesk@usg.edu or 706-583-2001.
Posted 16 days ago. Nov 28, 2017 - 17:14 EST
Monitoring
Information Technology Services (ITS) has restored full functionality of GeorgiaVIEW QPROD. We will continue to monitor this system for stability until the end of the business day today, November 28, 2017. If you are still experiencing issues with GeorgiaVIEW QPROD, please contact the ITS Helpdesk at helpdesk@usg.edu or 706-583-2001
Posted 17 days ago. Nov 28, 2017 - 11:52 EST
Investigating
Information Technology Services (ITS) is currently investigating reports of slowness issues with the GeorgiaVIEW QPROD Online Learning Environment. Users at the following Institutions and organizations may be affected:

* Albany State University
* Atlanta Metropolitan State College
* Georgia College and State University
* Georgia Gwinnett College
* Georgia Highlands College
* Gordon State College
* Kennesaw State University
* Savannah State University
* South Georgia State College
* University of Georgia
* USG Training Initiatives
* GeorgiaVIEW Community

Affected users may be experiencing slowness. Additional information will be posted here when the issues are confirmed.
Posted 17 days ago. Nov 28, 2017 - 11:29 EST
This incident affected: GeorgiaVIEW Online Learning (GeorgiaVIEW Online Learning Environment (QPROD)).