Academic analytics is defined as the process of evaluating and analyzing organizational data received from
university
A university () is an educational institution, institution of tertiary education and research which awards academic degrees in several Discipline (academia), academic disciplines. ''University'' is derived from the Latin phrase , which roughly ...
systems for reporting and decision making reasons (Campbell, & Oblinger, 200
Academic analytics will help student and faculty to track their career and professional paths. According to Campbell & Oblinger (2007), accrediting agencies,
Government, governments,
parents
A parent is either the progenitor of a child or, in humans, it can refer to a caregiver or legal guardian, generally called an adoptive parent or step-parent. Parents who are progenitors are first-degree relatives and have 50% genetic meet. ...
and
students
A student is a person enrolled in a school or other educational institution, or more generally, a person who takes a special interest in a subject.
In the United Kingdom and most commonwealth countries, a "student" attends a secondary school ...
are all calling for the adoption of new modern and efficient ways of improving and monitoring student success. This has ushered the higher education system into an era characterized by increased scrutiny from the various
stakeholders. For instance, the Bradley review acknowledges that
benchmarking
Benchmarking is the practice of comparing business processes and performance metrics to industry bests and best practices from other companies. Dimensions typically measured are Project management triangle, quality, time and cost.
Benchmarking is ...
activities such as student engagement serve as indicators for gauging the institution's quality (Commonwealth
Government of Australia
The Australian Government, also known as the Commonwealth Government or simply as the federal government, is the national Executive (government), executive government of Australia, a federalism, federal Parliamentary system, parliamentary con ...
, 2008).
Increased competition,
accreditation
Accreditation is the independent, third-party evaluation of a conformity assessment body (such as certification body, inspection body or laboratory) against recognised standards, conveying formal demonstration of its impartiality and competence to ...
, assessment and regulation are the major factors encouraging the adoption of analytics in
higher education
Tertiary education (higher education, or post-secondary education) is the educational level following the completion of secondary education.
The World Bank defines tertiary education as including universities, colleges, and vocational schools ...
. Although institutions of higher learning gather much vital data that can significantly aid in solving problems like attrition and retention, the collected data is not being analysed adequately and hence translated into useful data (Goldstein, 2005).
Subsequently,
higher education leadership are forced to make critical and vital decisions based on inadequate information that could be achieved by properly utilising and analysing the available data (Norris, Leonard, & strategic Initiatives Inc., 2008). This gives rise to strategic problems. This setback also depicts itself at the
tactical level. Learning and teaching at institutions of higher education if often a diverse and complex experience. Each and every teacher, student or course is quite different.
However,
LMS is tasked with taking care of them all. LMS is at the centre of academic analytics. It records each and every student and staff's information and results in a click within the system. When this crucial information is added, compared and contrasted with different enterprise information systems provides the institution with a vast array of useful information that can be harvested to gain a competitive edge (Dawson & McWilliam, 2008; Goldstein, 2005; Heathcoate & Dawson, 2005).
In order to retrieve meaningful information from institution sources i.e. LMS, the information has to be correctly interpreted against a basis of educational efficiency, and this action requires analysis from people with learning and teaching skills. Therefore, a collaborative approach is required from both the people guarding the data and those who will interpret it, otherwise the data will remain to be a total waste (Baepler & Murdoch, 2010). Decision making at its most basic level is based on
presumption
In law, a presumption is an "inference of a particular fact". There are two types of presumptions: rebuttable presumptions and irrebuttable (or conclusive) presumptions. A rebuttable presumption will either shift the burden of production (requir ...
or
intuition
Intuition is the ability to acquire knowledge without recourse to conscious reasoning or needing an explanation. Different fields use the word "intuition" in very different ways, including but not limited to: direct access to unconscious knowledg ...
(a person can make conclusions and decisions based on experience without having to do data analysis) (Siemens & Long, 2011). However, a lot of decisions made at institutions of higher learning are too vital to be based on
anecdote
An anecdote is "a story with a point", such as to communicate an abstract idea about a person, place, or thing through the concrete details of a short narrative or to characterize by delineating a specific quirk or trait.
Anecdotes may be real ...
, presumption or intuition since significant decisions need to be backed by data and facts.
Background
Analytics
Analytics is the systematic computational analysis of data or statistics. It is used for the discovery, interpretation, and communication of meaningful patterns in data, which also falls under and directly relates to the umbrella term, data sc ...
, which is often termed “business intelligence”, has come out as new
software
Software consists of computer programs that instruct the Execution (computing), execution of a computer. Software also includes design documents and specifications.
The history of software is closely tied to the development of digital comput ...
and
hardware that enables businesses to gather and analyse large amounts of information or data. The analytics process is made up of gathering, analysing,
data manipulation and employing the results to answer critical questions such as ‘why’. Analytics was first applied in the admissions department in higher education institutions. The institutions normally used some formulas to choose students from a large pool of applicants. These formulas drew their information from high school transcripts and standardized test scores.
In today's world, analytics is commonly used in administrative units such as
fund raising and admissions. The use and application of academic analytics is meant to grow due to the ever-increasing concerns about student success and accountability. Academic analytics primarily marries complex and vast data with
predictive modelling
Predictive modelling uses statistics to Prediction, predict outcomes. Most often the event one wants to predict is in the future, but predictive modelling can be applied to any type of unknown event, regardless of when it occurred. For example, pre ...
and statistical techniques to better decision making. Current academic analytics initiatives are bent to use data to predict students experiencing difficulty (Arnold, & Pistilli, 2012, April). This allows advisors and faculty members to intervene by tailoring procedures which will meet the student's learning needs (Arnold, 2010).
As such, academic analytics possesses the ability to improve learning, student success and teaching. Analytics has become a valuable tool for institutions because of its ability to predict, model and improve decision making.
Analytic Steps
Analysis is composed of five basic steps: capture, report, predict, act and refine.
Capture: All analytic efforts are centred on data. Consequently, academic analytics can be rooted in data from various sources such as a
CMS, and financial systems (Campbell, Finnegan, & Collins, 2006). Additionally, the data comes in various different formats for example
spread sheets. Also, data can be got from the institution's external environment. To capture data, academic analytics needs to determine the type of available data, methods of harnessing it and the formats it is in.
Report: After the data has been captured and stored in a central location, analysts will examine the data, perform
queries, identify patterns, trends and exceptions depicted by the data. The standard deviation and mean (
descriptive statistics
A descriptive statistic (in the count noun sense) is a summary statistic that quantitatively describes or summarizes features from a collection of information, while descriptive statistics (in the mass noun sense) is the process of using and an ...
) are mostly generated.
Predict: After analysing the warehoused data through the use of statistics, a
predictive model is developed. These models vary depending on the question nature and type of data. To develop a
probability
Probability is a branch of mathematics and statistics concerning events and numerical descriptions of how likely they are to occur. The probability of an event is a number between 0 and 1; the larger the probability, the more likely an e ...
, these models employ
statistical regression concepts and techniques. Predictions are made after the use of
statistical algorithms
Statistics (from German: ', "description of a state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social ...
.
Act: The major goal and aim of analytics is to enable the institution to take actions based on the probabilities and
predictions made. These actions might vary from
invention
An invention is a unique or novelty (patent), novel machine, device, Method_(patent), method, composition, idea, or process. An invention may be an improvement upon a machine, product, or process for increasing efficiency or lowering cost. It m ...
to information. The interventions to address problems might be in the form of a personal email, phone call or an automated contact from faculty advisors about study resources and skills, such as office hours or help sessions. Undoubtedly, institutions have to come up with appropriate mechanisms for impact measurement; such as did the students actually respond or attend the help sessions when invited.
Refine: Academic analytics should also be made up of a process aimed at
self-improvement. Statistics processes should be continually updated since the measurement of project impacts is not a one-time static effort but rather a continual effort. For instance, admission analytics should be updated or revised yearly.
Comprehending Involved Stakeholders
Analytics affects
executive officers, students, faculty members,
IT staff and student affairs staff. Whereas students will be keen to know academic analytics will affect their grades, faculty members will be interested in finding out how the information and data can be appropriated for other purposes (Pistilli, Arnold & Bethune, 2012). Moreover, the institution staff will be focussed on finding how the analysis will enable them to effectively accomplish their jobs while the institution president will be focussed on freshman retention and increase in graduation rates.
Criticisms
Analytics have been criticised for various reasons such as
profiling. Their main use is to profile students into successful and unsuccessful categories. However, some individuals argue that profiling of students tends to
bias
Bias is a disproportionate weight ''in favor of'' or ''against'' an idea or thing, usually in a way that is inaccurate, closed-minded, prejudicial, or unfair. Biases can be innate or learned. People may develop biases for or against an individ ...
people's behaviours and expectations (Ferguson, 2012). Additionally, there is no clear guidelines on which profiling issues should be prohibited or allowed in institutions of higher learning.
References
Academic Analyticsin the
EDUCAUSE
Educause is a nonprofit association in the United States whose mission is "to advance higher education through the use of information technology". Membership is open to institutions of higher education, corporations serving the higher education in ...
Resource Library
* Arnold, K. E. (2010). Signals: Applying Academic Analytics. Educause Quarterly, 33(1), n1. (accountability)
* Arnold, K. E., & Pistilli, M. D. (2012, April). Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). ACM.
* Baepler, P., & Murdoch, C. J. (2010). Academic analytics and data mining in higher education. International Journal for the Scholarship of Teaching and Learning, 4(2), 17.
* Campbell, J. P., & Oblinger, D. G. (2007). Academic Analytics. Educause Article.
* Campbell, J. P., Finnegan, C., & Collins, B. (2006). Academic analytics: Using the CMS as an early warning system. In WebCT impact conference.
* Commonwealth Government of Australia. (2008). Review of Australian Higher Education o. Document Number)
* Dawson, S., & McWilliam, E. (2008). Investigating the application of IT generated data as an indicator of learning and teaching performance: Queensland University of Technology and the University of British Columbia. (A. L. a. T. Council o. Document Number)
* Ferguson, R. (2012). Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5), 304-317.
* Goldstein, P. (2005). Academic analytics: The uses of management information and technology in Higher Education o. Document Number)
* Heathcoate, L., & Dawson, S. (2005). Data Mining for Evaluation, Benchmarking and Reflective Practice in a LMS. E-Learn 2005: World conference on E-Learning in corporate, government, healthcare and higher education.
* Norris, D. M., Leonard, J., & Strategic Initiatives Inc. (2008). What Every Campus Leader Needs to Know About Analytics o. Document Number)
* Pistilli, M. D., Arnold, K., & Bethune, M. (2012). Signals: Using academic analytics to promote student success. EDUCAUSE Review Online, 1-8.
* Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. Educause Review, 46(5), 30-32.
References
{{Reflist
Business analytics