PERSPECTIVES ON COMPUTERS IN EDUCATION ‑

THE PROMISE, THE PAIN, THE PROSPECT

 

 

T Alex Reid

Director of Computing Services

University of Oxford

 

10 September 1994

 

 

Computers and Teaching in the Humanities (CATH) Conference

Courseware in Action

 

Glasgow University

10-12 September 1994

 

 

CONTENTS

 

A. Introductory Background

B. The Promise

C. The Pain

            1. Inappropriate and Untrustworthy Evaluation

            2. The Not‑Invented‑Here (NIH) Syndrome

            3. Unavailability of Delivery Platforms

            4. Lack of a Viable Market for Courseware

            5. Non‑Cost‑Effective Courseware

            6. No Incentives for Developers

            7. Fear of Redundancy

            8. Technodazzle

            9. No Examples of Good Practice

            10. Inability to Maintain Currency

            11. Lone Enthusiasts

            12. Inefficient Courseware Development

            13. Piecemeal Development

            14. Lack of Integration into Curriculum or Institution

            15. Inadequate Support Services

            16. Low Priority for Educational Objectives

            17. Failure to Value Intellectual Property

            18. Overselling

D. The Prospect

            1. Potential of the Computer

            2. Predictions

            3. Postscript

E. References


A.  Introductory Background

 

In some respects, I rather feel that I am here under false pretences.  I currently have little involvement in computer‑based education, and very little in the humanities, let alone in the combination.  That’s not say I am totally ignorant of either, but I suspect there may be little I can say that is not already patently obvious to you.

 

On the other hand, I have been working in the computer industry now for nearly 33 years, which means I probably started before many of you were born.  Furthermore, I have had something of an interest in the use of computers in the education process for 23 of those years.  For some of that time that interest has been quite intense, for instance when I helped to persuade the University of Western Australia and the WA Government to underwrite the acquisition of a Plato system in 1983, which provided a national subscription‑based service.

 

My interest in humanities computing also goes back a long way, to the time when I was involved in helping set up a computerised version of the Corpus Inscriptionum Latinarum, back in 1971 (now available on CD‑ROM, and called the Epigraph database - Jory, 1993).  I also well remember being fascinated to read the humorous and informative, but at times heart‑breaking account of a US scholar’s struggles with use of computers in the humanities ‑ this was Ben Schneider’s “Travels in Computerland;  or, Incompatibilities and Interfaces”, published in 1974 (Schneider, 1974).  It was probably reading this book, more than anything else, that has given me a lasting sympathy for the adventures of the humanitist in IT land.  There has actually been one other very significant factor, and that is coming to terms with the fact that my wife has been persistently uncomfortable with technology of all forms, computers included, despite the technological orientation of myself and our 3 sons - and she is a not-unintelligent Arts and Education graduate and English and Language teacher.

 

What I am trying to say is that I possibly can bring a perspective to bear on your deliberations in this conference that may just be helpful.

 

Let me say at the outset, lest any of what I have to say may give you cause to doubt it, that I remain very firmly convinced of the promise of computer‑based education, despite some of the disappointments, confusion, wastage and pain I have witnessed over the years.

 

I must say that it seems very clear to me that this country is much further advanced than Australia in terms of development and infrastructure for CBE.  Such initiatives as CTI and TLTP I have sought for some time to have emulated in Australia, with something happening there on this front only now.  On the other hand, but without having done a proper study, my impression is that the level of interest and activity, as well as use of CBE, is very comparable between the two countries.  Without further investigation, I cannot be sure of the reasons for this discrepancy.  One attractive hypothesis is that in the UK the activity is taking place on a much more durable foundation, so that we should see a marked divergence in effective and widespread use in the future.

 

I should also just comment on my terminology.  I prefer to use the term “Computer‑Based Education”, since it covers both teaching (ie the teacher’s perspective) and learning (ie the student’s perspective).  I notice that this conference refers to “Computers and Teaching”, but I have assumed that this is not specifically intended to exclude the learning side, or to focus primarily or solely on the teaching side.

 

 

B.  The Promise

 

What are some of the promises of CBE?  Here is a list from 1983 (Reid, 1983), but it might equally have been made in 1973 or 1993.

 

a.       accelerated learning

b.      reduced time required for instruction

c.       improved understanding and performance by students

d.      improved effectiveness in teaching

e.       more pleasurable learning

f.        simplified remedial effort

g.       brings students to common level of background knowledge more efficiently

h.       automated collection and analysis of student performance data

i.         simplified prescription of courses of learning

j.        improved understanding of student progress

k.      accommodates differing rates and styles of learning

l.         improved communication between students and lecturers

m.     improved opportunities for research into learning patterns

n.       more effective use of lecturer time

o.      increased flexibility in timetabling

p.      improved treatment of specific learning disabilities

q.      improved student attitudes to learning

r.        ability to teach some material previously not possible

 

The list is not meant to be exhaustive, but representative of the kind of thing we have been saying for over 20 years.  Back in 1983 I could cite serious studies to corroborate each of these promises.  I’m sure we could add much to this list now, including the very topical one of enabling lecturers to spend more time on research!

 

The overall vision we might paint would look something like the following, taken from the Information Technology Strategic Planning Proposals of the University of Western Australia in 1992 (Reid, 1992):

 

“In the very long term, it is likely that the bulk of the routine, mundane or rote learning tasks will be handled by computer-mediated systems.  ...  In the longer term, ... lectures will probably only be used when there is something special to say to the whole class, or someone special comes with something to say.

 

“Interaction between instructor and student will occur through two much enhanced means - electronically and in small tutorial groups.  The electronic communication will occur in various forms - broadcast from the instructor to all students, in response to specific requests made by individual students, and also in response to the instructor examining electronic progress reports (eg ‘come and see me because you appear to be having difficulty in this area’).

 

“The most important interaction will once again revert to the small group model, where there is opportunity to interact in a meaningful way on real matters of issue.  This will restore the principal rationale for students choosing to come to [a particular] university - because they will have the opportunity to interact with the best people in their chosen discipline.”

 

I am encouraged and excited to learn that this vision is shared and is actually being realised, through careful use of technology, in Project Atlantis at McGill University (Piehler, 1994).

 

The rapidly falling cost of technology compared with conventional teaching methods compels us to believe that we must be on the right track, and that sooner or later CBE must pay off.  The cost of CBE is falling, whilst the cost of conventional teaching continues to rise:  data for Plato in 1976 suggested the cross-over point (in terms of dollars per hour of instruction) would be reached between 1977 and 1979 for university teaching (Hofstetter, 1981).  Even if you may dispute the dates, the trends are true for all CBE (perhaps the trends are even more marked with the advent of micros).

 

Surely all of us gathered here still believe in all this, do we not?

 

In fact, with the arrival first of the microcomputer, then of interactive multimedia, including now movie clips, and so on, we are more excited than ever about the promises the technology is making.

 

I was reading some papers written by Alfred Bork the other day, some dating back to 1971.  They could easily have been written today.  They explain why it is that computers are going to revolutionise the education process, in a way that parallels the impact of the book.  “We stand at one of the great moments in the history of education” he said in 1978 (Bork, 1981).

 

These writings are mirrored by those of Bengt Kjöllerström just last year (who also, by the way, is a physicist):  “IT can transform this [existing university] structure as it will enable students to study when and where it suits them...” (Kjöllerström, 1994).

 

 

C.  The Pain

 

We really have to find the solutions to a formidable range of problems, impediments and issues.  It seems that every time we overcome one impediment to the effective and widespread use of IT in teaching, something else emerges.  I have compiled a list of some of these - not guaranteed to be exhaustive, but rather to give an overview of how far we have come and how far we have yet to go.  This analysis is based on personal experience and observation in Australia, and observations in the UK and the USA.  It is not inconsistent with others who have analysed the situation (eg see Hammond, 1992).

 

1. Inappropriate and Untrustworthy Evaluation.  We need evaluation capabilities at several levels, as we have for the textbooks that we might select for our courses:

·    reviews from the publisher (often with glowing testimonials - something to excite our interest);

·            independent reviews in the press (from colleagues we trust or respect);

·    ability to see it and try it for ourselves - this is really hard for CBE!

Each of these plays an important part in our evaluation of a potentially suitable textbook.  The first two we can get something of a handle on in regard to CBE, but I think we are a long way from solving the third need.

 

2. The Not‑Invented‑Here (NIH) Syndrome.  This also seems largely to have been solved for textbooks, but is a really serious impediment for courseware.  This difference is not just a factor of the textbook’s longstanding place in education, versus the newness of CBE.  It also has much to do with the power of the technology used for CBE, which makes CBE material very much more complex and intrinsically difficult to compare, and the fact that so little courseware addresses an extensive part of the subject matter.  Only when courseware is produced which can be viewed as an integrated whole can it be reasonably be considered for adoption elsewhere than its birthplace.

 

3. Unavailability of Delivery Platforms.  Although progress is being made on this all the time, we are constantly behind the targets of numbers of students for every micro that we have set for ourselves - the recommendations of the national Nelson (1983) and McDonough (1991) Reports were, respectively, 5 by 1990 (which I don’t think was achieved by any UK university), and 4 by 1996.  The results of an informal survey conducted in March of this year (Rosner, 1994) indicated that the vast majority of universities were still a very long way from meeting the Nelson or McDonough targets - the overall picture is still quite gloomy.  Even these proposed levels of provision would be totally inadequate.  And given the manner in which equipment is funded in most universities, the recurrent (replacement and upgrade) implications of the required level of provision haven’t even begun to be considered.  This is a really serious issue, on which the whole vision of widespread use of CBE could well founder.  A bit of lateral thinking here, however, may help.  The place where the fastest deployment of suitable hardware is taking place is in the home.  Why duplicate resources to which students already have access?  More on this later.

 

4. Lack of a Viable Market for Courseware.  If courseware is ever to be as widely used in education as textbooks, then we need a means of creating and sustaining a market for it that is at least as effective as that for books.  At present, few are willing to invest in courseware development, because there are few prospects of any return.  People do not beat a path to your door if you build a better mousetrap.  Darby (1994) likens our present mode of operation (eg the TLT projects) to famine relief.  I like this analogy - such handouts meet the immediate need, but in the process destroy whatever incentives there were for the locals to invest in the next harvest, because they destroy the market (who’s going to pay for food when they can get it free from the relief agencies?).  I think we could perhaps take a leaf out of the book of the more thoughtful relief agencies, who advocate purchasing the products of depressed economies rather than sending them handouts (in materials or money).  If we follow the analogy, then we should be asking governments to buy the products of entrepreneurial ventures, which obtain loan or similar funding to reach that point, rather than just ask for handouts (of course, that is not to deny the important place of pump-priming).

 

5. Non‑Cost‑Effective Courseware.  This is something that many people in the CBE field shy away from.  If full cost-effectiveness studies were carried out for most of the courseware we are currently producing, our funding agencies would be scared off - so we don’t do it.  To be honest with ourselves, we need to take into account the full cost of development (which includes the time of academics and others seconded to development teams), the costs of delivery, and the costs of ongoing support and development throughout the life of the product.  The effectiveness side of the equation is covered by 1. above.  I’m afraid few projects would yield a positive result.  As has been said, the outcome is nearly always that the project satisfactorily demonstrates the potential of the technology (eg see Mapp, 1994).  This is another reason little interest has been shown in CBE development by commercial concerns.

 

6. No Incentives for Developers.  I think it is agreed by all nowadays that developments must originate with the relevant subject-matter people - the academics who teach it.  But there must be substantial incentives for them to embark on something as adventurous as courseware development.  At present, these are few and far between.  Even those universities who claim to provide promotion and advancement based on teaching as well as research rarely do so in practice.  A massive cultural change is required, which will take a long time (and won’t happen of its own accord!).  And even if the whole of academia were willing, there is still the serious issue of how you measure achievement in teaching and more specifically courseware development (compared with the well-established “publish or perish” arrangements for research performance).

 

7. Fear of Redundancy.  A powerful disincentive for many lecturers to become involved in development is, of course, the persisting fear that they will, in effect, be doing themselves out of a job in the long run.  In a sense they are right, as it seems very likely that the traditional job of lecturer will disappear.  But redundancy is only skin-deep;  we need to think more radically about the nature and purpose of the academic post - those who are at the forefront of research should also be at the forefront of the teaching of our brightest students - but the form which that teaching takes will change.

 

8. Technodazzle.  So much CBE development is overpowered by the wonder of the latest technology.  It marvellously demonstrates the potential of the new technology, but in and of itself is rarely cost-effective.  This is linked to point 5 above.  It is always going to be hard not to be influenced by the glamour of the latest offering.  As has been well said, “What is the question to which interactive multimedia is the answer?”

 

9. No Examples of Good Practice.  After 30 years of courseware development, we still have very few examples that we can point to as models for future development.  This is partly because the half-life of courseware is so short, but also because we have very few mechanisms to bring these to people’s attention, or to demonstrate them effectively when we have their attention.  Without ample examples of good practice in every discipline, we will not progress.

 

10. Inability to Maintain Currency.  As indicated above, courseware gets out of date very quickly.  This happens on two fronts - on the first, the technology advances so quickly that users become bored with the “pedestrian” material developed to exploit older technology;  on the second, the subject matter needs updating periodically - this is not so rapid an effect as the first, but is a more serious one, since the effort of updating material can be quite substantial, and not nearly so glamorous as developing it in the first place (the main incentive for authors to produce revisions of their textbooks is the additional revenue they bring in - albeit only pizza money).  On a third front related to the first, sometimes material exploits features which are not supported on later versions of the technology (software or hardware).  Plans and procedures for updating courseware must be devised.

 

11. Lone Enthusiasts.  How often have projects petered out when the originator, the main driving force, the enthusiast departs?  This is due partly to over-zealous enthusiasts (beware the person with fire in their eyes!), partly to lack of institutional support for specific projects (to remove the dependency on one person), and partly to the fact that CBE has not yet been institutionalised, ie made something that is considered a normal part of the life of academia.  These factors are, I believe, being addressed now rather effectively, by such means as the TLTP receiving a high institutional and national profile.  This appears to me to be less well-established in the humanities than in other disciplines, however.

 

12. Inefficient Courseware Development.  I used to think that this was the chief impediment to more widespread adoption of CBE, and campaigned against home-grown software, against the use of standard programming languages for development, and for the institutional adoption of high-level, “intuitive” development tools.  These goals are still not achieved very often, but even where they are, it is clear that the real impediments go far beyond the actual writing process.  The writing is such a small component of the whole development process, that even if it were reduced to zero, the overall project time would not be substantially affected.  Nonetheless, there are still very good reasons to pursue these goals, not so much to reduce development time, as to develop reusable material and reusable expertise.

 

13. Piecemeal Development.  So much courseware development has occurred in a piecemeal fashion in the past.  This is equivalent to writing a few examples for a chapter of a textbook.  This material may have enjoyed some success at the place where it was developed by the developers or their immediate associates, but it rarely receives wider use, and invariably experiences a quiet death after a short period.  To be effective and have lasting and widespread impact, it must be a part of a larger whole.  Otherwise it will never be regarded as anything other than a clever experiment - by the institution, by peers and even by the students who have used it.

 

14. Lack of Integration into Curriculum or Institution.  The ultimate answer to problem 13 is thorough integration into the curriculum, and into the academic life of the institution.  So often CBE has been promoted by isolated individuals or groups, who do not have the recognition of their peers, their universities, or sometimes even their departments.  It is inevitable in these circumstances that their impact would be minimal and not lasting.  This is gradually changing, again through the national recognition now being afforded such initiatives.  It is becoming “respectable”!

 

15. Inadequate Support Services.  Resources are required to support development and use within institutions, and to support distribution and dissemination.  A corollary to and consequence of 14 is that such efforts have been under-resourced (often, the enthusiast wildly underestimates the required resources in the first place!).  The under-resourcing takes place at the level of the individual effort, the institutional scene, and nationally.  CTI Centres, their equivalent at an institutional level, and the national CTISS services are helping to address these deficiencies.

 

16. Low Priority for Educational Objectives.  As indicated in 8 above, the priority in development of CBE materials has all too often not been directed primarily towards meeting educational goals.  Instead, the glamour of the technology, or the opportunity to obtain some funding, or the attraction of being involved in a leading‑edge project, have deflected many from asking first what are the educational needs that are to be addressed.  Too often, what is easy to accomplish with the technology is what gets tackled, rather than what may be really needed.

 

17. Failure to Value Intellectual Property.  Copyright issues have not really come to the fore much yet.  But they loom as potentially a very thorny issue.  Much of the culture of courseware to date has been free distribution.  This is being reinforced by the TLTP requirement that all products be freely distributed.  I do not happen to think that this is the best means of ensuring both comprehensive distribution and sustainable development (as indicated by my comments in 4 above).

 

18. Overselling.  A final pain which we are probably all guilty of inflicting on ourselves is overselling the technology.  This may yield short-term gains, but when we cannot deliver on the exaggerated promises we have made, as is inevitable, serious disillusionment sets in with the funding agencies and with our institutional leadership.

 

 

D.  The Prospect

 

Let’s now turn to the future and what I believe are the prospects for CBE.  As I have hinted through the course of reviewing the above problems, solutions to some of them are now in place, solutions to others are likely to emerge with little redirection of effort, and just a few will remain thorns in our side.  These I believe will only be overcome by radical thinking and endeavour.  Bork asserted 16 years ago that we were on the brink of a revolution.  I believe we are at that point now.

 

But revolutions are messy things!  They hardly ever happen in the manner anticipated (almost by definition!).  Furthermore, those who are in the vanguard frequently get swept away with the tide they unwittingly unleash.  How do we know how this revolution is going to take shape, and what impact it will have on how we teach the humanities in universities?

 

1. Potential of the Computer

 

It may be helpful to consider how information technology is impacting scholarship generally.  It is happening through 3 modes of use of the computer, which have emerged in sequence over the life of the device.

 

In the first mode, computers are used to do faster and more accurately the things we were already doing (typically, long and tedious calculations);  they improved efficiency.  You could say that they enable us to do the previously impracticable.

 

As the first mode has gathered momentum, a second, overlapping mode has emerged, as we started to realise more of the potential of the computer.  In this mode we use computers to change how we do things, to change our methods of solving problems.  We can start to tackle new problems.  This enables us to do the previously impossible.  It is as this mode emerged, I believe, that the use of computers in the humanities gathered momentum.

 

The third mode is only just beginning to emerge.  In this mode, computers enable us to change what we do, to allow questions to be asked which we could not even think of asking before.  This enables us to do the previously inconceivable.

 

The applications belonging to this third mode will and do catch us unawares.  They express the revolutionary nature of the computer.  Because they are unpredictable, and only starting to emerge, I can’t really give you any good examples.

 

But it may help if you consider the impact of various other fairly pervasive technologies, such as the telephone or the car, and consider how blinkered the inventors’ vision of their impact was, compared with what has happened.  The telephone has changed the very nature of communication, the car has changed how we live, not just how we are transported (eg it accounts for the rise of suburbs).  These technologies have thus had massive, unforeseen and possibly unforeseeable social implications.  So will the computer.

 

2. Predictions

 

In making some predictions, then, about the prospects for CBE in universities, I am conscious that it is very difficult to be right!  The best way to be correct, I believe, is to make many and radical predictions about the future (not necessarily contradictory ones), so that at least one of them will turn out right.  It also helps to be very cagey about the timescale.  This, I think, is how Nostradamus did it!

 

So I will be bold enough to make some predictions about how I think things will develop, which may help to provide a vision of where we’re going and why ‑ some light at the end of the tunnel to give us hope (albeit just me waving a flashlight!).  Without a vision, the Bible says, the people perish (Proverbs 29:18).

 

Prediction 1:  The only CBE developments that will have any impact will be the very ambitious and well-resourced, or the primitive, simple, almost naïve ones.

 

The first because they are the only ones which can hope to fulfill the requirements of full integration into and serious impact upon the curriculum and the institution.  A good example is the 30-person team used by the Texas Learning Technology Group to create the 160 hours of the Chemistry 1 course for 15 year-olds (McKendree, 1994).  The team included video producers, graphics designers, graphics software programmers, authoring software programmers, subject matter experts, classroom teachers, and instructional designers.

 

The second because such developments will quietly infiltrate their way into the system, and no serious investment of resources is required.  To some extent, this is represented in part by what Erhmann calls “worldware” - the use of standard packages such as Lotus 123 to facilitate adjunct teaching functions (Ehrmann, 1994).  But it also includes small, quickly-built tools;  the tools and products may not themselves propagate (indeed, most will die an early death), but the ideas they embody will propagate and perpetuate.

 

Products which fall between these two ends of the spectrum will be short-lived.

 

Prediction 2:  CBE will make a great leap forward in terms of its effectiveness, pervasiveness and impact - but this will occur in ways that we do not currently expect.  I suspect that this will occur outside the traditional education system, probably centred in the home or office, and will be controlled by commercial interests linked to entertainment and the media.

 

This should not trouble us, as I can think of no greater outcome than that everyone (possibly starting with mature and continuing students) should have the opportunity to obtain a grounding in the humanities.

 

The challenge for us is to be in the vanguard of developing the materials to convey this grounding, and to be ready and willing to enter into strategic partnerships with the media, publishers or other interested backers.

 

Prediction 3:  Central funding for development and distribution will dry up in a few years - well before you believe that it reasonably should.  Another period in the wilderness will ensue unless the momentum, the development and distribution systems, the infrastructure, and the alliances are in place by then.

 

This prediction has really nothing much to do with the technology, its promise, or our claims about it and whether or not they are realised (though all of these will have some influence).  It is purely a recognition of the “fickle” nature of such funding.  This year CBE, next year something else...

 

Prediction 4:  CBE will have a greater impact, and developments will be more radical, in the humanities than in the sciences.

 

This will occur because, although both fields are concerned about teaching both facts and how to think critically, the latter is of greater concern to the humanities (Webster, 1994).  Furthermore, the third, more radical or revolutionary impact of the computer is primarily to do with the social impact, the consequences for human systems, and so will more quickly be perceived and exploited by the humanities.

 

The real challenge here is to have sufficient numbers of humanities scholars equipped to recognise these trends and exploit them.  I fear that humanities scholars, in general, may have little ability or inclination to see the potential of technology beyond their immediate application.  However, I am encouraged by the projects which are on the agenda for this conference, some of which appear to exhibit just the right degree of radical thinking to indicate the appropriate kind of awareness.  How can that attitude be conveyed to your peers?

 

3. Postscript

 

I am sorry if my suggestions do not sound very rosy for many conventional courseware development projects.  Of course, I may be quite wrong;  but if I have stimulated you to look again at what you have been doing, or where you think you are going, and to attempt a defence of that, then I shall be content.

 

But I must say that I think this may be what you already are doing.  I am pleased that the theme of this conference is “Courseware in Action” - because only when we focus on the proper, durable means of implementation and integration, rather than just on the development, as we have so often done to date, will we have a reasonable prospect of overcoming the pain and problems on which I have dwelt so much in this paper, and realise the promise of computer-based education in teaching the humanities.

 

 

E.  References

 

Bork, A:  Interactive Learning:  Millikan Lecture, American Association of Physics Teachers, June 1978, in Learning With Computers, Bork, A, Digital Press, 1981, p285.

 

Darby, J:  remarks made in discussion at National Initiatives: Value for Money?, ALT Briefing, London, 5 September 1994.

 

Ehrmann, S:  Looking Backward:  US Efforts to Use Technology to Transform Undergraduate Education, in Higher Education 1998 Transformed by Learning Technology, edited by Martin, J, Darby, J & Kjöllerström, B, CTISS Publications, 1994, p10.

 

Hammond, N, Gardner, N, Heath, S, Kibby, M, Mayes, T, McAleese, R, Mullings, C, & Trapp, A:  Blocks to the Effective Use of Information Technology in Higher Education, Computers and Education, Vol 18, no. 1-3, 1992, pp155-162.

 

Hofstetter, F T:  Using the PLATO System: Features, Research and the Future, ADCIS Proceedings, 1981.

 

Jory, E J:  Epigraph: A Database of Roman Inscriptions, The University of Western Australia, 1993.

 

Kjöllerström, B:  An Introduction, in Higher Education 1998 Transformed by Learning Technology, edited by Martin, J, Darby, J & Kjöllerström, B, CTISS Publications, 1994, p7.

 

McDonough, W R (Chair):  Report of the Working Party On the Provision of Computing Facilities for Teaching, Inter-University Committee on Computing, September 1991.

 

McKendree, J:  Who is the Audience? Design versus Modifiability, in TLTP Newsletter, No. 1, July 1994, p6.

 

Mapp, L:  Learning >From Learning Technology: A Framework of Implementation Issues, The CTISS File, No. 17, July 1994, pp23-26.

 

Nelson, D (Chair):  Report of a Working Party on Computer Facilities for Teaching in Universities, Computer Board for Universities and Research Councils, 1983.

 

Piehler, P:  Atlantis: An Ancient Initiative, in The Oxford Magazine, No. 107, Fourth Week, Trinity Term 1994, p1.

 

Reid, T A:  The Benefits of Using Plato and CBE Generally, internal paper, University of Western Australia, 11-Oct-93.

 

Reid, T A:  Information Technology Strategic Planning Proposals, Office of IT, University of Western Australia, March 1992, p39.

 

Rosner, R:  Survey of Student Access to Workstations, University College London, electronic survey and communication, 12-May-94.

 

Schneider, Ben R Jr:  Travels in Computerland; or, Incompatibilities and Interfaces, Addison-Wesley, 1974.

 

Webster, F:  Mission That is Humanly Possible, in Synthesis: Multimedia for Teaching and Learning, The Times Higher, 13-May-94, page v.