|
FROM 1 JANUARY 2007
NAATI INTRODUCES A NEW SYSTEM OF ACCREDITATION
IT INVOLVES -
PERIODIC ACCREDITATION and REVALIDATION OF ACCREDITATION
To retain the highest level of competency and currency in the translating and interpreting profession, NAATI is introducing changes to its accreditation process. From 1 January 2007 all NEW accreditations based on tests sat and applications received after this date will be valid for a period of three years.
This means that if you are successful on a NAATI test that you sit for after 1 January 2007, you will be awarded accreditation for three years.
At the end of the three years, you will have the options of:
a) applying for revalidation of accreditation
b) allowing the accreditation to lapse
read more PDF
‘Opting in’ to Revalidation of Accreditation
Revalidation of Accredited Practitioners
To enhance the value of NAATI accreditation and provide the marketplace with capacity to identify practitioners who are experienced and who retain professional currency, from 1 January 2007, NAATI will introduce a new accreditation system based on periodic revalidation.
Read more PDF
REVALIDATION OF ACCREDITATION
Forum for Service Providers 2006
In February and March this year NAATI held public forums to discuss a proposal for the revalidation of accreditation. Following to these forums NAATI developed a survey to all practitioners for return between March and June this year. The results of this survey are in the report titled ‘Revalidation of Accreditation NAATI Survey Results on Practitioner Work Experience 2006’ found below.
Following the results in this report NAATI held a forum for service providers on September the 8th 2006 in Melbourne, Victoria.
This forum for the major public and private service providers was convened to assist NAATI to develop reasonable and workable criteria of work practice for the Revalidation of Accreditation and to provide views on periodicity and record keeping.
The record of this forum has been provided for everyone’s information.
Service Provider Forum PDF
REVALIDATION OF ACCREDITATION NAATI Survey Results
On
Practitioner Work Experience 2006
Information on the proposed system of revalidation of accreditation was released in the NAATI Revalidation of Accreditation Second Discussion Paper on October 31st 2005.
NAATI held a public forum in February and March 2006 in each capital city with industry stakeholders to consider and discuss the observations and recommendations contained in the discussion paper. The process included discussion of the proposal and NAATI encouraged and received feedback to assist with the development of a fair and viable system of revalidation.
Read more PDF
NAATI RATER RELIABILITY STUDY
PHASE ONE COMPLETED
PHASE TWO BEGINS
As part of NAATI’s commitment to continuous improvement and as part of its long-term on-going work related to the validation of tests, the Rater Reliability Study was commissioned in 2005 to investigate the consistency of ratings, both inter and intra-rater reliability, of the NAATI tests. The study was undertaken by Helen Slatyer and Andy Carmichael through the Centre for Translation and Interpreting Research (CTIR) at Macquarie University. Helen is an accomplished researcher in language testing and measurement as well as being an accredited two-way Translator and translator educator. Andy Carmichael is an Auslan interpreter and active member of the profession.
Read more (PDF)
National Summary on Revalidation Forums
NAATI has completed the collation of feedback from the eight public forums convened to facilitate consultation with key stakeholders in the T&I industry. The report is comprised of a brief overview at the beginning, followed by the detailed feedback provided on specific topics discussed.
Download PDF here
Back to top
Update on Revalidation Accreditation
NAATI has completed eight public forums across Australia on the proposal for Revalidation of Accreditation. They were convened as follows:
13 February 2006 Melbourne 70 attended
15 February 2006 Perth 33 attended
17 February 2006 Sydney 123 attended
22 February 2006 Brisbane 50 attended
23 February 2006 Hobart 25 attended
24 February 2006 Darwin 12 attended
2 March 2006 Canberra 14 attended
3 March 2006 Adelaide 35 attended
The attendance numbers (362) were those recorded at the commencement of the forums. Numbers at completion were lower (254).
The purposes of the forums were:
- To provide an opportunity for stakeholders to express their views
- To reach a national consensus or majority view on the major issues to be based on group responses from all states and territories
- To develop parameters for revalidation that are practical,workable and acceptable to the majority of stakeholders.
At each forum there was a set presentation followed by a question time. The participants then divided into five working groups to cover the following key areas:
- Implications of revalidation for previously accredited practitioners and practitioners who do not meet revalidation criteria
- Periodicity of revalidation and the timetable and incentives for upgrading of accreditation from the paraprofessional level
- Continuing Practice Requirements
- Professional Development Requirements
- Role of Service providers and Implications for Service Provision
t the end of each forum, each working group submitted a written response to the issues discussed. In addition, NAATI has received a number of individual responses. These are now being collated into a national summary which will be forwarded to the NAATI government Members and the Board of Directors. It will also be published on this web site.
First Revalidation Forum in Melbourne
13 February 2006
NAATI convened the first public forum concerning the proposed Revalidation of Accreditation on Monday 13 February 2006 in Melbourne.
NAATI is convening the forums in the capital cities of Australia to obtain important feedback on key issues that were identified in the First Discussion Paper in October 2003 and in the Second Discussion Paper issued in October 2005.
A report will be issued by NAATI on this web site following the completion of all forums in early March.
NAATI is disappointed by a report on the Melbourne forum which has been issued through a member of the Western Australian Institute of Translators and Interpreters who was not in attendance at the meeting. The report contains several inaccuracies and an important omission which NAATI seeks to clarify. We therefore, provide the following clarification to the above-mentioned report.
NAATI RESPONSE TO EXTERNAL REPORT ON REVALIDATION FORUM IN MELBOURNE
1. NAATI’s publicly stated objectives for the forums were:
- to provide an opportunity for stakeholders to express their views
- to reach a national consensus/majority view on the major issues to be based on group responses from all states and territories
- to develop parameters for revalidation that are practical, workable and acceptable to the majority of stakeholders
2. The forums were not framed to limit people’s consideration of the proposal. The First Discussion Paper in 2003 presented a proposal. The feedback at that time showed clear consensus for revalidation of accreditation. There was no feedback at that time to suggest that NAATI should not be the body to administer the revalidation. In addition, while there was consensus for the concept, there were key issues emanating from this paper about which there was insufficient feedback for NAATI to adequately address them. The forums were designed to move the proposal forward and to obtain this necessary feedback. Therefore the focus of the Melbourne forum was on these key areas.
3. There was not a clear yes/no answer to the question as to whether “NAATI intended to implement the proposal even if it was opposed by a majority of practitioners”.
What was communicated was that there is a clear consensus for revalidation of accreditation; that we need to find a means to implement it that is workable and acceptable to the majority of stakeholders. It was also made clear that any feedback on the question raised above would be conveyed to the NAATI Board of Directors and in turn to the Members of NAATI.
4. What is missing from the report is the clear statement by NAATI that it wishes to work with Ausit to develop a system that fits the objectives and needs of both organisations. It was also suggested that reciprocal arrangements should be explored.
Download
PDF here
Back to top
Revalidation
Of Accreditation
Second Discussion Paper on Basic Concepts and Strategies for Implementation
As part of the need to ensure
currency of NAATI accreditation, NAATI has been developing a system
which will require periodic revalidation of accreditation. This
is in keeping with most professions within Australia.
The First Discussion Paper was
released in late 2002 and was followed by consultation with stakeholders
in the industry. The outcome of the consultation process was that
there was general consensus about the need for revalidation, but
little agreement on the means by which it could be achieved.
Since a system for revalidation
of accreditation has been requested and supported by both NAATI
Members (governments) and service providers, and is included as
one of the requirements in NAATI's constitution, NAATI has continued
to work towards developing a workable system that will meet industry
requirements. This has not been easy, since variations in the
supply and demand for T & I services vary considerably by
language and location. This means that the ability for practitioners
to meet the requirements for revalidation of accreditation will
be variable and will often depend upon these two factors.
NAATI has give consideration to
a variety of aspects related to revalidation of accreditation
and now presents a Second Discussion Paper. This paper reiterates
and updates the information provided in the First Discussion Paper
and moves forward by proposing a system for implementation.
NAATI requests all stakeholders
to consider this second Discussion Paper and to make known to
NAATI their views and comments. Comments may be sent to NAATI
by 15 December 2005 by post or email by 15 December 2005 as follows:
NAATI
Revalidation of Accreditation Proposal
PO Box 4040
Hawker ACT 2614
Email: info@naati.com.au
Subject: Revalidation of Accreditation
NAATI also intends to convene public forums for discussion of
the paper in major metropolitan centres on dates to be determined
between mid December 2005 and early February 2006. These will
be notified on the web site in due course.
A Copy of the Paper is available
for download below. You will need Adobe Acrobat to view it, which
can be downloaded here: www.adobe.com
Revalidation
Second Discussion Paper September 2005 (232 KB)
Back
to Top
UPDATE ON COOK REPORT
Over the past few months NAATI has been developing a three year work plan which will incorporate recommendations of the Cook Report. Cook has made over thirty recommendations which will be prioritised according to time and financial resources.
In the first instance, NAATI is committed to introducing independent marking for the November 2006 Translation Tests. Administrative procedures are being developed and the piloting of these will be carried out between May and September for Special On Demand tests in selected languages.
In addition, NAATI is putting into place changes to examiner recruitment, appointment, training and auditing. These will be phased in after 1 July 2006.
As soon as NAATI finalises its implementation plan for the Cook recommendations, it will post it on this web site. It should be noted that the Cook recommendations have significant resource implications and NAATI has been informed by governments that it cannot expect any additional funding before the 2007-2008 financial year. In the meantime, NAATI will implement as many recommendations as possible within its budget.
NAATI Welcomes
Review on Test Administrative Processes
NAATI
welcomes the Cook Report as the outcome of an external review
of its operations related to testing. The report is comprehensive
and serves as a mechanism to provide opportunities for future
improvements and growth.
The Review was conducted
by Mr John Cook and Ms Hilary Dixon. Mr Cook is an independent
external consultant, who has had no previous relationship with
NAATI and who has both a working and consulting background in
examination management and test assessments. Ms Dixon is a language
specialist with experience and expertise in language assessment.
The report makes
a number of findings and recommendations. Some of the key recommendations
include the introduction of a system of independent marking, the
introduction of computers in translation tests, mandatory training
of examiners and examiner performance appraisals. Other recommendations
relate to setting and marking of tests, systems of assessment,
candidate preparedness for testing and NAATI resources. The report
also acknowledges that the implementation of the recommendations
will require considerable time and a substantial injection of
funds.
NAATI has completed
an initial analysis of the report. We invite interested parties
to read the report and NAATI's response. We also invite you to
provide NAATI with your comments on various recommendations. Comments
may be sent to NAATI by post or email.
NAATI
The Cook Report
PO Box 4040
Hawker ACT 2614
Email: info@naati.com.au
Subject: The Cook Report
Copies of the Report
and the Response are available for download below. You will need
Adobe Acrobat to view them, which can be downloaded here: www.adobe.com
NAATI
Response (82KB)
Back
to Top
NAATI MOVES FORWARD ON CHANGES TO INTERPRETER TEST
NAATI has now completed the work on the development of the new format for the Interpreter Test. As an outcome of the Test Format Review in 2000-2002, NAATI developed a pilot Interpreter Test which included:
Task 1:
1 dialogue of 400 words to be interpreted by the consecutive mode
1 Social/Cultural Questions
1 Ethics Questions
1 Sight Translation Passage (200 words in English)
Task 2:
1 dialogue of 400 words to be interpreting using the chuchotage mode
1 Social/Cultural Questions
1 Ethics Questions
1 Sight Translation Passage (200 words in LOTE)
Task 3
1 Consecutive Passage of 300 words in English, broken into two 150 word segments
1 Consecutive Passage of 300 words in LOTE, broken into two 150 word segments
This format was developed for tests in Arabic, Chinese and French and was piloted with volunteer candidates, some of whom are accredited, others are not.
Following the analysis of results of the marked pilot Interpreter tests together with the results of the candidate follow-up questionnaire and the evaluation reports from the examiners, it became clear that the sight translation and the splitting of the consecutive passage was well received as positive changes to the test. Most candidates coped well with these changes and commented that it made the test more realistic. Candidates fully supported the splitting of the consecutive passage and commented that the sight translation was a good addition to the test and was pitched at appropriate levels and in context with the dialogues.
With reference to the chuchotage component of the test, candidates were divided on their responses. Some felt it was a good addition to the test, others commented that it was very challenging and that the time gaps between segments were insufficient. (Note, there should not be time gaps between segments as this is not consecutive interpreting)
Examiners commented that this component raised serious problems. Chuchotage is whispered simultaneous interpreting and this implies voice and diction control and different interpreting strategies as compared to consecutive or simultaneous interpreting. Most candidates did not whisper which resulted in a situation of simultaneous interpreting under consecutive interpreting conditions. In addition, there were several technical difficulties which remain unresolved. Examiners also commented that chuchotage interpreting requires special training without which candidates would have great difficulty in mastering the skill. They also commented that although there are occasions in the workplace where this is required (eg. court rooms, conference settings), it is not in high demand as a necessary skill for the majority of interpreters. In contrast, sight translation is a common requirement of interpreters.
On the basis of these outcomes, the NAATI Board has accepted the recommendation of the NAATI Qualifications Assessment and Advisory Committee to make the following changes to the Interpreter Test:
- introduce sight translation to the Interpreter Test (one per dialogure)
- split the consecutive passages into two segments
- not introduce chuchotage interpreting to this test
As a result of the decision taken by the Board of Directors on 23-24 February 2006, NAATI will now work to introduce the new format. In the first instance, this will require the development of Sample Test Kits and extensive examiner training. It is anticipated that the first tests to use the new format will be in the March to June period of 2008.
NAATI
Completes Research Work on Pilot Translator Tests
In 2000 NAATI commenced
a series of validation studies in relation to its tests. The first
part of the series involved studies of the content and construct
of the Translator and Interpreter Tests. At the time, a group
of experts met to discuss the current NAATI format of these tests
and to suggest ways in which they might be improved.
In 2001-2, the expert committee recommended
changes to the format of the Translator test and the Interpreter
tests. New tests were designed in three languages, Arabic, Chinese
and French according to the recommended formats. During the design
phase some problems were identified which required further adjustments
of the tests. Finally, in 2004, the design phase was completed
and in 2005, the tests were trialled among a group of volunteer
candidates.
Proposed changes to the format of the Translator
test are as follows:
Current Format Proposed New Format
Task 1:
Candidates choose two of three passages
for translation; each of 250 words (English equivalent)
Task 2:
Candidates answer two of three ethics questions
Task 1:
Candidates choose one of three passages
for translation; the passage is 500 words (English equivalent)
Task 2:
Candidates respond to three of five translation
challenges related to the passage translated
Task 3:
Candidates answer two of three ethics questions
The pilot tests involved candidates sitting for the tests and
then completing a questionnaire and interview about how they found
the test. Examiners then marked the test and provided comments
about the test from the perspective of setting and marking.
The results of the Translator pilot tests
showed the following:
" Candidates generally thought that
one longer passage was easier than two shorter passages
" The above was contradicted by the marking of the tests
which showed that more serious omissions and general errors were
made by candidates in the longer passages resulting in the overall
scores being lower than they had achieved on the current NAATI
accreditation tests.
" Examiners expressed the view that in predicting performance
as professional translators, performance on a range of test passages
gives a better basis upon which they can evaluate the candidates'
ability.
" The new task involving responses to "translation challenges"
in the pilot test neither added nor removed anything from the
test in terms of the overall assessment.
" Examiners expressed the view that
the new test was much more difficult and time consuming to set
and mark and that if implemented, extensive training would be
required.
In summary, the results of the Translator
Pilot test have shown no real advantage or disadvantage over the
current format in terms of assessing candidate performance. However,
implementation of the new format may reduce the current pass rates
and in turn, the number of annual accreditations. It could also
significantly increase the setting and marking costs which could
have implications for test fees.
As a result of these findings, the Qualifications
Assessment and Advisory Committee (QAAC) recommended that NAATI
should not introduce the new format for the Translator test until
further research is conducted and other alternative test formats
are examined. At the recent meeting of the Board of Directors,
this recommendation was endorsed. It should be noted that since
the NAATI Pilot Test project commenced, there have been some new
developments in Europe which show promise in accurately measuring
translation performance.
The outcome of the completed research,
therefore, is that the proposed new format of the Translator Test
will not be implemented and that the current format will be retained
for the foreseeable future.
Since the pilot testing for the new Interpreter
Test Format is not yet complete, no decisions have been taken.
It is anticipated that the research will be completed early in
the first quarter of 2006 with decisions to follow soon thereafter.
Back
to Top
|