Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
2012 Q6 Competence Management System
#1
I have just completed 2012 under exam conditions and of the three questions I chose I cannot find a thread that discusses Q6.

Please see attached my attempt, I would appreciate feed back from one and all.  Personally I am concerned I should of kept it less specific to particular skills and a more generic answer may have been more appropriate but as we all know time does not allow you to change the direction of your answer once you've started!

Many Thanks

Mike
Reply
#2
(09-09-2015, 01:38 PM)mdbolton Wrote: I have just completed 2012 under exam conditions and of the three questions I chose I cannot find a thread that discusses Q6.

Please see attached my attempt, I would appreciate feed back from one and all.  Personally I am concerned I should of kept it less specific to particular skills and a more generic answer may have been more appropriate but as we all know time does not allow you to change the direction of your answer once you've started!

Many Thanks

Mike


Yes  think you were rather too specific and be careful of using abbreviations such as NR SWT and CofC (although I do see that later on you explained them)

There was too much continuous writing so not easy to see the structure and there is a danger of examiner overlooking items, so better to have used bullets etc. to make very clear  and separate

e.g. As a major works TiC (Tester In Charge) I use 2 distinct sources:
1. NR SWT (Signal Works Testing) CofC (Certificate of Competence)
2. IRSE Licence.

1.  Predefined form, listing tasks and applicable equipment types on which it may be undertaken each assessed as 
  • X Not Competent
  • M Mentored
  • R Restricted
  • C Fully Competent
      Qualified Proposer makes assessment, supported by training courses and mentoring records; Approved by senior in company; held in NR database

2. Broader assessment of ability to perform a particular role:
  • Principles Tester
  • Functional tester
  • Assistant Tester
    based on an independent assessment judged against Competency Assessment Criteria for various elements,
    justified by a range of techniques including: Workplace Observation, Witness Testimony, Questioning etc.
    assessment evidence then reviewed by a Competency Assessor.


and so forth.......



 I am not actually saying that it was right to go into this level of detail when answering this part of the question, but if you do, then you should lay it out rather more as I have above than in a page of almost unbroken text.

I think in the first part of your answer, you should have said a bit more about the PURPOSE; I would have said something about 
having a mechanism that is capable of demonstrating that the person has the correct attributes 
  • specific task training, 
  • broad underpinning knowledge of the domain and environment, 
  • experience of undertaking such a task in a range of circumstances, 
  • display appropriate responsible attitude and behaviours,
to be able consistently to undertake the task to a professionally acceptable standard of performance.  

In a sense you wrote that the purpose of Competence Management is to manage competence- which although true, doesn't actually add much to be able demonstrate your understanding!

Conversely I would not have gone into quite the detail you did here about how it SHOULD WORK; I would perhaps have kept some of the detail for the part B.  Having said that there are 12 marks for part A  and I think I might expect to get 4 for the above, so I have 8 still to claim in this section.  I would certainly have started more gerically before giving a specific example and have talked about-
a) definition of what is being benchmarked and relevant standard
b) assessment against those
c) recording of that assessment
d) allocation to tasks subsequently being based on that assessment record.
Then perhaps go on to describe the example of the tester and the two complementary systems as indicated above. 



In part B you have talked about mentorship, but never really described what is actually meant by that term- you hint at it when speaking about the gathering of evidence and forms, but much more important to concentrate on the essence of what it is seeking to achieve.  I know that you know, but you must describe to the examiner.
Something like: 
An individual working under mentorship is 
  • initially constantly under the watchful eye of an already competent person who can give helpful advice should the mentoree be in need of it whilst they are gradually gaining experience of working in real-world conditions, or intervene if necessary to prevent an undesirable situation from resulting from a mistake;
  • later on, when the mentor has gained good confidence that the mentee is broadly capable and is aware of the limits of their experience, then the mentorship may become more "arms length", but the mentor remains responsible for the correct performance of the work, but may satisfy themselves by discussing after the activity has been undertaken and reviewing the results before countersigning for the task.

However be careful, because actually the question was about the EVIDENCE NEEDED and you should start with that as the main focus; however given that this evidence has almost invariably to be gathered whilst the individual is under mentorship then this does indeed become relevant in addressing the bit on HOW IT IS TO BE GATHERED.

For the last part you again I think should have been more general.  However given that you were thinking about the tester scenario, then I'll comment on what you wrote.  Suppose errors were made by a tester when commissioning an Ebi track circuit; would a complaint on the IRSE licence be appropriate if the error was actually quite specific to defective knowledge about that sort of track circuit?  
  • The IRSE licence category is functional tester and the person may actually be perfectly fine to undertake controlled changeovers and through test SSI locations, test signal, points and probably also DC track circuits.  
  • If however the error was due to failure to follow process, perhaps undertaking a set-up and drop/pick up test of that track when in fact no-one had checked it was actually installed correctly according to the design drawings and the individual had then signed for tasks that they hadn't actually undertaken, then a complaint on their IRSE licence would certainly seem more appropriate because it shows a failure to follow due process that is probably generically applicable across the role as a whole.  
Having made the distinction re the separate complementary measures of competence in the first part of the question,rather surprising that you did not utilise that distinction here!



So overall I do agree with your own critique in that specific examples are good but did dominate too much that it narrowed the question just to the sub-set rather than being just that- an example.

Also do avoid long length of prose in your answers
USE:
  • Bullet Lists
  • Diagrams
  • Tables
  • Lines of space to separate
PJW
Reply
#3
I have attempted the same question, see attached for my 'under exam conditions 31 min' attempt.

I'd appreciate any feedback.

Adrian
Reply
#4
(25-09-2015, 11:41 AM)AdrianM Wrote: I have attempted the same question, see attached for my 'under exam conditions 31 min' attempt.

I'd appreciate any feedback.

Adrian

To me your answer was rather too focused on just summarising the operation of the IRSE Licensing scheme.
I agree that the question did indeed ask for a description of how a system should work, but although I can't place a finger precisely on why, I don't feel that this was quite what the examiners were after.  
I suppose it may be that 
  • I don't think the IRSE licence scheme is itself a Competency Management System, but only one element of one,
  • the exam is not about being able just regurgitating recalled facts, so presumably they wanted something more.
I think I'd have given a bit less detail about the steps in the process of obtaining a licence and a little more about the implementation within the management of a company or project- how the competence to do a task is defined, how an individual is developed to have that competence, how work is assigned to people who can demonstrate their competence.  It is never a bad idea in IRSE exam to hint at WHY things are they way they are, so perhaps you could have stuck broadly with your description but woven such things into it, trying to relate back to the first part of the question re the function of a CMS to show how the steps in getting the licence fulfill.

There were a few things in your description which grated slightly; for example 
  • the CACs are Criteria, not CheckLists; 
  • the purpose of the CA is to review the adequacy of the WPA which has been carried out (rather than fill the gaps identified by the WPA; it is actually more to fill gaps that were NOT identified by the WPA and arguably more of a scrutiny of them than the actual candidate!);
  • the WPA and CA must be carried out by those having the assessment skills and adequate demonstratable knowledge of the domain area, but need not actually hold a relevant current licence themselves.
Part b:
Question explicitly asked for examples; you hardly seemed to do so.  Rather vague statement about evidence being "signed off by manager and/or assessor"; there could be witness statements, mentor reports etc. verified by any appropriate (generally licensed) individual and the line manager typically examines logbook etc. and signs to say that the candidate is ready for assessment and then the WPA makes a judgement whether that piece of evidence is valid and demonstrates the CAC which it is claimed to do so.

Part c:
Again there was too much focus on the mechanics of the IRSE licensing scheme, rather than the person and how to increase their level of competence and restrict what they can do and how they can do it in the interim.  Indeed a person can make an error in all sorts of ways for which a complaint on their licence would neither be fair nor supportable- the complaint has to be based on the failure to perform in accordance with a defined CAC.  
My opinion (and I am afraid that I have had o do far too much thinking about such things recently!)  is that 
  • when there has been a deliberate violation then registering a complaint may well be appropriate, but 
  • should the error be an honest oversight or mistake then it would be very hard to make such a charge stick and it would very likely not be upheld upon appeal.  Until it is, then it does not get recorded in the IRSE logbook- this does not mean that there is not a lesson for the person / organisation to learn

I don't think this was one of your better answers.  It was a very decent length and well presented (apart from your tendency to overflow regularly into the right hand margin), but your really spent too much time talking about the IRSE licensing scheme and actually you weren't actually as familiar with that in all respects as you should have been given that you chose to very much focus your answer on to it.
It seemed to get progressively weaker as the question progressed.  Sensible amounts were written and there was not anything very wrong, even though it wasn't all completely right; however didn't feel you really "hit the nail squarely on the head".  I think that it would have passed, but not much more.
I wouldn't be very happy about answering this particular question well myself, but I think that your presentation of the material from the earlier attempt would have been a step in the right direction.
PJW
Reply
#5
I have also attempted the same question, feedback appreciated.


I have already added some comments having read previous attempts.
Reply
#6
(05-01-2016, 04:15 PM)dorothy.pipet Wrote: I have also attempted the same question, feedback appreciated.


I have already added some comments having read previous attempts.

6a.
Nothing really to add to those comments you have already gleaned.
Probably more emphasis on the initial stage of defining what competencies are actually needed to undertake a particular role.


6b.
Little to add here either; think I'd have made reference to Underpinning Knowledge to distinguish it from that which is immediately needed to perform the actual headline task in ideal circumstances.

6c.
Ditto.  
Wonder if the "informal review" is actually using the Competence Management System (which surely is the formal process)?
Answer focused only on post incident investigation, but think should have considered in wider context.
A model example I think is the way that NR signallers in turn routinely review the recorded conversations of their peers and there is a continual improvement process re the clarity of safety critical communications; there is a lot that signal engineers could learn from this.


In the real world, I think it is very difficult.  Such things tend to come to light only after there has been an incident and almost invariably a lot of people are involved none of whom is entirely blame free and have not always done everything that they should and generally have done something they shouldn't.  However the environment is such that the world isn't perfect and if everyone always followed every instruction to the letter then no one could actually do anything.  So people use their common sense and end some rules a bit and everyone does it and is broadly happy, perhaps for years. Then there is incident because sooner or later "the holes in the Swiss cheese" just happened to line up- so do you judge the people who happened to be involved on this occasion as "incompetent" when in fact acted no differently to others who are still deemed competent because they had the good fortune not to be involved on the thing that went wrong?
Then what about the person who simply made an honest oversight on one occasion; does that in itself put them outside the normal range.  We are all human and no one gets everything right every time.  

Hence to me a Competence Management System ought to be taking far more notice of whatever indications there can be of a person's continual level of performance (e.g. the number and type of Check Logs raised against a designer during the routine checking of their work, then the Test Logs subsequently being raised on the design) than focusing excessively on the more dramatic discovery of an error because of a serious incident.

I am sure that we can both think of a particular case in which:
a) a designer missed something when producing Control Tables from a not well presented initial Scheme Plan,
b) a checker identified that error, which was then corrected,
c) however another designer had meanwhile produced data to the pre-checked Control Tables but believed that these hadn't changed since the draft version so never revisited,
d) the original checker then inexplicably failed to identify the consequent omission from the data which they had themselves realised had affected the Control Tables,
and a similar sequence of "nearly but not quite" continued throughout the entire testing process which led to something highly undesirable being commissioned.........

No one proud of their involvement, but
1. at what point does the normal variation and lack of perfection of human performance actually become incompetent?
2. what would have been gained by restricting anyone's specified competence to continue to undertake such work.  Reality is that the staff involved had all had a personal wake-up call and therefore not only less likely to do the same again but indeed less likely than others to make such a mistake in future....
3. what is the advantage of "punishing" someone for making a mistake that they didn't want to make in the first place?

So my personal view is that one should do more continual routine monitoring but only take significant action after an incident where someone knowingly acted recklessly or whose performance clearly fell well below that which one would expected from the average person of that defined competence when placed into that scenario.

End of Rant.
PJW
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)