Following indicators will be measured during the running test period: The aim will be to
improve the indicator values compared with the start and the end. Target of the indicator
values will be set in consultation with the stakeholders, at the start of running test period,
aiming at a level where business can be achieved without difficulty (CBM-NET).
• Reduction of the number of business operation errors (which are the number of
incorrect data inputs that are corrected by reverse transaction inputs; overall business
mistakes, which are found and adjusted by multiple checking procedures are not
counted.)
• Reduction of the number of system operation mistakes
(2)
System continuity
The status of manual preparation and training delivery are measured as indicators. The
manuals are expected to be prepared prior to the entry into service of the ICT system.
However, even in the case where some part of the manuals is not prepared in time, entry into
service may be deemed appropriate under condition that the consultant determines that this
incompletion is already being addressed (e.g. documentation is delayed but running test
results confirm that operation can be conducted without any concerns for utilization). In such
cases, the unachieved issues will be addressed as part of CBM’s autonomous program of
continuous technical improvement.
•
Status of manual preparation
Target: In order to run CBM-NET daily operation continuously, the minimum set
of manuals (NB1) is specified, and the preparation status of the necessary manuals is
reported.
(NB 1): status that manuals for cheque truncation, fund management (MMK), fund
management (foreign currency), credit and collateral management, bond
management, bond transfer, common business operations for CBM, and disaster
recovery
Indicator: Manual preparation status = number of prepared manuals / total number
of manuals to be prepared
•
Status of training
Target: Adequate trainings and briefings are conducted for the bank officers
identified in CBM and in commercial banks as the users of the ICT system. At
CBM this means at least 2 officers from each branch or HQ where there is a
department that either operates or uses the system for business. In the case of the
commercial banks, this means at least 2 officers from each branch using CBMNET.
Indicator: Status of training = number of officers trained / total number of officers
to be trained.
•
Understanding of the training
Target: officers of CBM and the commercial banks properly understand the
training and briefing they have been given. Responses to the CBM-NET basic
outline’s 5 stage evaluation (1. Completely understood; 2. Mostly understood; 3.
Basically understood; 4. Some parts not understood; 5. Not understood) (NB 2) must
be 3 or above.
(NB2) Questionnaire evaluation items and evaluation parameters are to be
reappraised during the period of operation
Indicator: Check understanding by questionnaire.
3