Commission Regulation (EU) No 822/2010Show full title

4. Annex V to Regulation (EC) No 198/2006 is replaced by the following:

“‘ANNEX V QUALITY REPORT FORMAT

Member States shall submit quality reports to be written according to a standard quality-reporting format provided by the Commission (Eurostat). A copy of the national questionnaire shall accompany the quality report.

1. RELEVANCE

Implementation of the survey and the degree to which statistics meet current and potential users’ needs. This covers a description of users and their individual needs as well as an evaluation of to what degree these needs have been satisfied.

2. ACCURACY

2.1. Sampling errors

This covers:

• Description of the sample design and the realised sample.

• Description of the calculation of the final weights including non-response model and auxiliary variables used, estimator used, e.g. Horvitz-Thompson estimator, variance of the estimates according to the sample strata, variance estimation software, in particular, a description of the auxiliary variables or information used should be reported in order to recalculate the final weights within Eurostat since it is needed for variance estimation.

• In case of non-response analysis, a description of the biases in the sample and results.

Tables to be provided (broken down by NACE Rev.2 and size classes according to the national sampling plan):

• Number of enterprises in the sampling frame.

• Number of enterprises in the sample.

Tables to be provided (broken down by NACE Rev.2 and size classes according to the national sampling plan, however allocation according to the observed enterprise characteristics):

• Coefficients of variation(1) for the following key statistics.

• Total number of persons employed, total number of enterprises that provided CVT, ratio of the total number of enterprises that provided CVT to the total number of enterprises.

• Total number of enterprises that provided CVT courses, ratio of the total number of enterprises that provided CVT courses to the total number of enterprises.

• Total number of persons employed in enterprises that provided CVT, total number of participants in CVT courses, ratio of the total number of participants in CVT courses to the total number of persons employed, ratio of the total number of participants in CVT courses to the total number of persons employed in enterprises that provided CVT.

• Total costs of CVT courses.

• Total number of enterprises providing IVT, total number of participants in IVT, ratio of the total number of enterprises providing IVT to the total number of enterprises.

2.2. Non-sampling errors

2.2.1. Coverage errors

This covers:

• Description of the register used for sampling and its overall quality, information included in the register, and its updating frequency.

• Errors due to the discrepancies between the sampling frame and the target population and sub-populations (over-coverage, under-coverage, misclassifications).

• Methods used to obtain this information and notes on the processing of misclassifications.

Tables to be provided (broken down by NACE Rev.2 and size classes according to the national sampling plan, however allocation according to the observed enterprise characteristics):

• Number of enterprises.

• Ratio of the number of enterprises for which the observed strata equals the sampling strata.

2.2.2. Measurement errors

Where appropriate an assessment of errors that occurred at the stage of data collection due for example to:

• The questionnaire design (results of pre-tests or laboratory methods; questioning strategies).

• Reporting unit/respondent considering the data collection mode used (e.g. problems and strategies to find the appropriate respondent(s) in the enterprise, memory problems, errors when filling the forms, assistance to the respondent). This includes a description and assessment of measures taken to assure the high quality of the information related to “participants” and to assure that “participant events” were not collected.

• Existence/use of relevant information systems and administrative records in the enterprise, e.g. correspondence between the administrative and survey concept (reference period, availability of individual data).

• Methods used to reduce this kind of errors, problems with the questionnaire as a whole or with single questions.

2.2.3. Processing errors

This covers a description of the data editing process such as processing system and tools used, errors due to coding, editing, weighting or tabulation, quality checks at macro/micro level and corrections/failed edits.

2.2.4. Non-response errors

This covers an assessment of unit non-response and item non-response and a description of the measures undertaken regarding “re-contacts” as well as:

• Full report on imputation procedures including methods used for imputation and/or re-weighting.

• Methodological notes and results of non-response analysis or other methods to assess the effects of non-response.

Tables to be provided (broken down by NACE Rev.2 and size classes according to the national sampling plan, however allocation according to the observed enterprise characteristics):

• Unit response rates(2).

• Item response rates(3) for the following with respect to all respondents: total number of hours work as a function of all respondents and total labour cost as a function of all respondents.

• Item response rates for the following with respect to enterprises offering CVT courses:

  • Total number of participants in courses, males, females as a function of enterprises offering CVT courses.

  • Total number of hours on CVT courses as a function of enterprises offering CVT courses, number of hours on CVT courses managed internally and externally as a function of enterprises offering CVT courses.

  • Total costs of CVT courses as a function of enterprises offering CVT courses.

• Item response rates for the following with respect to enterprises offering IVT: Total number of participants in IVT as a function of enterprises offering IVT.

3. TIMELINESS AND PUNCTUALITY

This covers a table of dates when each of the following phases of the project started and ended such as fieldwork (considering the different data collection modes), reminders and follow-up, data checking and editing, further validation and imputation, non-response survey (as appropriate) and estimations as well as data transmission to Eurostat and dissemination of national results.

4. ACCESSIBILITY AND CLARITY

This covers the type of results sent to enterprises, a dissemination scheme of results and a copy of any methodological documents relating to the statistics provided.

5. COMPARABILITY

This covers the deviations from the standard European questionnaire and definitions provided in the manual referred to in Article 8 and a description of links done with other statistical sources (use of certain data available in registers, survey linked to another national survey).

6. COHERENCE

This covers a comparison of statistics for the same phenomenon or item from other surveys or sources and an assessment of coherence with structural business statistics for the number of persons employed as a function of NACE Rev.2 and Size Group.

Tables to provide (broken down by NACE Rev.2 and size classes according to the national sampling plan, however allocation according to the observed enterprise characteristics):

• Number of persons employed from structural business statistics and number of persons employed from CVTS.

• Percentage of differences (SBS — CVTS)/SBS.

7. COST AND BURDEN

This covers an analysis of the burden and benefit at national level through, for example, a consideration of average time for answering to each questionnaire, problematic questions and variables, variables most/least useful in describing CVT at national level, estimated or actual satisfaction level of data users at national level, difference of burden between for small and large enterprises and efforts made to reduce burden.”

(1)

The coefficient of variation is the ratio of the square root of the variance of the estimator to the expected value. It is estimated by the ratio of the square root of the estimate of the sampling variance to the estimated value. The estimation of the sampling variance must take into account the sampling design and changes of strata.

(2)

The unit response rate is the ratio of the number of in scope respondents to the number of questionnaires sent to the population selected.

(3)

The item response rate for a variable is the ratio of the number of available data to the number of available and missing data (equal to the number of in scope respondents).’